Texas Historical Marker

Sargent-Rugeley House

Bay City · Matagorda County · placed 2015 · Recorded Texas Historic Landmark

Cowboys & Cattle

Hear Duane tell it

Matagorda County, Texas

Duane's take

Here's my telling of what the Texas Historical Commission put down on the marker for the Sargent-Rugeley House in Matagorda County. Now settle in, because this story starts with loss and ends with something that'll outlast most of us by a good long while. John Thomas Sargent was born in 1834, and by the time Texas cattle country was writing its legends, he was one of the men holding the pen.

A prominent cattleman, the kind of man a community leans on. But life has a way of leveling even the most prominent of men. A devastating storm — and the Texas coast does not play at storms — took his home, took his wife, and took his father.

In one blow. You don't come back from something like that the same man you were before. What you do is you keep going.

John purchased a home in Matagorda for his family and, in 1881, he married Jane Ann Bates. She was born in 1858, and she would outlive nearly everyone in this story, not passing until 1945. Remember that number.

She carried this family a long, long way. By the turn of the twentieth century, Bay City was flourishing. Houses and buildings going up all over, and the Sargents were right in the thick of it.

In 1905, Jane purchased several lots in the Hamilton Heights subdivision — one of the highest points in Bay City, which, if you've been watching the Gulf horizon your whole life, you understand is not a small thing. Those lots were meant for their daughter, Catherine Minna Sargent Rugeley, born in 1884, and her husband, James Walcott Rugeley, born in 1874. John Sargent himself helped design the home, a father drawing up plans for the life his daughter was about to live.

They hired a man named J.S. Gibson in 1905 to build it, and what Gibson put up was a three-story Victorian — twenty-six rooms, if you can picture that, including bathrooms and pantries, winding staircases, transom windows, and custom hardware. Beveled and stained glass catching the light.

Cypress shutters built to stand up to whatever the coast might throw at them. And the lumber? Shipped all the way from Calcasieu Parish, Louisiana.

Nothing about this house was accidental. Now, folks around Bay City took to calling it Miss Kate Rugeley's Home, though John and Jane lived there too for a stretch. After John Sargent died in 1911, the house was remodeled — Prairie and Greek Revival elements layered onto that Victorian bones, the house itself growing and changing like the family inside it.

A large veranda wrapping it all together, the kind of porch that says come sit, the day's not over yet. James Rugeley wasn't just the man who married into a good family. He owned a local cotton gin and was a respected leader in that community in his own right, right up until his death in 1935.

Catherine lived on until 1967. And Jane Ann Bates Sargent, that remarkable woman who purchased those lots back in 1905, who outlived her husband by thirty-four years and watched Bay City keep on growing around the house she helped build — she made it to 1945. The home stayed in the Sargent-Rugeley family until 1969.

That is sixty-four years of one family in one house on one of the highest points in Bay City. Three stories. Twenty-six rooms.

Lumber from Louisiana. And a man who lost everything to a storm, helping to design something built to last. The Texas Historical Commission made it a Recorded Texas Historic Landmark in 2015.

Some houses are just walls and a roof. And then there's this one.

What the marker says

By the turn of the twentieth century, Bay City was a flourishing community with houses and buildings constructed all over the city. John Thomas Sargent (1834-1911), a prominent cattleman, purchased a home in Matagorda for his family after a devastating storm destroyed his home and took the lives of his wife and father. In 1881, John married Jane Ann Bates (1858-1945). In 1905, Jane purchased several lots in the Hamilton Heights subdivision, one of the highest points in Bay City. John Sargent assisted in the design of the new home planned for his daughter, Catherine Minna Sargent Rugeley (1884-1967), and her husband, James Walcott Rugeley (1874-1935). The home was often referred to as “Miss Kate Rugeley’s Home,” although John and Jane also lived in the house for a time. J.S. Gibson was hired in 1905 to construct the three-story home in the Victorian style. However, after the death of John Sargent, the home was remodeled with Prairie and Greek Revival elements. Features include a large veranda, beveled and stained glass, cypress shutters for storm protection, and lumber shipped from Calcasieu Parish in Louisiana. This stately home boasts 26 rooms, including bathrooms and pantries with winding staircases, transom windows and custom hardware. John and Jane Sargent were active in the communities of Matagorda and Bay City, involved in the Masonic Lodge, St. Mark’s Episcopal Church, and the Bay City Public Library Association. Their son-in-law, James Rugeley, owned a local cotton gin and was also a respected leader in the community. The home was in the Sargent-Rugeley family until 1969. Recorded Texas Historic Landmark – 2015

Hear thousands of these as you drive.

Duane reads Texas historical markers out loud, hands-free, in his own voice. Join early access and we'll tell you the moment he's ready to ride.