The only county hospital in the Town of Washington or nearby area might have been the county Infirmary. I worked there right out of high school.
There are still a few big estates in Millbrook, the town hall could give you the town historian's phone number.