He was apparently very busy. From ancestry.com family trees, I have found that he was married three times and had at least 13 children. He was born in Rockingham Co., VA in 1766. His first child, James B., was born before 1789 and James' mother was Mary Williams. Joseph was then married to Amelia Taylor on Feb. 5, 1789 in Fauquier Co., VA. They had ten children: John Joseph b. 1794 in VA, Elizabeth, Samuel, Mary "Polly", Joseph Washington, Henry Joseph, Amelia, Margaret "Peggy", Sarah Jane, Alexander and Daniel. Some of these children were born in VA and some were born in Coshocton Co., OH. After his 2nd wife died, he married Nancy Norris who was born in VA but married in OH around 1826-30. They had two children: Mahala Jean and Jennie Emily "Jane". I was only aware of their daughter Elizabeth, from whom I descend, but I got the other information from other people's trees. I don't know how accurate it is.