Could you provide a bit more information on this family?
Do you know where any of the children were born and dates of same. Including your William E.
Checking 1860 and 1880 census of Floyd Co. does not come up with these names. There are Williams families and there is a Wm. H., but the dates do not work for him to be your ancestor.