I believe your Simon Conn was in 1880 Marshall Co, AL in Mt. High. Here is the info:

1880 Marshall Co, AL Census; District 258, Mt. High:

Simean Conn, self, md, white, M, 56, GA, Farmer, SC, SC
Manerva J, wife, md, F, 43, GA, Keeps House, SC, SC
Millie Goodwin, SDau, F, 18, AL, works on farm, SC, GA
Martha Goodwin, SDau, F, 18, AL works on farm, SC, GA
Starlin L. Conn, Son, M, 13, AL works on farm, GA, GA
Samuel A Conn, Son, M, 6, AL works on farm, GA, GA

------------------------------
Source Information:
Census Place Mt High, Marshall Co, AL
Family History Library Film 1254024
NA Film Number T9-0024
Page Number 261B
-------------
Based on the info you posted, I would bet this is his 2nd wife. Apparently Manerva was married to a Goodwin before, Simean/Simon, and since her (twin) daughters were born ca 1862, I bet he died in the Civil War. (If they had other children, they would probably be listed as well). Starlin L is probably Sterling.

Can you email me the info you have on the family in the 1870 census? I don't believe I am related, but he is close in age, and location to my Simon Conn. (Simon S Conn Sr b/1826, GA who married Alsrey Gentry and lived in Cherokee Co, GA in 1850). I do not have a death date or place of burial for my Simon and Alsrey, and do not have a census record for them in 1870, so I am trying to eliminate this Simean (of the 1880 Marshall Co, AL census) as my Simon with a 2nd wife. Thus, the 1870 census information and any other information you can share would be much appreciated. I think they could be cousins.

Please email at poetmom@aol.com as I do not check the boards often.