I was thinking Stephen Barnes might be his father. He is listed along with my 3rd great grandmother Emeline Barnes Sutliff in the 1850 Census but listed as Edwin E Barnes. This is where I may be wrong because I'm assuming that Edwin E and Elliot E are the same person; both born about 1826 and living in the same town and county. I'm at a dead end with Stephen Barnes and the rest of the Barnes Family too. Let me know what you think.
Hopefully these links aren't broken:
"United States Census, 1850," Edwin E Barns in household of Stephen Barns (Canajoharie, Montgomery, New York, United States):
https://familysearch.org/pal:/MM9.1.1/MCTQ-2G4 "United States Census, 1860," Elliot Barnes (, Otsego, New York):
https://familysearch.org/pal:/MM9.1.1/MC43-6RW