Hello: They were in Taylorsville, in Alexander County in 1870. The census says they were all born in NC, but the censustaker probably assumed that as I see several pages where everyone was born in NC, which is unusual. In any case, his first wife was still alive in 1870, and the youngest child, Julian was less than one year old ( indicated as five months old, born in Dec, but the census page is dated the end of July 1870, which doesn't agree).
Best wishes
Norm Dawson
Calgary AB