I was wondering the exact same thing. I show Martha Hubbard (11) and two younger siblings living with a family of another name in the 1860 census. That is as far back as I seem to be able to go.