The Michigan Birth certificates (online!!!) have Harriet Bayne MARRIED to Dexter. And James and Frank are her children. The Filkins family (Dexter is first born) are in NY....to this day. Move from NY to Michigan and very young pregnant women......This smacks of scandal....Harriet would be about 10 for conception, and 10 - 11 for October 1855 birth. Harriet and Dexter also have Warren T in 1861 and William in 1868 (have exact BDays thanks to Michigan data).
Then I think Harriet dies about 1871....Dexter marries Ann Wilson and they have two children Charles D 1877 Mabel 1879.
Maybe there's a better explanation for James and Frank's parents.....would love to think so....
RJ Samp