Rowe - Swett - Atwood

My grandfather was James Swett Rowe, b. 4/28/1835, probably in Hampden, d. about 1901 in Orrington. His parents were Moses Rowe (1781-1858) and Joanna Atwood Swett (1802-1901), m. 12/29/1828. (Moses had two previous wives, Mary Dyer and Jane Webster, for a total of 20 children). Joanna Atwood Swett was the daughter of Benjamin Swett (b. 1769 or 1779, d. 1854 Hampden) and Mehitabel Atwood (1774-1839); they married apparently in 1801 after his first wife Joanna Atwood of Wellfleet MA died.

Near the end of the last century, James Swett Rowe gave a talk at the centennial celebration of Orrington, of which I have a copy. He provided information which has helped me trace the Rowe, Atwood and Dean lines, but mentioned nothing about the Swetts beyond his grandfather Benjamin. Most likely Benjamin Swett came from Cape Cod, as did all the other families mentioned. If anyone can connect Benjamin to his ancestors, I'd like to hear the story.