Okay I've been in contact on Ancestry with a 3rd Cousin (she's descended down through Henry Theodore Verge + Ellen Victoria Westhaver through their son Lindsay Verge who is her great-grandfather), and she says that her grandfather heard it from his own father (Lindsay Verge) that the Verges were French, German and Portuguese. Now the French and German I know to be correct because of the Westhaver and Boutilier ancestry, but the Portuguese is new to me.
Could it be that Joseph Verge (married to Mary Blewett in Massachusetts) was born in Portugal originally? Would that even be feasible?
(As an aside: I've tested my father's DNA (Henry Theodore Verge is is great-great-grandfather), and of the Verge matches he receives none of them are from the Newfoundland branch, not even in the 5th-8th cousin range. Would this be proof that the Newfoundland Verges are not related? Maybe?)