Elizabeth Riley/Reilly may have been born in New Brunswick -- both children Edgar and Helena were baptized in Port Elgin, NB although born in Tidnish, Cumberland County, NS.
Patrick Reilly was listed a godfather on Edgar's and Ellen Reilly listed as a godmother on Helena's. (John Reilly listed as father -- born 1790 Ireland)
On both birth certificates, it is indicated that their father James Helm was born in Prince Edward Island. If so, perhaps his mother Sarah Jane King may also have been from there.
There is a family -- Michael & Sarah King -- living on PEI who have a son Owen, but he would be too young to be Sarah Jane's father. Perhaps, Michael King was a brother??
To view birth records:
www.novascotiagenealogy.com