I am descended from William Elliot, who lived in Scarboro and was the brother of your James Elliot. I have visited the family parish of Westerkirk in Scotland, and can go back another generation on John Elliot, if you haven't gotten any more info in the meantime.
Regards,
Nora Elliott
Anchorage, Alaska