I suppose it's possible that James is the father of your McCulloughs. We literally have almost zero information on him. I've heard theories from family members such as he died shortly after arrival or he just took off on his own. I've even heard that he might not have existed and Hugh actually have been named James Hugh McCullough. I'm really not sure. If you find information on him you would be solving a mystery that has been pondered by genereations.