Hi Faye, nearest match (unproven) I can find for a first marriage of John b 1802 is Elizabeth Sutton b 23 Jun 1805 in Rawdon Guisley. Married on the 22 Dec 1825 @ Guisley St Oswald. It does state John is a Widow in his second marriage to Elizabeth Smith on the 3 Mar 1835. So your James may have this mother.
There might also be other siblings of James which I will check on.

Regards
Robert Proctor (Lancashire)