I haven't progressed much with this family.
I do now have the following:
William Tay m. Ann ?? around 1778
children found so far
William b. 1779 Kings Norton (Worcestershire)
John b. about 1786 Kings Norton d. 1857
m. Ann Taylor 25th February 1811, St. Martin's Church Birmingham
Children Jane b. 20 April 1817 Birmingham
m. Thomas Lloyd
William b. 17th October 1820
m. Mary ??
Obviously there are gaps in the generations where there must have been more children but no trace of them so far.