According to "The Descendants of Francis Ellis, 1715-1997" (self-published by Wanda M. Ellis, 1825 W. Knight Drive, Durant, OK 74701, ©1997), Joseph was the s/o Francis ELLIS: b. c1715 in Somerset Co., MD; md. Amey [---], c1744 in MD. Francis' children included:
1. Sarah ELLIS; md. Benjamin WILLS
2. Benjamin ELLIS
3. Joshua ELLIS
4. Jesse ELLIS
Ms. Ellis lists the same children for Joshua & Abigail, although she flops Joshua (b. c1785) and Elisha (b. c1786).
Stephen Ellis md/1 Temperance "Tempy" ELLIS, d/o Joseph ELLIS & Esther [---], c1804 in Hancock Co., GA; md/2 Elizabeth [BUFFINGTON] MAYNARD, 08 Mar 1841.
I have not yet attempted to verify any of the above data. My wife descends from Stephen Ellis through his son, George M. ELLIS. George lived in Pike Co., GA, and Coosa Co., AL, before moving to Smith Co., TX, in the late 1850s. I hope this helps.