I am so sorry about the losses in your father's family. Your grandmother must have been very heartbroken losing three daughters. And, your grandfather losing even more.
I was rereading this post I realized I added a brother. But then I also lost a lot of my records when my last computer crashed, so not sure just what information I have.
But I am related through Jesse Payne's youngest brother Joseph (Ben) Paine.