I checked Norinne Holman book 170 years of Cemetery Records in Milam Co. and found neither name buried in Peasant Hill.
I also check all of Milam Tx cemetery and found nothing.
I would suggest that you contact the cemetery office there is a chance he could have been buried without a headstone. I found that was the case with my husbands grandfather in Calif. If you have not already done so, it might help to get a copy of their obits.