You won't be able to find a death certificate for him because Mississippi didn't start using them until 1912.
You'll have to find his newspaper death notice or maybe the Tate County MS Genealogical & Historical Society, http://msgw.org/tate/gensoc.html
has inventoried their county cemeteries.
If you're not interested in purchasing the books they've created, ask them to do lookups for a donation to their society. Successful Searching!