You might find the answer in a local newspaper. I'd look for the newspaper at http://mdah.state.ms.us/arrec/faq.php#birth
which has newspapers starting 1801.
If you don't find it there, I'd check with your local, public library and ask them to locate it on microfilm via inter-library loan. Successful Searching!