If you haven't done it already, you might send for his Civil War records. I was able to find a place of birth from a Civil War record.