Have you looked in the Tallahassee area? I noticed that one of my ancestors (a Spier) witnessed a will for a Robert B. Oliver and his wife Sarah in Tallahassee. This Oliver would be too old to be your R. B. Oliver as the will was in the mid 1800's. Parts of Tallahassee were considered Jefferson County as some points, though. So, maybe a clue.