My Dooley's didn't leave Georgia until after the civil war. After the 1870 census. There are some other Dooley's in Fannin County though. I am not sure if they are related/ or how they could be related.