This is what my great aunt Priscilla Barkley Godfrey recorded about her grandmother Priscilla Elizabeth Bagby:
Priscilla Elizabeth Bagby was born 14 November, 1836 at "Society Hill", Stevensville, King and Queen Co., VA. She died 15 January, 1923 at Clifton Forge, VA, at the home of her daughter, and was buried in Clifton Forge. After the death of her husband in 1873, she cared for and brought up their four girls to maturity, and useful lives. She received something like 300 acres from her father's estate, with about fifteen slaves, who remained with her faithfully during the trying times of the Civil War. One of the woman slaves married a man from Norfolk, and lived there after the War; when Dr. Henley died, this woman (very aged), journeyed to her old mistress to mourn with her the loss of a dear master. Another, Sam Bagby, remained near his old mistress in a sort of reverential guardianship and readiness to be of aid to her should she require it. Sam did not follow the run of negroes into being a Republican in politics, and the death of his wife and burning of his house (possibly murder and arson) may not have been wholly disconnected from his leanings to the Democratic party, the death and buring occurring on an election day while Sam was absent at the polls. (He, and his family, were made members of the white Bruington Baptist Church, and were given permanent pews therein). Mrs. Henley removed from King and Queen County to Washington, D.C., in the summer of 1886, and there lived for about 10 years. etc.
I hope this gives you some dates and facts to continue your search.
This little bit of info also shows some of the horror visited upon Africian Americans after the War, as if they had not been through enough with their removal from their homeland and enslavement.
My Virginia parent tried to teach us the wrongness of slavery from an early age. We were taken to see the slave cabins on a cousin's farm (later we realized this was where Kunta Kinta had been so savagedly beaten). Our parents were NAACP members from the 1950's and as a family we participated in a demonstration in Dover, Delaware in 1962.
We watched Martin Luther King, Jr.'s I Have a Dream speech live, and were discussing what was going on in TN when we got the news of his assassination. When busing came to Newark, Delaware, my school board sitting parent made sure that his children were bused to the distant school.
The shame of descent from slave-owners is everlasting.