Here's a possibility:
1880 Chestnut Hill, Ashe, NC
J. W. Brewer, b. VA, 24, laborer
Louisa, b. NC, 21
Eli, b. NC, 1/12
That's all that I found except for the 1900 and 1910 Censuses you mentioned above. I did notice that Isom's birth in the 1900 Census was 1855 and in 1910 Census it was abt. 1852. Makes me wonder if his birth year at the cemetery is correct.
Do you have his obituary and death certificate? If not, I'd contact the Smyth-Bland Regional Library, www.sbrl.org/local-history
and Smyth County Genealogy, http://smythcountygs.org/
and ask about a copy of his obit.
I'd check www.familysearch.org/
for his death certificate. If they don't have it, you can order a copy from the Virginia Department of Health. Successful Searching!