A "man of coat-armour" in medieval times would have been a squire, or armor-bearer to a knight. Later it seems to have meant someone who was entitled to his own coat of arms.
http://en.wikipedia.org/wiki/ArmigerI think by 1873, this term probably meant "gentleman"; i.e. "doesn't have to work for a living."