I have an 1851 census entry here: http://www.douglashistory.co.uk/history/Lists/1851%20census%...
The page is badly laid out, but there is this: Kirkcudbright DOUGLAS ROBERT SERVANT U 15 FARM SERVANT KKD PARTON
A century too late for your Robert, but maybe there is a connection.