Hello Jared,
Wonder if this helps in any way ?.
Birth
Robert Rae
Born 3 Oct 1833 Glasgow
Baptised 13 Oct 1833

Found a Mary Rae could this be your Mary
1881 Census
28 Saltmarket
City of Glasgow
Blackfriars
Lanarkshire
Scotland
Janet McGibbon Head Widow age 70 b.1811 Glasgow Scotland
Mary Rae Boarder Widow age 70 b.1811 Glasgow
Rebecca Rae Boarder Single age 30 b.1851 Glasgow Lappet Weaver

Wonder why The Below address is listed twice and strange enough both have Rae Families living in them Building could possibly be a Tenement Block
1881 Census
49 Glasgow Road
Rutherglen
Lanarkshire
Scotland
Thomas Rae Widower age 54 b.1827 Glasgow Cotton Yarn Dresser
Joanna Rae Daughter age 11 b.1870 Glasgow

1881 Census
49 Glasgow Road
Rutherglen
Lanarkshire
Scotland

Jane McCuean Married age 49 b.1832 Glasgow House Keeper
Jane McCuean Daughter Single age 23 b.1858 Rutherglen (Weaver Coloured)
Margaret McCuean Daughter Single age 21 b.1860 (Weaver Cotton)
Mary McCuean Daughter age 11 b.1870 Glasgow
Mary Rae Relative Single age 18 b.1863 Glasgow (Weaver Cotton)
Maggie Rae Relative Single age 16 b.1865 Glasgow (Weaver Cotton)

Hope this helps in some way ?.
Regards
Maureen.
Liverpool.U.K.