The only agency keeping vital records of births and deaths from that period would be located in the Maryland Archives, Hall of Records, Annapolis, MD. You can find some such records online. Ellicott City is located in Howard County (created in 1851 from a part of Anne Arundel County) and some birth records are broken down by county.