If you search on National Records of Scotland you may find documents that link your ancestor to ones in Scotland. There are two main lines of Ogilvy/Ogilvie, one is the Ogilvy of that Ilk, namesakes of the very first and second is the Lords and Earls of Airlie who are a cadet branch. Those of Cortachy and Clova are not yet proven to be connected, but might be connected back in time.
Be careful as other users on the internet are not real genealogists or even amature and are generally wrong 99% of the time since most trees link to assumed information. Ask the people who you copied the information from and if they cannot answer or say they got it from elsewhere, this is a non-reliable source.