I don't have much data on Orr Hoag and his descendants, but you said his parents were Asa Hoag and Elizabeth Norton? My Hoag line is out of one of their other children, David Hoag.
The Hoag family tree page I'm looking at (from the Hogg DNA Project website, link below) says Orrin S. Hoag, son of Asa & Elizabeth, was actually born in Ohio in 1831. Looks like before 1820, Asa and Elizabeth had 5 children in NY, then after 1820 they must have been moving around, as there is one child listed as born in Vermont (Lavina Hoag, b 1822), and two children born in Ohio (Charles Hoag, b 1826; and Orrin S. Hoag, b 1831). Orrin was the youngest child.
Source:
http://hdhdata.org/cgi-bin/showpage.pl?d2710&f04042