I believe that land was owned by Captain Thomas Jones in the mid 1700s. I believe Frances Pickle was the owner prior to that.
Captain Thomas Jones Tavern is currently an office building at 90 Beaver Ave, Clinton 08809. You can google to find photos and information on the building and what went on at his property during the Revolutionary War.
I stopped off at the North Branch of the Hunterdon County Library and checked out a series of maps:
"Hammond, D. Stanton, III. Genealogical Society of New Jersey Map Series # 4 (s.l.: 1965). This series
shows early land ownership in Hunterdon County. There is an 'Index Map, 1688-1765,' and Sheets A,
B, C, D, E, F, and G. These maps were indexed by William H. Blue (see above), and a copy of the
index accompanies the maps."

The map shows the Vought House, with Captain Thomas Jones two properties to the east, then Conrad Pickel to the east of that. I believe Conrad Pickel to be an ancestor of mine and Frances was his brother. Superimposing the old map with a current map it appears Captain Jones owned land from the Shammy Shine Car Wash to East Street and going 1000 yards north, with Conrad owning the property that Miller's, Immaculate Conception Church and Exxon Research is currently located on.

You asked about 46 Center St. property history. I probably took you back futher than you were expecting, long before anything was built.

Here is a map of Annandale Village from 1873 showing property owners: http://www.toyarts.com/annandale/gallery/1873_beers_annandal...
More maps listed here: http://www.toyarts.com/annandale/gallery/maps.html

There are other maps at the library, but some are located only at the main branch.
http://www.hclibrary.us/pdfs/ref/genealogysources.pdf