I'm not 100% sure @ the moment where High Street was (I grew up in Jersey City myself). I do know that West Hoboken has nothing to do with present day Hoboken. The current city of Union City was once two different towns, West Hoboken & Union Hill. I belong to a schuetzenverien in North Bergen, & one of the other clubs there is Union Hill Turnverein.
The brewery is long gone, it was on Summit Avenue & was razed to build Roosevelt Stadium which has also been razed & now has a school on the site.
I've been to St. John's Lutheran Church on Summit Avenue & North Street, just give the minister a call. St. Johns has absorbed into it Trinitatis Lutheran Church from Bowers Street & All Souls Lutheran Church (my dad went there) on Paterson Street.