Hi Chris,
Hayle's wharf was originally across Ross Ck. from Wickham St. on the South side near Tomlins St.
I believe they relocated in about the 1930/1940s to a site next door to Burns Philip (now Bullwinkles nightclub). They relocated when Burns Philip closed their wharf. It would have been at about 150 Flinders St. There is a car park there now.
Cheers.