There's an incorrectly transcribed Joseph Hunt b 1882 living with his father Joseph Tee (b 1847, Portsmouth) and family in Saffron Hill in the 1901 census on Ancestry. Worth a look?
Lots of the Havant Tees moved into Portsmouth in the nineteenth century.