From the context, I would say he's using a different meaning of the word "inmate", meaning "one who
lives with another". In other words, referring to himself as an inmate means the son was living with the father.