If he completed a full 21 years engagement with the Army then there will probably be pension records that detail his service, next of kin, any marriage and any children.

Possibly helpful - the nearest paper mill to Pontypridd was, I believe, in Ely, north-west Cardiff: maybe he moved from Pontypridd to be closer to his work at the paper mill?