It would probably have been difficult for a man, living on his own, without a wife, to bring up a child who was only 4 years old, and work at the same time. In 1901, Alfred is with his wife and Frederick.
In 1911, Alfred is living with other people, in shared accommodation, and Frederick is living with his Aunt, and his maternal grandparents. This would probably be a normal thing to do.
1901
Address: 2, Cranmer Road, Croydon County: Surrey
Name Relation Condition Sex Age Birth Year Occupation , Disability Where Born
CHANDLER, Alfred T Head Married M 35 1866 Contractor's Carman EwellSurrey
CHANDLER, Emma Wife Married F 30 1871 EwellSurrey
CHANDLER, Frederick A Son M 0 (7 MOS) 1901 CroydonSurrey
KING, Harold W T Boarder Single M 22 1879 Printers Compositor Gravesend Kent
1911
Address: 7 Queen St Croydon County: Surrey
Name Relation Condition/Yrs married Sex Age Birth Year Occupation Where Born
WOODS, Edwin Head M 55 1856 Carman Waltonfield Essex
WOODS, Jane Wife F 49 1862 Bracken Bucks
CHANDLER, Alf Widower M 47 1864 Carman Ewell Surrey
BLACKWELL, Charley Single M 59 1852 Turner Labourer Little Marloes Bucks
1911
Address: 304 Powerscourt Road Buckland Portsmouth County: Hampshire
Name Relation Condition/Yrs married Sex Age Birth Year Occupation Where Born
HOLMES, Agnes Mary Wife Married F 38 1873 Ewell Surrey
HOLMES, William John Son M 14 1897 School Portsmouth
HOLMES, Constance Daughter F 6 1905 School Portsmouth
DAVEY, William Father In Law Married M 81 1830 Retired Bricklayer Lingfield urrey
DAVEY, Anna Mother In Law Married 52 years F 72 1839 Godstone Surrey
CHANDLEY, Frederick Nephew M 10 1901 School Croydon Surrey
MARRIAGE
Name: CHANDLER, Alfred Thomas married Emma Davey
Registration district: Epsom
County: Surrey
Year of registration: 1896
Quarter of registration: Jul-Aug-Sep
Spouse's last name Not available before 1912
Volume no: 2A
Page no: 28