There is more evidence pointing toward Lancashire or Lancaster, because his army records also state he was born in Lancaster, St Mary's.
Further checks on Allerton parish records show that there are none uploaded online yet as there are many people born in this place on the censuses but no birth records. Perhaps Allerton was close to this 'St Mary's'.