The image is that of the Royal Coat of Arms. It is probably there to denote his service in the Imperial Forces.

In the case of graves tended by the Commonwealth Wargraves Commission they have the deceased Service/Regimental cap badge. This may be on a similar basis.