Hope this is still active after 9 years. I am researching Frederick Holbrook Peat as he appears to have been a veteran of the American Civil War, serving for an uncertain period in the 5th Pennsylvania Volunteer Cavalry, and died in Hampshire, England in 1893. He was an officer in the British army, but is shown as being born in Jamaica.
Is he the same person as the one you are researching? If so, he appears to have had a somewhat complex marriage history, as he was married in England in 1847 to a Frances Jane Isabella Gregory, who died between 1861 and 1871, and the, in London in 1874 to Phoebe Barbara Franziska Lumley. One Ancestry Tree shows his two children as Frederick (one of the names you cite) and Georgina.
If we are dealing with the same person, I'd be interested to hear from you.