OK, I checked my Doty book and here is what they say about Peter Doty but first I'll give you the interesting passage about his father Ormond.
Ormond Doty, son of Joseph Doty and Lucretia DeLong. Ormond lived in and around Albany NY during the Revolution. He was a loyalist and imprisoned at Albany on that charge. At the intercesssion of his brothers, who were patriots, was released on the condition of going to S. Wallingford, VT, at that time a wilderness.
Sarah b. Dutchess Co, NY 3/3/1769
Isaac b. prob Lansinburgh NY 12/30/1772
Joseph b. S. Wallingford VT 2/12/1775
Ormond b. SW, VT 2/11/1777 d. 12/1777
Peter b. SW, VT 12/6/1778
Elias b. SW, VT 3/6/ 1781
Lemira b. SW, VT 7/28/1783
Phebe b.. SW, VT 12/28/1785
Ormond #2 b. SW, VT 11/12/1787
Samuel b. SW, VT 11/23/1790
Acrilla b. SW, VT 10/30/1792
7080-Peter Doty, son of Ormond Doty and Phebe Vail b. S. Wallingford, VT Dec 6, 1778 m. there Hannah Aldrich b. Swanzey, N.H. dau. Silas Aldrich and Mehitabel Thair. She d. Peru, NY. He married 2d there Maria R. Spencer of Clarendon, VT b. Nov 7, 1814. He d. Peru 1862. She d. Nov 21, 1873.
Children by 1st wife:
1. Luoy m. Abraham Stover, child, live in Peru.
4. Silas b. Peru Apr 2, 1807
5. Sampson, lived Champlain, NY 1852-4.
And by 2nd wife b. Peru
11. Hiram, not m.
12. Lydia Ann b. Dec 18, 1839 not m.
There is no information on Charles, only his name listed. Some people in the book have stories and information like occupations but none listed for Peter.
The second Ormond listed (Peter's brother) is my ancestor, my gggg-grandfather so that is how we're connected.