Here is a link to Malvern Cemetery in Lennoxville. Many Bakers there and likely some of yours. I also found, in Drouin, a John Arthur Baker, son of William and Ida, born 1887 in Lennoxville. This was just a very quick look. There were Bakers in Lennoxville when I was growing up. They lived on Belvedere Street - a long-established Lennoxville family. I believe their names were Nancy and Reg. I believe their son still lives in that house. Belvedere Street is now called College Street. Search Canada411 and you will find him at that address and can contact him.
Just as an aside, there are many, many English-speaking people in Quebec. They are not descended from Scottish troops fighting in the War of 1812. Although I suppose a few of them might be. Some of them are descended from Americans who came in seeking land when southern Quebec was opened up to settlement after 1790; some of them came from England, Ireland and Scotland after the British took Quebec in 1759. Some of them came from Ireland during the potato famine or following the Highland Clearances. All this to say that you will find a large number of English-sounding names in Quebec, Baker among them.
If you can't find that Baker on College Street, e-mail me at
sreed85@sympatico.ca and I will send you his name and address.