I went to the Bemidji Library and found that J.Markhan is buried in Bemidji at the Greenwood Cemetery. He is buried in Or A. The original cemetery section A. It doesn't say anything about Belle. The book I looked at was one transcribed by volunteers so Belle may have been overlooked. I have not been to the cemetery to look. At the library there is an obit for Walter's wife who died in 2010. If you would like I can go and transcribe it for you.
Also, in the book "Bemidji First City On the Mississippi" 1896-1996 Bemidji Centennial there is a little on Joseph Markham. It says "...Bixby invited Joseph M. Markham, a Minnesota legislator from St. Hilaire, and convinced him that the village of Bemidji needed a fine new hotel like Markham had built in Crookston."
Hope this helps. I will try to get to the cemetery and see if I can find Joseph and Belle.