I agree, it was probably the Palace of Fine Arts, here's a picture:

http://www.exploratorium.edu/history/palace/fountain.html

Though, it is fenced in now. :-(

If that's not it, then it might be one of the "ponds" at Golden Gate Park.