Manch,
I know you have a thing for Golden Gate Heights, but for me, I’ll take Telegraph Hill. Weather is usually the best in the city and it is close to North Beach, Fishermen’s Wharf, Chinatown, etc.
Man, I can’t afford the NE part of the city… Hopefully one day I can, but that day is not today… 
Who can? Even if my net worth were $10M, dropping half on a home would be a fools errand.
Yeah… you probably wouldn’t have gotten to $10M by having habits that involved splurging on $5M houses. 