You are better off to pay off your mortgage. That’s the decision I made when I retired. The S&P 500 could indeed go up 7% per year, but you have gotten too used to this long running bull market. It could also have 0% return over the next 5 years. Think about all the things that could send it into a downward spiral starting with a true trade war or a Trump impeachment, either of those are a distinct possibility.
I have been thinking similar lines today for my 100k outstanding balance in HELOC vs my keeping the investment money invested. I continue to hold my investments as the investment returns for this year is appx 37%.
If it is 7%, I would not mind paying off my mortgage as we have small difference of 5.6%-4% is 1.6% benefit.
Two reasons.
100k capital (If it is 5Million or 10 Million, case is different). Gain is not so much worth.
Even though you account 20% capital gain, you have not accounted equally 4.5% interest you deduct from your rent (If rental home) or primary (rent opportunity cost).
If it is strict 7% return and 100k, I would pay off debt even though financially I am wrong.
Paying off 4.5% mortgage will never be better financially if you only look at the math. But we are humans, not robots. (Alas, @harriet chased our only robot away… )
So you need to look at the whole package. I believe humans only have a limited capacity for taking risks. There’s only so much our brains can handle. So it can be that by paying off the primary house you take away the biggest financial risk in your life, and that in turn allows you to take more risks in stock market.
It’s the same way how people are more rational playing with “house money” or only trading paper accounts. The pain is not as bad as if you are under other stress. Paradoxically you can take on far more risks by derisking in certain key vital areas.