When people think about retirement regrets, they usually point to blunders like filing for Social Security too early, investing too conservatively, or not planning well enough for healthcare expenses.