The older you get, the harder it becomes to find time with your friends. Go out and do active things with them, go camping, spend all night driving around or playing pool and talking about life. That stuff will fade way before your physical fitness.