Should I feel guilty about not liking my best friend anymore?

Man I have been best friends with him since about 1st grade we are both 19 now. For the last year or two we have been steadily growing apart. He had a girlfriend and would ditch me to hang out with her which is understandable but now he wants to start chilling again but I don’t want to hang with him anymore. I have nothing in common with him anymore but he lost all of his friends because he was with his girlfriend so much. I feel bad that I don’t want to hang with him since we were best friends for years but I really don’t want to hang with him to be honest. What should I do?