Pulling away from friends

Hey guys I'm currently pulling away from friends and am scared to approach them because I don't have a job and don't really do anything interesting. So I don't have much to tell. Also one of my mates has been making funnily intended remarks towards me, but they feel like stabs to the heart. Does anyone have advice to stop me from pulling away from my mates? I also have slowly growing anxiety. Every time I meet up with them the anxiety for the next time gets even worse.