anxiety if i don’t do ram jaapa mentally?

I recently started doing ram jaapa at all times and it has done wonders for my mental health and clarity - no depression or anxiety when I do it, which have been big barriers for me all my life. however, if i stop because i’m engrossed in something worldly for an extended period of time (it doesn’t happen right away) my anxiety heightens, and it feels worse than before. I have also lost a lot of interest in many worldly things and only want to realize God. it has only been a few days and these worldly desires come creeping in similar to the anxieties when i stop chanting the mantra. can someone please explain why my anxiety has come back so strongly, if it is the result of ram naam cleansing my negative karmas or what, whenever i stop chanting mentally? i feel this is going to have to be a lifelong endeavor in changing this mantra, as i just feel so terrible without it.