Was I in the Wrong?— How to deal

Hey folks, 22M here. Yesterday, I traveled to Jaipur for an exam, which went smoothly (I even think I might have qualified). Afterward, near Sindhi Camp, I boarded a bus to return to my hometown. I put in my earphones, and shortly after, a transgender person approached me, asking for money. I politely smiled and said, "NO," trying not to offend. They asked again, and I responded, "Sorry mere paas nahi hain aap aage puchh lo," then resumed listening to music. Suddenly, they yanked out my earphones and said, "Tu kuwara hi marega re," before moving on to the next passenger. I'm confused and overthinking this encounter. Was I wrong not to give money? Is this their typical behavior? This was my first experience in such a situation, and societal conditioning makes me take these interactions seriously. Any advice?