Safari allowing notifications without permission

A few minutes ago, a notification popped up from [youtube.com](http://youtube.com) on my mac. This hasn't happened before, and I haven't used YouTube since yesterday. I'm 99% sure I didn't accidentally allow notifications from them, since the notification pop-up is very noticeable and I never click allow before reading pop-ups. When I went into the notification section on my Mac to turn it off, I noticed about a dozen websites, most of which are advertisement and survey websites had notifications enabled. I know for a fact that I have never allowed any notifications from any website on Safari, and since it's been only two months since I got this mac, I'm pretty sure I couldn't have misclicked this often. Has this happened to anyone else? Might Safari be allowing notifications without permission? (since it's very buggy, and just while writing this I noticed three different bugs, one which caused me to have to restart my system and re-write the post).