Voice Feedback on Siri not turning off

I wanna be able to type to siri without it responding to me out loud, I have the voice feedback setting off, but it still will say the answer out loud. Any fixes for this or is it just bugged?