If I'm paying income taxes shouldn't I purchase everything else without taxes ?

I fail to understand the rationale behind levying income taxes. If I have to pay taxes while purchasing everything, then why should I pay Income tax ? Alternatively, if I pay IT then other things should be made tax free.