Are less relevant keywords worth it?

How *wide* do you cast your "net" if you've covered the lower KD% keywords *most* relevant to your business? (I don't want irrelevant traffic). Or is it a case of going back to the drawing board and improving on my keyword research? Or something else...