I'm not too sure of how the KIA works against the Sicilian, I'm not an e4 player. But in general, I'd advise against switching up your game because a certain opening annoys or bothers you. I used to do this quite a bit (I'm looking at you, Benko gambit
) and was given some good advice about not doing it.
First, part of the reason we stick with certain openings and lines is we know those lines and become more familiar and stronger in them. When we switch an opening to spite the opponent, we're taking us out of territory we know best and going down to his level. It evens the game, which gives away a bit of your psychological advantage.
Secondly, the main lines of openings are typically the most critical. If you play a sideline, you're less likely to gain an advantage and the opponent will usually have fewer problems in the opening.
IMO, and from my own experience, it's worth putting in the time and effort to learn the main lines.