What can I do to avoid fighting Whiterun?

So I've joined the Stormcloaks because these Imperial guys kept attacking me. Now Stormcloaks want to attack Whiterun but I like Whiterun. What do I do?

Turns out Whiterun likes Imperials... Hmm..