Let the fly know you're not gonna kill him. Maybe he will understand and fly away. :p
Just kidding...lol...

Sometimes little things annoy us the most, it seems we're helpless ;)