You can try vinegar, I don't know that it kills them but I know they don't like it. Also chasing with a fly swat is good fun