yes i know how you feel, they get on my nerves and the worst thing is that i almost lose every time they do this to me although it doesn't have anything to do with chances. one of the solutions is to kick players if they don't start the fight after a certain amount of time.
it might seem really insignificant but believe me, things add up and small things like these can become a reason for people to quit. i mean when i play a game i want to change my mood or entertain myself, so if i keep encountering nuisances like these i might as well do something else to entertain myself, like watching anime,movies or playing other games...etc
