>>773899I just brush them off and they go away. The key is to be gentle and not scared or violent. Avoid slapping or making any movements that will crush part of the insect. They never come back once I brush them away, even if they were getting really into my shit due to the smell of food or whatnot. I have a theory that it's an instinctive behaviour to move on as a damage avoidance strategy.
If you kill one, then nearby ones will smell it and go nuts.