Besides, if they don't look for you, don't mess with them. They're not like you. They speak differently, dare not do the same thing, and have different futures.
If I were you, I would take some self-defense equipment. If they come, show them. If they threaten you, you can stab them in the arm or thigh. Just poke it. This is a once and for all solution.