Nice shot. Love the mix of symmetry and asymmetry.

I completely understand about the fear, but there are a few things I believe and will share if I ever get challenged (which I haven't even once in three years) because I firmly believe in my reasons for doing what I do.

1. I try to capture street life in its most natural form.
2. I never shoot with the intention to make anyone look foolish
3. I never take advantage of the homeless or sick, unless it's saying something particularly important
4. If anyone still disagrees then I'll happily delete the picture and apologise.

Don't get me wrong, I'd feel bad if I got challenged but I would do my very best to get across the reasons for what I'm doing.

If you can be clear and believe in your approach then I'm sure you'll be fine. I like to think that people recognise genuine intent, and you certainly seem like a genuine guy. Can't wait to see some more street photography from you!