Spiritually speaking, am I a bad person for doing this, some people actually think so?

There's a homeless man living in my neighborhood, he's in his lat fifties, early sixties. He's actually wearing business casual attire, old and dirty of course. I think he was probably a victim of the recession and now has nothing left. I felt bad for him, he doesn't seem to like panhandling, he's quiet when he does and you can see the shame in his eyes. He's not like a homeless person whose on the street because they're an addict or they're mentally ill. I decided to try and do something for him, give him some hope. I spent about twelve bucks in an Aldi and got some food items, enough to last him a little while. One of my neighbors criticized me for it. She just knocked on my door and told me she'd report me to the police since there's supposed to be a law against giving stuff to homeless people. She was saying that it only encourages the man to panhandle more and inconveniences everyone. This is the same woman who criticizes me for not attending church, and lets the Religious solicitors into the building because she thinks I need to know more about Jesus. Adding insult to injury, a Muslim woman who lives two doors down (someone I defended once) also took offense. She sent me an email telling me that I shouldn't be encouraging that man to be in this area. Here I am, the outspoken Atheist activist in my neighborhood, and the Christians and Muslims are upset because I gave a homeless old man food. Am I bad for this? I feel like I've lost what little hope I had left for humanity because of this. If I'm a bad man for helping a poor old man, then I'm damn proud of being evil.