To the OP: If you don't care about what these people think of you, when they ask you what you're doing/where you're going, either ignore them completely, or tell them to **** off. Then, they'll stop talking to you & will avoid you, and the problem is solved.
I myself hate it when people ask me personal questions, especially strangers. I'll either ignore them completely, or tell them to to go hell. Problem solved.