I used to do that too. You only have to care what the people close to you think about you. You can't do everything right for everyone, people will have opinions about everyone and everything. And the ones who are negative and try to talk shit about you, are the ones who envy you. Try to let it go, it makes life easier.