You can't. You can increase your privacy settings, though, to prevent them from getting notifications of your forum activities. You can also block people, after viewing their profile.
