Karmendra Singh Yadav is not following anyone