Taking a veiled swipe at his arch-rival Sachin Pilot, Rajasthan Chief Minister Ashok Gehlot today said he wants to leave the Chief Minister post, but the "post doesn't let me go".