"You can step on anybody's toes, but not on his toe, " said Esfandiari, who was jailed for more than three months in 2007 during a visit to Iran.

CNN: Iran's Ahmadinejad to leave politics, newspaper reports