Home Minister P Chidambaram has withdrawn his remarks referring to by-elections in the context of the Mullaperiyar dam issue which has created a furore in Kerala. "Like some other speakers, I also made a passing reference to the forthcoming by-election. I take back that remark," he said in a statement in New Delhi today.