The Congress has declared that there is no question of the Prime Minister moving out of his office- a suggestion made by allies Mamata Banerjee andMulayam Singh Yadav last evening, creating a perfect storm. "We cannot spare Dr Manmohan Singh," said the party spokesperson Janardhan Dwivedi.