West Bengal Governor CV Ananda Bose on Friday filed a defamation case against Chief Minister Mamata Banerjee at the Calcutta High Court, a day after she said that women complained to her saying that they were afraid to visit the Raj Bhavan because of the activities there, a source said.