Former Prime Minister Rajiv Gandhi abolished the inheritance tax after his mother Indira Gandhi's death in 1984 to save her wealth from going to the government, Prime Minister Narendra Modi said, alleging that the Congress now wants to bring back the levy.