Prime Minister Narendra Modi today refuted criticism of his government's handling of the economy, stating a "handful of people" are trying to spread a contagion of pessimism based on the slowdown of the last economic quarter, when growth slowed to 5.7 per cent, the lowest in three years.