Negating talk of caste playing a role in the BJP not going beyond 240 in the Lok Sabha elections, Union Environment Minister Bhupender Yadav has said the Congress is indulging in politics of polarisation while ignoring affirmative action.