Karnataka's by-poll campaign has come to an aggressive close as Chief Minister Siddaramaiah challenged Prime Minister Narendra Modi and minister BZ Zameer Ahmed Khan made an allegedly derogatory remark at HD Kumaraswamy.