Bihar Chief Minister Nitish Kumar today said his government would soon start work on a caste census after taking the views of all parties, backing opposition leader Tejashwi Yadav's demand in his latest snub to ally BJP. An all-party meet on a caste census is likely on May 27.