Even a policeman accompanying him for security did not deter a group of men from attacking a Punjab Shiv Sena leader with swords in the middle of a busy street in Ludhiana on Friday, allegedly over his controversial remarks against Sikhs.