Prime Minister Narendra Modi will not travel in November to Pakistan to attend the regional SAARC summit, said the government today, blaming "cross-border terror attacks" for creating an environment that is "not conducive" for the meeting of the eight-nation group.