Here are the latest developments
The highlight of Mr Modi's visit will be prayers on the banks of the Ganga river, which he invoked repeatedly in his election campaign. The Dashashwamedh Ghat, venue of the 'Maha Arti' ceremony, has been spruced up with flowers and banners. Red carpets had been laid out. The ghat has, in fact, turned saffron with flags and BJP workers donning party colours. The boats, a familiar sight at the ghat, have been asked to stay away for a while. The spot where the 'Puja' is to be performed is awash with rose petals.
Security is tight at the ghat where the Ganga Arti attracts huge crowds everyday. A bomb explosion in 2010 at the ghat had killed two persons and left several others injured.
There is tight security in the rest of Varanasi too. A special team of the Gujarat Police carried out inspections of all areas that Mr Modi is likely to pass through.
Mr Modi landed at Babatpur Airport at around 4.45, and left for the Police Lines by chopper soon after. From Police Lines he drove to the famous Kashi Vishwanath Temple where he and his close confidante Amit Shah took part in a 'yajna' before reaching the Dashashwamedh Ghat to take part in the Ganga "Arti". Party workers and curious onlookers had gathered in large numbers all along the route.
A few days before Varanasi voted, the BJP was locked in a confrontation with the Election Commission when the district administration denied him permission to hold a rally in the city at a venue of the party's choice. He had instead driven through the town in a show of strength.
The BJP alleged that permission for prayers at the Ganga river and another event had come in too late to organise them. Mr Modi had offered an "apology to Ganga ma" and promised to visit later and offer prayers.
The local BJP unit said there was no formal communication on whether Modi would address the people of Varanasi. He won the seat by a margin of about 3.7 lakh votes. He won his other seat, Vadodara in Gujarat by 5.7 lakh votes.
This morning Mr Modi landed in Delhi to a massive welcome and addressed party workers at the BJP headquarters after a victory roadshow.
He thanked party workers for his spectacular victory in the general elections and said he would work for the good of all Indians. "This victory is dedicated to the sacrifices of generations of loyal party workers who have been working tirelessly since 1952. It's the fruit of their blessings, prayers and hard work," Mr Modi said as the crowd showered rose petals on him and chanted his name.
The BJP has won 282 seats in the Lok Sabha, 10 more than the majority mark. The national alliance led by the party has won 337 seats. Its the best performance by a political party since 1984.
Donald Trump Says He Will Meet PM Modi Next Week PM Modi To Visit US For Quad Summit, Attend UN Assembly From September 21-24 Over 600 Gifts, Mementos Received By PM Modi Up For E-auction 9 Dead, 2,800 Hurt As Pagers Explode Across Lebanon, Hezbollah Blames Israel 3 Grams Of Explosives Per Pager: Israel's Complex Op To Hurt Hezbollah "Wear Proper Undergarments": Delta Airlines' New Memo For Flight Attendants Video: Brazil Mayoral Candidate Attacks Opponent With Chair On Live TV 3 Grams Of Explosives Per Pager: Israel's Complex Op To Hurt Hezbollah Chandigarh Court's Notice To Kangana Ranaut Over 'Emergency' Controversy Track Latest News Live on NDTV.com and get news updates from India and around the world.