One of the attackers entered the church's premises and smashed a glass window.
The three men arrested for vandalizing a church in Delhi on Wednesday were drunk and were acting on a bet, the police today said.
"They had no connection with any political or fringe group," said senior Delhi police officer Tejinder Luthra.
The arrested men, Kaka, Raja and Ravinder, are all residents of Tilak Nagar in west Delhi, around two km from the church. Kaka is a mechanic and the others are unemployed.
Two of the men were clearly seen on CCTV, which helped the police track them down.
Ravinder, a Delhi University graduate, was seen coming to the church window at around 4.30 am on Wednesday morning, praying briefly and then hitting something.
He returned a few minutes later with another man on a bike and pulled at something from the window. Both men are seen driving off soon after.
"None of these people had any motivation to harm any religious sentiment. They were drunk and had challenged each other to do something that was sensational and would grab attention. When they came back to their senses, they were remorseful," Mr Luthra told reporters.
After seeing a statue toppled over on Wednesday morning, the church complained to the police.
This is the fourth such attack on a church in the capital city, with all previous cases remaining unsolved.