The Madras High Court on Wednesday allowed the Tamil Nadu government to go ahead with the opening ceremony of "Veda Nilayam" memorial, the residence of late Chief Minister J Jayalalithaa here, on Thursday but ordered that the building shall not be thrown open to the public.