A case under the Arms Act was registered against him at the Nizamuddin police station.
About the pistols found in his son's house, Buta Singh said: 'My son was a shooting champion and all the guns are licensed but only my son knows where the licences are.'
He has refused to step down as chairman of the National Commission for Scheduled Castes/Scheduled Tribes and maintains the charges against his son are a 'conspiracy' against him and his family.
'I am a chairman of a constitutional forum, why would I resign? I do not know what transpired between him (others in the case) and my son. Under pressure (my son) would have made it (the confession),' Buta Singh had said Saturday.
According to the CBI, the corruption case against Sweety Singh follows a complaint from Nashik-based contractor Ramraj Patil.
Patil alleged that Sweety Singh demanded a bribe of Rs.30 million for the withdrawal of a case filed against Patil by a group of conservancy workers employed by him (Patil).
Patil is a garbage collection contractor with the Nashik Municipal Corporation. Some 100 workers complained he was not paying their wages and had taken a bank loan of Rs.100 million (Rs.10 crore) in their name.