Justice Kaur, who did not give any reason for her recusal, said she would refer the matter to the Acting Chief Justice for assigning the bail plea to another bench for today itself.
The bail plea was on Monday mentioned before a bench of Acting Chief Justice Gita Mittal and Justice C Hari Shankar and was listed for hearing on Tuesday.
Karti's parents P Chidambaram and Nalini Chidambaram, both senior advocates, were present in the courtroom.
Karti, the arrested son of former Union minister P Chidambaram, had moved the high court seeking bail, hours after a court in New Delhi sent him to judicial custody till March 24.
The court had also dismissed his appeal for an urgent hearing on his bail plea and the threat perception due to the fact that his father, as a Union minister in the previous UPA government, had handled several sensitive issues.
The court had sent him to Tihar Jail after the CBI, in whose custody he was quizzed for 12 days in a row after his arrest on February 28 from Chennai, said he was no longer required for further custodial interrogation.
The court said his bail plea would be heard on March 15 as scheduled.
Karti was arrested by the CBI on his return from the United Kingdom in connection with an FIR lodged on May 15 last year. It alleged irregularities in a Foreign Investment Promotion Board (FIPB) clearance given to a media house, INX Media, for receiving funds of about Rs 3.05 billion from overseas in 2007 when his father was the Union finance minister.
The CBI had initially alleged that Karti Chidambaram received Rs 1 million as a bribe for facilitating the FIPB clearance to INX Media. It, however, later revised the figure to $1 million (about Rs 65 million at the current exchange rate and Rs 45 million in 2007).
The fresh evidence in the case, which triggered Karti's arrest, was based on a statement of Indrani Mukerjea, former director of INX Media (P) Ltd, who recorded it under Section 164 of the CrPC before a magistrate on February 17.