He fell sick in the morning and was rushed to a hospital where he took his last breath, the family members said.
The body will be flown to Raebareli tomorrow for the burial, they said.
A recipient of Padma Bhushan in 2013 and Sangeet Natak Akademi award, he was a resident guru at the ITC Sangeet Research Academy in the city for the past 20 years
Despite movement restrictions and age-related illness, he used to appear for public performances till recently.
Condoling his death, Chief Minister Mamata Banerjee said, "Saddened at the passing away of veteran vocalist Padma Bhushan Abdul Rashid Khan.
India has lost a great gem in the world of music", she said in a tweet.
