"I told the committee that it is fine they are inquiring into the team's performances and those of the captain and coach but what about the board officials who are also responsible for the steep decline in our cricket," Yousuf told PTI today from Lahore.
"Every time the team performs badly, the responsibility is put on the captain, coach and the players but I have never seen anyone in the board being held responsible," he added.
The committee includes Test captain Misbah-ul-Haq and senior batsman Younis Khan -- both of whom have not attended the first two days of the fact-finding committee's three-day meeting in Lahore.
Present in the meeting were Shakil Sheikh, the head of the PCB's cricket committee and a senior member of the board of governors, Subhan Ahmed, PCB's chief operating officer and Iqbal Qasim, former Test player, besides Yousuf.
"I also told them clearly that I had serious doubts over the sincerity of the board in forming the committee and taking decisions to improve things," he added.
The former cricketer said that apologies from Waqar Younis and Shahid Afridi wouldn't resolve the crisis in Pakistan cricket.
"This is not the first time Afridi has apologised. I appreciate Waqar for having the courage to face the people and come out with a public apology. I think Afridi also needed to face the media instead of apologising through the social media," Yousuf said.