From what we do to how we do it, artificial intelligence (AI) is now rewriting realities for billions of people across the globe. However, UN Women has warned, citing multiple studies, that the AI revolution is leaving women at a higher risk of discrimination and violence.
In a media advisory, it cited an analysis by the US-based Stanford Social Innovation Review, which found that 44 per cent of 133 AI systems demonstrated gender bias.
Another study by the United Nations Educational, Scientific and Cultural Organization (Unesco), cited by the organisation, revealed that 20 per cent of responses generated by large language models (LLMs) exhibited sexist and misogynistic attitudes. The models were found to associate women with terms such as “home”, “family”, and “children”, and men with “business”, “executive”, and “career”.
“Honestly, it is not that LLMs are fed certain sexist remarks. They are a reflection of existing biases and prejudices in society. It will show a doctor as a male and a nurse as a female, and that is because of the generic perception of women as caregivers,” says Jibu Elias, India lead at Mozilla Foundation, a US-based non-profit organisation promoting an accessible and inclusive internet. “The bigger challenge here is how AI will actually know that society is evolving,” he adds.
The warning by UN Women comes as the global community prepares for the UN Global Dialogue on AI Governance, scheduled for July 6–7, and the AI for Good Global Summit in Geneva, Switzerland, from July 7–10.
According to Osama Manzar, founder and director of the Digital Empowerment Foundation, the digital ecosystem has historically deprived women, and AI is adding another layer to that disadvantage.
“The real question should not be whether women are using AI, but whether women are considered right at the levels of design, development, deployment, and adoption,” he says.
On the biases reflected by the technology, he observes that AI is built on large datasets and that if data is not collected, stored, and used ethically in the first place, LLMs will only amplify those biases.
As UN Women views safety as a key component at the design stage itself, it also said that, in a study of 138 countries, only 24 referenced gender in a national AI strategy. Moreover, just 18 included substantive gender-responsive provisions that can help AI detect stereotypes, broaden representation, and improve accessibility at scale.
The advisory also highlighted AI’s role in intensifying digital violence against women. Previous reports by the organisation found that nearly one in four surveyed women human rights defenders, activists, and journalists had experienced AI-assisted online violence, while 12 per cent reported experiencing the non-consensual sharing of personal images. “AI is compounding this. Deepfakes are among the most visible examples of AI-enabled abuse that disproportionately targets women and girls,” the UN Women advisory notes.
Six per cent of women have been targeted through deepfakes or manipulated images and videos, while more than one in four have received unsolicited sexual advances through digital messaging.
According to the experts, it is important to know who is building the technology before we talk about the users. “From product teams to research labs and then bodies that implement standards, the representation of women is low and any technology is a reflection of its creator,” says Elias. It is not about men particularly showing bias, he says, any homogeneous group tends to miss the issues which diverse groups identify much earlier.
A report by the International Labour Organization released in March found that women remain underrepresented in science, technology, engineering, and mathematics (STEM) and AI, accounting for only 30 per cent of the global AI workforce. “Meaningful participation is a hopeful start, but it is only a beginning. Women’s representation should go beyond numbers and account for those who are most excluded from the digital ecosystem,” says Manzar. The economic disruption caused by AI is also expected to affect women the most, UN Women warns.
While discussions around the AI wave have largely focused on reskilling, women face deeper practical challenges. Juhi Bhatnagar, a Gurugram-based AI investor, says she gets only enough time to focus on her current role because she is also raising two children. “The entire concept of reskilling is far more challenging for women, as they are already performing multiple roles,” she says, adding that she undertook additional training so she would not lose confidence while entering a field predominantly led by men.