OpenAI has launched IndQA, a new benchmark designed to evaluate how well AI models understand and reason about questions pertinent to various Indian languages across a wide range of cultural domains, to deepen its focus in the country that has its second highest user base after the US.
This would likely be the first time that Indian languages are being benchmarked by a global LLM platform.
IndQA evaluates knowledge and reasoning about Indian culture and everyday life in 12 Indian languages and 10 cultural domains by partnering with 261 domain experts across the country. As of now its reach spans

)