Explore Business Standard
GPT-3, the popular AI-powered tool, was found to reason as well as college undergraduate students, scientists have found. The artificial intelligence large language model (LLM) was asked to solve reasoning problems that were typical of intelligence tests and standardised tests such as the SAT, used by colleges and universities in the US and other countries to make admissions decisions. The researchers from the University of California - Los Angeles (UCLA), US, asked GPT-3 to predict the next shape which followed a complicated arrangement of shapes. They also asked the AI to answer SAT analogy questions, all the while ensuring that the AI would have never encountered these questions before. They also asked 40 UCLA undergraduate students to solve the same problems. In the shape prediction test, GPT-3 was seen to solve 80 per cent of the problems correctly, between the humans' average score of just below 60 per cent and their highest scores. "Surprisingly, not only did GPT-3 do about