September 21, 2015

AI system solves SAT geometry questions as well as average human test taker

Aaron Escobar, flickr

(September 21, 2015)  The Allen Institute for Artificial Intelligence (AI2) and University of Washington researchers have created an artificial intelligence (AI) system that can solve SAT geometry questions as well as the average American 11th-grade student, a breakthrough in AI research.

This system, called GeoS, uses a combination of computer vision to interpret diagrams, natural language processing to read and understand text and a geometric solver to achieve 49 percent accuracy on official SAT test questions. If these results were extrapolated to the entire Math SAT test, the computer roughly achieved an SAT score of 500 (out of 800), the average test score for 2015.

AI2/University of Washington

A paper outlining the research, “Solving Geometry Problems: Combining Text and Diagram Interpretation,” was a joint effort between the UW Computer Science & Engineering department and AI2.

These results, presented at the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP) in Lisbon, Portugal, were achieved by GeoS solving unaltered SAT questions that it had never seen before and that required an understanding of:

read entire press  release >>