Odysseys
“We tested several leading frontier models and find that the strongest models achieve a success rate of 44.5%, which leaves substantial room for future improvements.”
The authors, in the abstract
Benchmarking Web Agents on Realistic Long Horizon Tasks