arXiv — cs.AI preprintsInternational9 October 2026
AgentHorizon: Evaluating Agentic Judges for Long-Horizon Computer-Use Tasks
This is an official announcement record
Firsthand records what arXiv — cs.AI preprints announced and links to the original. The wording below is theirs, not ours.
arXiv:2610.11050v1 Announce Type: new Abstract: Computer-use agents are capable of completing complex tasks, increasing the use of automatic judges to determine success, either for training or for evaluation without human involvement. Despite their flexibility, their reliability on long tasks spanning multiple applications remains unclear. A trajectory, composed of long sequences of screenshots and actions, may appear complete, but in reality violates constraints from the instruction or introduces an unwanted side effect. To identify these errors, a judge needs to examine the trajectory with r
Read the official announcement
Opens arxiv.org
More from arXiv — cs.AI preprints
- An Explainable Header-Centric Framework for Large-Scale Semantic Table Interpretation and Data Quality Assessment9 October 2026
- Synthesis Through Simulation: Generating Coherent Enterprise Data via Scalable Agent-System Interaction9 October 2026
- Agent-Controlled Forgetting for Tool-Using Agents: Reversible Context Curation in Practice9 October 2026
- Verification and Self-Improvement in Agentic AI: Foundations and Limits9 October 2026
- The Harness as the Only Mutable Surface: Compliance-Bounded Self-Evolution of LLM Agents in Credit Pipelines, with a Measured Admission Gate9 October 2026
This content is for informational purposes only and is not professional advice. Specifications, prices, plan tiers, and features change frequently and may differ from what is shown here; verify current details on the manufacturer's or company's official page before purchasing. Ratings are based on analysis of published documentation, not independent lab testing.