arXiv: cs.AI preprintsInternational5 November 2026
PAYWORTHY: Can LLMs Predict Which Freelance Jobs an AI Agent Will Complete?
This is an official announcement record
Firsthand records what arXiv: cs.AI preprints announced and links to the original. The wording below is theirs, not ours.
arXiv:2611.05759v1 Announce Type: new Abstract: Before an AI agent takes on a paid job, someone has to judge whether it is likely to succeed. We test whether frontier language models can make this call before any attempt. We propose PAYWORTHY which contains 1{,}494 real freelance job postings, sampled from 18.8M postings made between 2020 and 2026 on a freelancing platform. An agent attempts each job from the posting alone in a single run, and an LLM judge acting as the client decides whether to accept the work. We ask 18 models to forecast how likely the agent is to succeed and measure how we
Read the official announcement
Opens arxiv.org
More from arXiv: cs.AI preprints
- Formalizing inverse problems in the age of AI: possibilities, pitfalls, and an invitation6 November 2026
- KDASO: Knowledge-Data Dual-Driven Automated Skill Optimization for Liability Adjudication Tasks6 November 2026
- BlockLock: Reproducible LLM Inference with Fixed Batch Geometry6 November 2026
- Resource-Efficient Reinforcement Learning Post-Training through Elastic Expert Parallelism6 November 2026
- The Two-Ledger Model: Transaction-Grain Cost Accounting for Multi-Agent AI Systems Across Clouds, Models, and Systems of Record6 November 2026
This content is for informational purposes only and is not professional advice. Specifications, prices, plan tiers, and features change frequently and may differ from what is shown here; verify current details on the manufacturer's or company's official page before purchasing. Ratings are based on analysis of published documentation, not independent lab testing.