arXiv — cs.AI preprintsInternational12 October 2026
Same Query, Different Answer: Run-to-Run Variance in Semantic Query Processing
This is an official announcement record
Firsthand records what arXiv — cs.AI preprints announced and links to the original. The wording below is theirs, not ours.
arXiv:2610.13823v1 Announce Type: cross Abstract: Semantic query engines ask a large language model (LLM) to judge individual rows, and benchmarks compare these engines on the quality of a few executions at temperature 0. We measure how much another execution changes. We re-execute the text and tabular workloads of SemBench, LRO-Bench, and UDA-Bench through their own harnesses, log every one of 1.2 million model calls, and reanalyze SemBench's published executions. At temperature 0, between 0.07% and 10.2% of rows change their operator output over five executions, depending on the model, and u
Read the official announcement
Opens arxiv.org
More from arXiv — cs.AI preprints
- Faithfulness Without Anchors: A Position Paper on the Structural Misalignments of Explainable AI Faithfulness Metrics for Feature Importance12 October 2026
- EliteTable: Self-Improving Program Search for Executable Control Policies12 October 2026
- Equal-Budget Monte Carlo Tree Search versus Randomized-Restart List Scheduling for DAG Workflows: A Controlled Equal-Budget Computational Study12 October 2026
- Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning12 October 2026
- SpireBench: Evaluating Long-Horizon Strategic Play of Agentic Models with Slay the Spire12 October 2026
This content is for informational purposes only and is not professional advice. Specifications, prices, plan tiers, and features change frequently and may differ from what is shown here; verify current details on the manufacturer's or company's official page before purchasing. Ratings are based on analysis of published documentation, not independent lab testing.