arXiv — cs.AI preprintsInternational2 October 2026
LEGO-OPD: Factorized Teacher Composition for Multimodal On-Policy Distillation
This is an official announcement record
Firsthand records what arXiv — cs.AI preprints announced and links to the original. The wording below is theirs, not ours.
arXiv:2610.00333v1 Announce Type: cross Abstract: Multimodal on-policy distillation (OPD) aims to improve visual grounding while preserving the strong reasoning capabilities of language models. Recent multi-teacher approaches combine LLM and VLM teachers to provide complementary supervision. However, directly using a VLM's full predictive distribution entangles its visual grounding signal with its own language prior, preventing the grounding information from being transferred independently. Conversely, increasing the strength of visual supervision can improve perception but may overemphasize v
Read the official announcement
Opens arxiv.org
More from arXiv — cs.AI preprints
- Heavy-Tailed Memory Traces in Long-Horizon Language Agents2 October 2026
- When Do Causal World Models Help Modular LLM Agents2 October 2026
- From Proposal to Verified Effect: Praxa, an Evidence-Bound Harness for Governed AI Agent Execution2 October 2026
- What Do Rationales Communicate? A Message-Intervention Study in Role-Specialized QA2 October 2026
- Measuring the Microtask Eligibility Gap: When Is an Off-the-Shelf SLM Enough for an Agent Harness?2 October 2026
This content is for informational purposes only and is not professional advice. Specifications, prices, plan tiers, and features change frequently and may differ from what is shown here; verify current details on the manufacturer's or company's official page before purchasing. Ratings are based on analysis of published documentation, not independent lab testing.