OrcaRouter: A Production-Oriented LLM Router with Hybrid Offline-Online Learning 事件

OrcaRouter: A Production-Oriented LLM Router with Hybrid Offline-Online Learning arXiv:2605.30736v1 Announce Type: cross Abstract: The rapid development of large language models, each with distinct capabilities and inference costs, raises a practical deployment question: given an incoming request, which model should handle it? We present OrcaRouter, a production-oriented LLM router that combines a LinUCB-based contextual bandit over lexical and sentence-embedding features with a hybrid offline-