After the Euclidean Highway: Hyperbolic Expert AI as the Next Innovation 文章

ArXiv CS.CL2026-07-21PAPERen作者: Kwan Soo Shin, In Seok Kang, Munho Lee

详细信息

来源站点
ArXiv CS.CL
作者
Kwan Soo Shin, In Seok Kang, Munho Lee
文章类型
PAPER
语言
en
发布日期
2026-07-21

摘要

arXiv:2607.17513v1 Announce Type: cross Abstract: Expert domains are trees; the Euclidean transformer is not, diluting parent-child structure exponentially at depth. The hyperbolic turn left one question unasked: not how much of a network to curve, but where curvature may touch the gradient. Placement is a law, not a knob: the same geometry on a trainable adapter collapses training (seventeen training collapses, ~220 GPU-hours), yet at the loss layer alone it trains without one -- this is HySAT (Hyperbolic Structure-Aware Training), hyperbolic losses at the loss layer only. Across six expert SLMs we constructed and deployed (Llama 3.1 and EXAONE 3.5; four adapter strategies; 18.0M-sample corpus; zero NaN over ~317K optimizer steps), a matched four-arm ablation isolates the preserved manifold invariant, and three propositions and a lemma prove why loss-only placement is stable where adapter-on-manifold is not.

相关事件

暂无数据

相关公司

暂无数据

相关人物

暂无数据