SLAD : Shared LoRA Adapters for Task Specific Distillation 事件

SLAD : Shared LoRA Adapters for Task Specific Distillation arXiv:2605.29726v1 Announce Type: new Abstract: In the context of resource-constrained environments such as embedded systems, adapting reduced-size foundation models to downstream tasks has become increasingly popular. This has recently motivated the emerging setting of task-specific distillation, where a larger and a smaller version of the same foundation model are both adapted to the same downstream task, with the goal of transferring