PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder 文章

ArXiv CS.CV2026-06-02NEWSen作者: Yancheng Liu, Kenichi Maeda, Manan Pancholy

摘要

arXiv:2606.01537v1 Announce Type: new Abstract: Clinical diagnosis often requires combining imaging with physiological measurements, yet deployed models typically operate on unimodal data. We present PaCX-MAE, a cross-modal distillation framework that injects physiological priors into chest X-ray (CXR) encoders while remaining strictly unimodal at inference. PaCX-MAE augments in-domain masked autoencoding with a dual contrastive-predictive objective, aligning CXR representations with paired ECG and laboratory embeddings. Extensive evaluation across nine benchmarks demonstrates consistent improvements over domain-specific MAE, particularly on physiology-dependent tasks (e.g., +2.7 AUROC on MedMod; +6.5 F1 on VinDr). The method proves highly label-efficient in the 1% regime and preserves anatomical fidelity, achieving parity with MAE on segmentation tasks.

相关事件查看全部 (1)

相关公司

暂无数据

相关人物

暂无数据