Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video 文章

ArXiv CS.CV2026-07-02PAPERen作者: Daniel Adebi, Sagnik Majumder, Kristen Grauman

详细信息

来源站点
ArXiv CS.CV
作者
Daniel Adebi, Sagnik Majumder, Kristen Grauman
文章类型
PAPER
语言
en
发布日期
2026-07-02

摘要

arXiv:2512.12165v4 Announce Type: replace Abstract: Understanding camera motion is a fundamental problem in embodied perception and 3D scene understanding. While visual methods have advanced rapidly, they often struggle under visually degraded conditions such as motion blur or occlusions. In this work, we show that passive scene sounds provide cues complementary to vision for relative camera pose estimation for in-the-wild videos. We introduce a simple but effective audio-visual framework that integrates direction-of-arrival (DOA) spectra and binauralized embeddings into a state-of-the-art vision-only pose estimation model. Our results on two large datasets show consistent gains over strong visual baselines, plus robustness when the visual information is corrupted.

相关事件

暂无数据

相关公司查看全部 (2)

A
ANDINONPROFIT

相关人物

暂无数据