Key-segments for video object segmentation 论文

2011引用 468
Video Surveillance and Tracking MethodsVisual Attention and Saliency DetectionAdvanced Vision and Imaging

详细信息

发表日期
2011-11-01
发表年份
2011

关键词

Video Surveillance and Tracking MethodsVisual Attention and Saliency DetectionAdvanced Vision and Imaging

摘要

We present an approach to discover and segment foreground object(s) in video. Given an unannotated video sequence, the method first identifies object-like regions in any frame according to both static and dynamic cues. We then compute a series of binary partitions among those candidate “key-segments” to discover hypothesis groups with persistent appearance and motion. Finally, using each ranked hypothesis in turn, we estimate a pixel-level object labeling across all frames, where (a) the foreground likelihood depends on both the hypothesis's appearance as well as a novel localization prior based on partial shape matching, and (b) the background likelihood depends on cues pulled from the key-segments' (possibly diverse) surroundings observed across the sequence. Compared to existing methods, our approach automatically focuses on the persistent foreground regions of interest while resisting oversegmentation. We apply our method to challenging benchmark videos, and show competitive or better results than the state-of-the-art.