Semantic Video Segmentation : Exploring Inference Efficiency
We explore the efficiency of the CRF inference beyond image level semantic segmentation and perform joint inference in video frames. The key idea is to combine best of two worlds: semantic co-labeling and more expressive models. Our formulation enables us to perform inference over ten thousand images within seconds and makes the system amenable to perform video semantic segmentation most effectively. On CamVid dataset, with TextonBoost unaries, our proposed method achieves up to 8% improvement in accuracy over individual semantic image segmentation without additional time overhead. The source code is available at https://github.com/subtri/video_inference
Code (1)
Tasks
Image SegmentationSegmentationSemantic SegmentationVideo SegmentationVideo Semantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Beyond Semantic Image Segmentation : Exploring Efficient Inference in Video
We explore the efficiency of the CRF inference module beyond image level semantic segmentation. The key idea is to combine the best of two worlds of semantic co-labeling and exploiting more expressive models. Similar to …
Image SegmentationSegmentationSemantic SegmentationVideo Semantic SegmentationExploring Temporal Information for Improved Video Understanding
In this dissertation, I present my work towards exploring temporal information for better video understanding. Specifically, I have worked on two problems: action recognition and semantic segmentation. For action recogni…
Action RecognitionOptical Flow EstimationSegmentationSemantic Segmentation+3Multiclass Semantic Video Segmentation With Object-Level Active Inference
We address the problem of integrating object reasoning with supervoxel labeling in multiclass semantic video segmentation. To this end, we first propose an object-augmented dense CRF in spatio-temporal domain, which capt…
ObjectSegmentationSemantic SegmentationVideo Segmentation+1Online Model Distillation for Efficient Video Inference
High-quality computer vision models typically address the problem of understanding the general distribution of real-world images. However, most cameras observe only a very small fraction of this distribution. This offers…
modelSegmentationSemantic SegmentationVideo Object Segmentation+1Mamba or RWKV: Exploring High-Quality and High-Efficiency Segment Anything Model
Transformer-based segmentation methods face the challenge of efficient inference when dealing with high-resolution images. Recently, several linear attention architectures, such as Mamba and RWKV, have attracted much att…
MambaSegmentation