Asynchronous Events-based Panoptic Segmentation using Graph Mixer Neural Network
In the context of robotic grasping, object segmentation encounters several difficulties when faced with dynamic conditions such as real-time operation, occlusion, low lighting, motion blur, and object size variability. In response to these challenges, we propose the Graph Mixer Neural Network that includes a novel collaborative contextual mixing layer, applied to 3D event graphs formed on asynchronous events. The proposed layer is designed to spread spatiotemporal correlation within an event graph at four nearest neighbor levels parallelly. We evaluate the effectiveness of our proposed method on the Event-based Segmentation (ESD) Dataset, which includes five unique image degradation challenges, including occlusion, blur, brightness, trajectory, scale variance, and segmentation of known and unknown objects. The results show that our proposed approach outperforms state-of-the-art methods in terms of mean intersection over the union and pixel accuracy. Code available at: https://github.com/sanket0707/GNN-Mixer.git
Code (1)
Tasks
Panoptic SegmentationRobotic GraspingSegmentationSemantic SegmentationSimilar Papers 제목 키워드 기반
LiDAR-Camera Panoptic Segmentation via Geometry-Consistent and Semantic-Aware Alignment
3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative info…
3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationSegmentation+1PanopticRecon: Leverage Open-vocabulary Instance Segmentation for Zero-shot Panoptic Reconstruction
Panoptic reconstruction is a challenging task in 3D scene understanding. However, most existing methods heavily rely on pre-trained semantic segmentation models and known 3D object bounding boxes for 3D panoptic segmenta…
3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationScene Understanding+3Bidirectional Graph Reasoning Network for Panoptic Segmentation
Recent researches on panoptic segmentation resort to a single end-to-end network to combine the tasks of instance segmentation and semantic segmentation. However, prior models only unified the two related tasks at the ar…
Instance SegmentationPanoptic SegmentationSegmentationSemantic SegmentationTowards Panoptic 3D Parsing for Single Image in the Wild
Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentat…
3D Reconstruction3D Shape ReconstructionAutonomous DrivingDepth Estimation+7SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
The panoptic segmentation task requires a unified result from semantic and instance segmentation outputs that may contain overlaps. However, current studies widely ignore modeling overlaps. In this study, we aim to model…
Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation