paper-with-me

Papers

Asynchronous Events-based Panoptic Segmentation using Graph Mixer Neural Network

2023-05-05 · Sanket Kachole, Yusra Alkendi, Fariborz Baghaei Naeini, Dimitrios Makris, Yahya Zweiri

In the context of robotic grasping, object segmentation encounters several difficulties when faced with dynamic conditions such as real-time operation, occlusion, low lighting, motion blur, and object size variability. In response to these challenges, we propose the Graph Mixer Neural Network that includes a novel collaborative contextual mixing layer, applied to 3D event graphs formed on asynchronous events. The proposed layer is designed to spread spatiotemporal correlation within an event graph at four nearest neighbor levels parallelly. We evaluate the effectiveness of our proposed method on the Event-based Segmentation (ESD) Dataset, which includes five unique image degradation challenges, including occlusion, blur, brightness, trajectory, scale variance, and segmentation of known and unknown objects. The results show that our proposed approach outperforms state-of-the-art methods in terms of mean intersection over the union and pixel accuracy. Code available at: https://github.com/sanket0707/GNN-Mixer.git

📄 PDF Abstract BibTeX arXiv:2305.03640

Code (1)

sanket0707/gnn-mixer 공식 구현 pytorch

Tasks

Panoptic SegmentationRobotic GraspingSegmentationSemantic Segmentation

Similar Papers 제목 키워드 기반

LiDAR-Camera Panoptic Segmentation via Geometry-Consistent and Semantic-Aware Alignment

2023-08-03 · ICCV 2023 1 · Zhiwei Zhang, Zhizhong Zhang, Qian Yu, Ran Yi 외

3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation. In this task, we notice that images could provide rich texture, color, and discriminative info…

3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationSegmentation+1

PanopticRecon: Leverage Open-vocabulary Instance Segmentation for Zero-shot Panoptic Reconstruction

2024-07-01 · Xuan Yu, Yili Liu, Chenrui Han, Sitong Mao 외

Panoptic reconstruction is a challenging task in 3D scene understanding. However, most existing methods heavily rely on pre-trained semantic segmentation models and known 3D object bounding boxes for 3D panoptic segmenta…

3D Panoptic SegmentationInstance SegmentationPanoptic SegmentationScene Understanding+3

Bidirectional Graph Reasoning Network for Panoptic Segmentation

2020-04-14 · CVPR 2020 6 · Yangxin Wu, Gengwei Zhang, Yiming Gao, Xiajun Deng 외

Recent researches on panoptic segmentation resort to a single end-to-end network to combine the tasks of instance segmentation and semantic segmentation. However, prior models only unified the two related tasks at the ar…

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation

Towards Panoptic 3D Parsing for Single Image in the Wild

2021-11-04 · Sainan Liu, Vincent Nguyen, Yuan Gao, Subarna Tripathi 외

Performing single image holistic understanding and 3D reconstruction is a central task in computer vision. This paper presents an integrated system that performs dense scene labeling, object detection, instance segmentat…

3D Reconstruction3D Shape ReconstructionAutonomous DrivingDepth Estimation+7

SOGNet: Scene Overlap Graph Network for Panoptic Segmentation

2019-11-18 · Yibo Yang, Hongyang Li, Xia Li, Qijie Zhao 외

The panoptic segmentation task requires a unified result from semantic and instance segmentation outputs that may contain overlaps. However, current studies widely ignore modeling overlaps. In this study, we aim to model…

Instance SegmentationPanoptic SegmentationSegmentationSemantic Segmentation