paper-with-me

홈 › Papers

Lightweight high-resolution Subject Matting in the Real World

2023-12-12 · Peng Liu, Fanyi Wang, Jingwen Su, Yanhao Zhang, GuoJun Qi

Existing saliency object detection (SOD) methods struggle to satisfy fast inference and accurate results simultaneously in high resolution scenes. They are limited by the quality of public datasets and efficient network modules for high-resolution images. To alleviate these issues, we propose to construct a saliency object matting dataset HRSOM and a lightweight network PSUNet. Considering efficient inference of mobile depolyment framework, we design a symmetric pixel shuffle module and a lightweight module TRSU. Compared to 13 SOD methods, the proposed PSUNet has the best objective performance on the high-resolution benchmark dataset. Evaluation results of objective assessment are superior compared to U$^2$Net that has 10 times of parameter amount of our network. On Snapdragon 8 Gen 2 Mobile Platform, inference a single 640$\times$640 image only takes 113ms. And on the subjective assessment, evaluation results are better than the industry benchmark IOS16 (Lift subject from background).

📄 PDF Abstract BibTeX arXiv:2312.07100

Code (0)

등록된 구현이 없습니다.

Tasks

Image Mattingobject-detectionObject Detection

Similar Papers 제목 키워드 기반

Lightweight Portrait Matting via Regional Attention and Refinement

2023-11-07 · Yatao Zhong, Ilya Zharkov

We present a lightweight model for high resolution portrait matting. The model does not use any auxiliary inputs such as trimaps or background captures and achieves real time performance for HD videos and near real time …

4kImage Matting

High-Resolution Deep Image Matting

2020-09-14 · Haichao Yu, Ning Xu, Zilong Huang, Yuqian Zhou 외

Image matting is a key technique for image and video editing and composition. Conventionally, deep learning approaches take the whole input image and an associated trimap to infer the alpha matte using convolutional neur…

Image MattingVideo EditingVocal Bursts Intensity Prediction

Deep Video Matting via Spatio-Temporal Alignment and Aggregation

2021-04-22 · CVPR 2021 1 · Yanan sun, Guanzhi Wang, Qiao Gu, Chi-Keung Tang 외

Despite the significant progress made by deep learning in natural image matting, there has been so far no representative work on deep learning for video matting due to the inherent technical challenges in reasoning tempo…

DecoderDeep LearningImage MattingOptical Flow Estimation+1

MODNet-V: Improving Portrait Video Matting via Background Restoration

2021-09-24 · Jiayu Sun, Zhanghan Ke, Lihe Zhang, Huchuan Lu 외

To address the challenging portrait video matting problem more precisely, existing works typically apply some matting priors that require additional user efforts to obtain, such as annotated trimaps or background images.…

GPUImage MattingVideo Matting

Real-Time High-Resolution Background Matting

2020-12-14 · CVPR 2021 1 · Shanchuan Lin, Andrey Ryabtsev, Soumyadip Sengupta, Brian Curless 외

We introduce a real-time, high-resolution background replacement technique which operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. Our technique is based on background matting, where an additional fra…

4kGPUImage MattingVocal Bursts Intensity Prediction