Towards Real-Time Automatic Portrait Matting on Mobile Devices
We tackle the problem of automatic portrait matting on mobile devices. The proposed model is aimed at attaining real-time inference on mobile devices with minimal degradation of model performance. Our model MMNet, based on multi-branch dilated convolution with linear bottleneck blocks, outperforms the state-of-the-art model and is orders of magnitude faster. The model can be accelerated four times to attain 30 FPS on Xiaomi Mi 5 device with moderate increase in the gradient error. Under the same conditions, our model has an order of magnitude less number of parameters and is faster than Mobile DeepLabv3 while maintaining comparable performance. The accompanied implementation can be found at \url{https://github.com/hyperconnect/MMNet}.
Code (2)
Tasks
Image MattingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Fast Deep Matting for Portrait Animation on Mobile Phone
Image matting plays an important role in image and video editing. However, the formulation of image matting is inherently ill-posed. Traditional methods usually employ interaction to deal with the image matting problem w…
Image MattingPortrait AnimationVideo EditingSelf-supervised Matting-specific Portrait Enhancement and Generation
We resolve the ill-posed alpha matting problem from a completely different perspective. Given an input portrait image, instead of estimating the corresponding alpha matte, we focus on the other end, to subtly enhance thi…
Image MattingSpecificityEfficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors
Learning effective deep portrait matting models requires training data of both high quality and large quantity. Neither quality nor quantity can be easily met for portrait matting, however. Since the most accurate ground…
Image MattingVideo SegmentationVideo Semantic SegmentationMODNet: Real-Time Trimap-Free Portrait Matting via Objective Decomposition
Existing portrait matting methods either require auxiliary inputs that are costly to obtain or involve multiple stages that are computationally expensive, making them less suitable for real-time applications. In this wor…
GPUImage MattingVideo MattingAutomatic Portrait Video Matting via Context Motion Network
Automatic portrait video matting is an under-constrained problem. Most state-of-the-art methods only exploit the semantic information and process each frame individually. Their performance is compromised due to the lack …
Image MattingOptical Flow EstimationSemantic SegmentationVideo Matting