Multi-Task Learning for Screen Content Image Coding
With the rise of remote work and collaboration, compression of screen content images (SCI) is becoming increasingly important. While there are efficient codecs for natural images, as well as codecs for purely-synthetic images, those SCIs that contain both synthetic and natural content pose a particular challenge. In this paper, we propose a learning-based image coding model developed for such SCIs. By training an encoder to provide a latent representation suitable for two tasks -- input reconstruction and synthetic/natural region segmentation -- we create an effective SCI image codec whose strong performance is verified through experiments. Once trained, the second task (segmentation) need not be used; the codec still benefits from the segmentation-friendly latent representation.
Code (1)
Tasks
Multi-Task LearningSegmentationSimilar Papers 제목 키워드 기반
Multiview Video Compression Using Advanced HEVC Screen Content Coding
The paper presents a new approach to multiview video coding using Screen Content Coding. It is assumed that for a time instant the frames corresponding to all views are packed into a single frame, i.e. the frame-compatib…
Video CompressionDec-Adapter: Exploring Efficient Decoder-Side Adapter for Bridging Screen Content and Natural Image Compression
Natural image compression has been greatly improved in the deep learning era. However, the compression performance will be heavily degraded if the pretrained encoder is directly applied on screen content image compre…
DecoderImage CompressionTransfer LearningScreen Content Image Segmentation Using Least Absolute Deviation Fitting
We propose an algorithm for separating the foreground (mainly text and line graphics) from the smoothly varying background in screen content images. The proposed method is designed based on the assumption that the backgr…
ClusteringForeground SegmentationImage SegmentationSegmentation+1Improved Screen Content Coding in VVC Using Soft Context Formation
Screen content images typically contain a mix of natural and synthetic image parts. Synthetic sections usually are comprised of uniformly colored areas and repeating colors and patterns. In the VVC standard, these proper…
Screen Content Image Segmentation Using Robust Regression and Sparse Decomposition
This paper considers how to separate text and/or graphics from smooth background in screen content and mixed document images and proposes two approaches to perform this segmentation task. The proposed methods make use of…
Image SegmentationMedical Image SegmentationregressionSemantic Segmentation