paper-with-me

홈 › Papers

Streaming-capable High-performance Architecture of Learned Image Compression Codecs

2022-08-02 · Fangzheng Lin, Heming Sun, Jiro Katto

Learned image compression allows achieving state-of-the-art accuracy and compression ratios, but their relatively slow runtime performance limits their usage. While previous attempts on optimizing learned image codecs focused more on the neural model and entropy coding, we present an alternative method to improving the runtime performance of various learned image compression models. We introduce multi-threaded pipelining and an optimized memory model to enable GPU and CPU workloads asynchronous execution, fully taking advantage of computational resources. Our architecture alone already produces excellent performance without any change to the neural model itself. We also demonstrate that combining our architecture with previous tweaks to the neural models can further improve runtime performance. We show that our implementations excel in throughput and latency compared to the baseline and demonstrate the performance of our implementations by creating a real-time video streaming encoder-decoder sample application, with the encoder running on an embedded device.

📄 PDF Abstract BibTeX arXiv:2208.01641

Code (1)

lin-toto/LICoris 공식 구현

Tasks

CPUDecoderGPUImage CompressionVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement

2025-06-19 · Tuan-Nam Nguyen, Ngoc-Quan Pham, Seymanur Aktı, Alexander Waibel

We propose a first streaming accent conversion (AC) model that transforms non-native speech into a native-like accent while preserving speaker identity, prosody and improving pronunciation. Our approach enables stream pr…

text-to-speechText to Speech

Hardware-Efficient Deconvolution-Based GAN for Edge Computing

2022-01-18 · Azzam Alhussain, Mingjie Lin

Generative Adversarial Networks (GAN) are cutting-edge algorithms for generating new data samples based on the learned data distribution. However, its performance comes at a significant cost in terms of computation and m…

Edge-computingHigh-Level Synthesis

Streaming Align-Refine for Non-autoregressive Deliberation

2022-04-15 · Weiran Wang, Ke Hu, Tara N. Sainath

We propose a streaming non-autoregressive (non-AR) decoding algorithm to deliberate the hypothesis alignment of a streaming RNN-T model. Our algorithm facilitates a simple greedy decoding procedure, and at the same time …

Decoder

Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions

2026-06-08 · Luxury, Jie Huang, Zihao Fan, Xiaoxiao Ma 외 arxiv

While recent autoregressive video diffusion models achieve remarkable streaming quality, they remain confined to low resolutions (e.g., 480P), leaving efficient, scalable, real-time high-resolution video generation a fun…

Video Generation

Decoder-only Streaming Transformer for Simultaneous Translation

2024-06-06 · Shoutao Guo, Shaolei Zhang, Yang Feng

Simultaneous Machine Translation (SiMT) generates translation while reading source tokens, essentially producing the target prefix based on the source prefix. To achieve good performance, it leverages the relationship be…

DecoderMachine TranslationTranslation