paper-with-me

홈 › Papers

Streamable Neural Fields

2022-07-20 · Junwoo Cho, Seungtae Nam, Daniel Rho, Jong Hwan Ko, Eunbyung Park

Neural fields have emerged as a new data representation paradigm and have shown remarkable success in various signal representations. Since they preserve signals in their network parameters, the data transfer by sending and receiving the entire model parameters prevents this emerging technology from being used in many practical scenarios. We propose streamable neural fields, a single model that consists of executable sub-networks of various widths. The proposed architectural and training techniques enable a single network to be streamable over time and reconstruct different qualities and parts of signals. For example, a smaller sub-network produces smooth and low-frequency signals, while a larger sub-network can represent fine details. Experimental results have shown the effectiveness of our method in various domains, such as 2D images, videos, and 3D signed distance functions. Finally, we demonstrate that our proposed method improves training stability, by exploiting parameter sharing.

📄 PDF Abstract BibTeX arXiv:2207.09663

Code (1)

jwcho5576/streamable_nf 공식 구현 pytorch

Similar Papers 제목 키워드 기반

NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields

2022-10-28 · Liangchen Song, Anpei Chen, Zhong Li, Zhang Chen 외

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To…

LiveGesture Streamable Co-Speech Gesture Generation Model

2026-04-13 · Muhammad Usama Saleem, Mayur Jagdishbhai Patel, Ekkasit Pinyoanuntapong, Zhongxing Qin 외 arxiv

We propose LiveGesture, the first fully streamable, speech-driven full-body gesture generation framework that operates with zero look-ahead and supports arbitrary sequence length. Unlike existing co-speech gesture method…

Gesture Generation

Chunked Attention-based Encoder-Decoder Model for Streaming Speech Recognition

2023-09-15 · Mohammad Zeineldeen, Albert Zeyer, Ralf Schlüter, Hermann Ney

We study a streamable attention-based encoder-decoder model in which either the decoder, or both the encoder and decoder, operate on pre-defined, fixed-size windows called chunks. A special end-of-chunk (EOC) symbol adva…

DecoderFormspeech-recognitionSpeech Recognition

BESTOW: Efficient and Streamable Speech Language Model with the Best of Two Worlds in GPT and T5

2024-06-28 · Zhehuai Chen, He Huang, Oleksii Hrinchuk, Krishna C. Puvvada 외

Incorporating speech understanding capabilities into pretrained large-language models has become a vital research direction (SpeechLLM). The previous architectures can be categorized as: i) GPT-style, prepend speech prom…

DecoderLanguage ModelingLanguage Modelling

A streamable large-scale clinical EEG dataset for Deep Learning

2022-03-04 · Dung Truong, Manisha Sinha, Kannan Umadevi Venkataraju, Michael Milham 외

Deep Learning has revolutionized various fields, including Computer Vision, Natural Language Processing, as well as Biomedical research. Within the field of neuroscience, specifically in electrophysiological neuroimaging…

Deep LearningEEGElectroencephalogram (EEG)Feature Engineering+1