paper-with-me

Papers

ZeST-NeRF: Using temporal aggregation for Zero-Shot Temporal NeRFs

2023-11-30 · Violeta Menéndez González, Andrew Gilbert, Graeme Phillipson, Stephen Jolly, Simon Hadfield

In the field of media production, video editing techniques play a pivotal role. Recent approaches have had great success at performing novel view image synthesis of static scenes. But adding temporal information adds an extra layer of complexity. Previous models have focused on implicitly representing static and dynamic scenes using NeRF. These models achieve impressive results but are costly at training and inference time. They overfit an MLP to describe the scene implicitly as a function of position. This paper proposes ZeST-NeRF, a new approach that can produce temporal NeRFs for new scenes without retraining. We can accurately reconstruct novel views using multi-view synthesis techniques and scene flow-field estimation, trained only with unrelated scenes. We demonstrate how existing state-of-the-art approaches from a range of fields cannot adequately solve this new task and demonstrate the efficacy of our solution. The resulting network improves quantitatively by 15% and produces significantly better visual results.

📄 PDF Abstract BibTeX arXiv:2311.18491

Code (0)

등록된 구현이 없습니다.

Tasks

Image GenerationNeRFVideo Editing

Similar Papers 제목 키워드 기반

ZeST: Zero-Shot Material Transfer from a Single Image

2024-04-09 · Ta-Ying Cheng, Prafull Sharma, Andrew Markham, Niki Trigoni 외

We propose ZeST, a method for zero-shot material transfer to an object in the input image given a material exemplar image. ZeST leverages existing diffusion adapters to extract implicit material representation from the e…

Appearance TransferObject

ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control

2026-01-30 · Jean Pierre Sleiman, He Li, Alphonsus Adu-Bredu, Robin Deits 외 arxiv

Achieving robust, human-like whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers. We intr…

Reinforcement Learning

ZEST: Attention-based Zero-Shot Learning for Unseen IoT Device Classification

2023-10-12 · Binghui Wu, Philipp Gysel, Dinil Mon Divakaran, Mohan Gurusamy

Recent research works have proposed machine learning models for classifying IoT devices connected to a network. However, there is still a practical challenge of not having all devices (and hence their traffic) available …

DecoderZero-Shot Learning

LEMONADE: A Large Multilingual Expert-Annotated Abstractive Event Dataset for the Real World

2025-06-01 · Sina J. Semnani, Pingyue Zhang, Wanyue Zhai, Haozhuo Li 외

This paper presents LEMONADE, a large-scale conflict event dataset comprising 39,786 events across 20 languages and 171 countries, with extensive coverage of region-specific entities. LEMONADE is based on a partially rea…

document understandingEntity LinkingEvent ExtractionZero-shot Event Extraction

ZeSTA: Zero-Shot TTS Augmentation with Domain-Conditioned Training for Data-Efficient Personalized Speech Synthesis

2026-03-04 · Youngwon Choi, Jinwoo Oh, Hwayeon Kim, Hyeonyu Kim arxiv

We investigate the use of zero-shot text-to-speech (ZS-TTS) as a data augmentation source for low-resource personalized speech synthesis. While synthetic augmentation can provide linguistically rich and phonetically dive…

Data AugmentationSpeech Synthesis