paper-with-me

Papers

VideoPoet: A Large Language Model for Zero-Shot Video Generation

2023-12-21 · Dan Kondratyuk, Lijun Yu, Xiuye Gu, José Lezama, Jonathan Huang, Grant Schindler, Rachel Hornung, Vighnesh Birodkar, Jimmy Yan, Ming-Chang Chiu, Krishna Somandepalli, Hassan Akbari, Yair Alon, Yong Cheng, Josh Dillon, Agrim Gupta, Meera Hahn, Anja Hauth, David Hendon, Alonso Martinez, David Minnen, Mikhail Sirotenko, Kihyuk Sohn, Xuan Yang, Hartwig Adam, Ming-Hsuan Yang, Irfan Essa, Huisheng Wang, David A. Ross, Bryan Seybold, Lu Jiang

We present VideoPoet, a language model capable of synthesizing high-quality video, with matching audio, from a large variety of conditioning signals. VideoPoet employs a decoder-only transformer architecture that processes multimodal inputs -- including images, videos, text, and audio. The training protocol follows that of Large Language Models (LLMs), consisting of two stages: pretraining and task-specific adaptation. During pretraining, VideoPoet incorporates a mixture of multimodal generative objectives within an autoregressive Transformer framework. The pretrained LLM serves as a foundation that can be adapted for a range of video generation tasks. We present empirical results demonstrating the model's state-of-the-art capabilities in zero-shot video generation, specifically highlighting VideoPoet's ability to generate high-fidelity motions. Project page: http://sites.research.google/videopoet/

📄 PDF Abstract BibTeX arXiv:2312.14125

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderLanguage ModelingLanguage ModellingLarge Language ModelText-to-Video GenerationVideo Generation

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Position-Wise Feed-Forward Layer 설명 없음
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Adam 설명 없음
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Garbage in, garbage out: Zero-shot detection of crime using Large Language Models

2023-07-04 · Anj Simmons, Rajesh Vasa

This paper proposes exploiting the common sense knowledge learned by large language models to perform zero-shot reasoning about crimes given textual descriptions of surveillance videos. We show that when video is (manual…

Common Sense ReasoningLanguage ModelingLanguage ModellingLarge Language Model

MAtch, eXpand and Improve: Unsupervised Finetuning for Zero-Shot Action Recognition with Language Knowledge

2023-03-15 · ICCV 2023 1 · Wei Lin, Leonid Karlinsky, Nina Shvetsova, Horst Possegger 외

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing,…

Action RecognitionFew-Shot action recognitionFew Shot Action RecognitionImage Generation+4

VideoINSTA: Zero-shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs

2024-09-30 · Ruotong Liao, Max Erler, Huiyu Wang, Guangyao Zhai 외

In the video-language domain, recent works in leveraging zero-shot Large Language Model-based reasoning for video understanding have become competitive challengers to previous end-to-end models. However, long video under…

EgoSchemaLanguage ModellingLarge Language ModelQuestion Answering+3

Zero-shot Video Moment Retrieval via Off-the-shelf Multimodal Large Language Models

2025-01-14 · Yifang Xu, Yunzhuo Sun, Benxiang Zhai, Ming Li 외

The target of video moment retrieval (VMR) is predicting temporal spans within a video that semantically match a given linguistic query. Existing VMR methods based on multimodal large language models (MLLMs) overly rely …

Moment RetrievalRetrieval

On the Audio Hallucinations in Large Audio-Video Language Models

2024-01-18 · Taichi Nishimura, Shota Nakada, Masayoshi Kondo

Large audio-video language models can generate descriptions for both video and audio. However, they sometimes ignore audio content, producing audio descriptions solely reliant on visual information. This paper refers to …

HallucinationSentence