Audio Generation
3개 벤치마크 · 논문 396편 · 이 태스크의 논문 보기 →
Benchmarks
Most implemented
WaveNet: A Generative Model for Raw Audio
Adversarial Audio Synthesis
AudioLM: a Language Modeling Approach to Audio Generation
It's Raw! Audio Generation with State-Space Models
GANSynth: Adversarial Neural Audio Synthesis
BigVGAN: A Universal Neural Vocoder with Large-Scale Training
Papers
Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation
We present Kandinsky 6.0 Video, a family of foundation diffusion models for synchronized text-to-audio-video generation, comprising Kandinsky 6.0 Video Lite (3B parameters) and Kandinsky 6.0 Video Pro (29B parameters). B…
Audio GenerationVideo GenerationPrism: Dynamic Sparse Attention for Native 2K Joint Video-Audio Generation Model Training
Natively training joint video-audio generation models at higher resolutions empowers them to learn richer visual details and sharper motion dynamics. However, full attention incurs quadratic cost and, as resolution incre…
Audio GenerationJoint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy
Video and audio are perceived together, yet most generative models treat them in isolation. We examine methods that model the two modalities jointly, generate one from the other, or edit them in a coupled manner, organiz…
Audio GenerationAll modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation
Video is a rich representation of a physical event, capturing appearance, geometry, motion, and temporal evolution. Other modalities, such as 3D body motion or audio, encode narrower aspects of the same event. We find th…
Audio GenerationVideo GenerationStepAudio 3 Gen Technical Report
We introduce StepAudio 3 Gen, a general-purpose audio generation model that supports zero-shot text-to-speech (TTS), voice design, vocal generation, sound effects, music, vibe speech, and mixtures of multiple audio types…
Audio GenerationPRISM-Bench: An Audio-Centric Diagnostic Benchmark for Text-to-Audio-Video Generation
Text-to-audio-video (T2AV) generation has advanced rapidly, but its evaluation still underestimates the audio modality. Existing benchmarks either treat audio as an auxiliary component of video quality or assess it in is…
Audio GenerationVideo Generation