Natural Image Manipulation for Autoregressive Models Using Fisher Scores
Deep autoregressive models are one of the most powerful models that exist today which achieve state-of-the-art bits per dim. However, they lie at a strict disadvantage when it comes to controlled sample generation compared to latent variable models. Latent variable models such as VAEs and normalizing flows allow meaningful semantic manipulations in latent space, which autoregressive models do not have. In this paper, we propose using Fisher scores as a method to extract embeddings from an autoregressive model to use for interpolation and show that our method provides more meaningful sample manipulation compared to alternate embeddings such as network activations.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ManipulationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generative Autoregressive Ensembles for Satellite Imagery Manipulation Detection
Satellite imagery is becoming increasingly accessible due to the growing number of orbiting commercial satellites. Many applications make use of such images: agricultural management, meteorological prediction, damage ass…
Image ManipulationManagementFisher Flow Matching for Generative Modeling over Discrete Data
Generative modeling over discrete data has recently seen numerous success stories, with applications spanning language modeling, biological sequence design, and graph-structured molecular data. The predominant generative…
Language ModelingLanguage ModellingVideo GenerationA Survey on Vision Autoregressive Model
Autoregressive models have demonstrated great performance in natural language processing (NLP) with impressive scalability, adaptability and generalizability. Inspired by their notable success in NLP field, autoregressiv…
3D GenerationBenchmarkingImage GenerationMedical Image Analysis+5InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generation
We introduce InfinityStar, a unified spacetime autoregressive framework for high-resolution image and dynamic video synthesis. Building on the recent success of autoregressive modeling in both vision and language, our pu…
Video GenerationTechnical note on Sequential Test-Time Adaptation via Martingale-Driven Fisher Prompting
We present a theoretical framework for M-FISHER, a method for sequential distribution shift detection and stable adaptation in streaming data. For detection, we construct an exponential martingale from non-conformity sco…
Test-time Adaptation