Predicting Novel Views Using Generative Adversarial Query Network
The problem of predicting a novel view of the scene using an arbitrary number of observations is a challenging problem for computers as well as for humans. This paper introduces the Generative Adversarial Query Network (GAQN), a general learning framework for novel view synthesis that combines Generative Query Network (GQN) and Generative Adversarial Networks (GANs). The conventional GQN encodes input views into a latent representation that is used to generate a new view through a recurrent variational decoder. The proposed GAQN builds on this work by adding two novel aspects: First, we extend the current GQN architecture with an adversarial loss function for improving the visual quality and convergence speed. Second, we introduce a feature-matching loss function for stabilizing the training procedure. The experiments demonstrate that GAQN is able to produce high-quality results and faster convergence compared to the conventional approach.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderNovel View SynthesisSimilar Papers 제목 키워드 기반
IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models
This paper provides a unified account of two schools of thinking in information retrieval modelling: the generative retrieval focusing on predicting relevant documents given a query, and the discriminative retrieval focu…
Ad-Hoc Information RetrievalDocument RankingInformation RetrievalQuestion Answering+1Unsupervised Adversarial Depth Estimation using Cycled Generative Networks
While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. To cope with this issue, in this …
Depth EstimationMonocular Depth EstimationRecover and Identify: A Generative Dual Model for Cross-Resolution Person Re-Identification
Person re-identification (re-ID) aims at matching images of the same identity across camera views. Due to varying distances between cameras and persons of interest, resolution mismatch can be expected, which would degrad…
Generative Adversarial NetworkPerson Re-IdentificationPredicting Query-Item Relationship using Adversarial Training and Robust Modeling Techniques
We present an effective way to predict search query-item relationship. We combine pre-trained transformer and LSTM models, and increase model robustness using adversarial training, exponential moving average, multi-sampl…
Deep LearningDiversityGenerative Adversarial Reviews: When LLMs Become the Critic
The peer review process is fundamental to scientific progress, determining which papers meet the quality standards for publication. Yet, the rapid growth of scholarly production and increasing specialization in knowledge…
FairnessLarge Language Model