paper-with-me

홈 › Papers

Learning Images Across Scales Using Adversarial Training

2024-06-13 · Krzysztof Wolski, Adarsh Djeacoumar, Alireza Javanmardi, Hans-Peter Seidel, Christian Theobalt, Guillaume Cordonnier, Karol Myszkowski, George Drettakis, Xingang Pan, Thomas Leimkühler

The real world exhibits rich structure and detail across many scales of observation. It is difficult, however, to capture and represent a broad spectrum of scales using ordinary images. We devise a novel paradigm for learning a representation that captures an orders-of-magnitude variety of scales from an unstructured collection of ordinary images. We treat this collection as a distribution of scale-space slices to be learned using adversarial training, and additionally enforce coherency across slices. Our approach relies on a multiscale generator with carefully injected procedural frequency content, which allows to interactively explore the emerging continuous scale space. Training across vastly different scales poses challenges regarding stability, which we tackle using a supervision scheme that involves careful sampling of scales. We show that our generator can be used as a multiscale generative model, and for reconstructions of scale spaces from unstructured patches. Significantly outperforming the state of the art, we demonstrate zoom-in factors of up to 256x at high quality and scale consistency.

📄 PDF Abstract BibTeX arXiv:2406.08924

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Arbitrary-Scale Image Synthesis

2022-04-05 · CVPR 2022 1 · Evangelos Ntavelis, Mohamad Shahbazi, Iason Kastanis, Radu Timofte 외

Positional encodings have enabled recent works to train a single adversarial network that can generate images of different scales. However, these approaches are either limited to a set of discrete scales or struggle to m…

Image Generation

Adversarial Sparse-View CBCT Artifact Reduction

2018-12-09 · Haofu Liao, Zhimin Huo, William J. Sehnert, Shaohua Kevin Zhou 외

We present an effective post-processing method to reduce the artifacts from sparsely reconstructed cone-beam CT (CBCT) images. The proposed method is based on the state-of-the-art, image-to-image generative models with a…

Cbct Artifact Reduction

CDUPatch: Color-Driven Universal Adversarial Patch Attack for Dual-Modal Visible-Infrared Detectors

2025-04-15 · Jiahuan Long, Wen Yao, Tingsong Jiang, Chao Ma

Adversarial patches are widely used to evaluate the robustness of object detection systems in real-world scenarios. These patches were initially designed to deceive single-modal detectors (e.g., visible or infrared) and …

Data Augmentationobject-detectionObject Detection

Dual Pyramid Generative Adversarial Networks for Semantic Image Synthesis

2022-10-08 · Shijie Li, Ming-Ming Cheng, Juergen Gall

The goal of semantic image synthesis is to generate photo-realistic images from semantic label maps. It is highly relevant for tasks like content generation and image editing. Current state-of-the-art approaches, however…

Generative Adversarial NetworkImage GenerationImage-to-Image Translation

Pose Manipulation with Identity Preservation

2020-04-20 · International Journal of Computers Communications & Control 2020 4 · Andrei-Timotei Ardelean, Lucian Mircea Sasu

This paper describes a new model which generates images in novel poses e.g. by altering face expression and orientation, from just a few instances of a human subject. Unlike previous approaches which require large datase…