paper-with-me

홈 › Papers

TherA: Thermal-Aware Visual-Language Prompting for Controllable RGB-to-Thermal Infrared Translation

2026-02-23 · Dong-Guw Lee, Tai Hyoung Rhee, Hyunsoo Jang, Young-Sik Shin, Ukcheol Shin, Ayoung Kim arxiv

Despite the inherent advantages of thermal infrared(TIR) imaging, large-scale data collection and annotation remain a major bottleneck for TIR-based perception. A practical alternative is to synthesize pseudo TIR data via image translation; however, most RGB-to-TIR approaches heavily rely on RGB-centric priors that overlook thermal physics, yielding implausible heat distributions. In this paper, we introduce TherA, a controllable RGB-to-TIR translation framework that produces diverse and thermally plausible images at both scene and object level. TherA couples TherA-VLM with a latent-diffusion-based translator. Given a single RGB image and a user-prompted condition pair, TherA-VLM yields a thermal-aware embedding that encodes scene, object, material, and heat-emission context reflecting the input scene-condition pair. Conditioning the diffusion model on this embedding enables realistic TIR synthesis and fine-grained control across time of day, weather, and object state. Compared to other baselines, TherA achieves state-of-the-art translation performance, demonstrating improved zero-shot translation performance up to 33% increase averaged across all metrics.

📄 PDF Abstract BibTeX arXiv:2602.19430

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ThermEval: A Structured Benchmark for Evaluation of Vision-Language Models on Thermal Imagery

2026-02-16 · Ayush Shrivastava, Kirtan Gangani, Laksh Jain, Mayank Goel 외 arxiv

Vision language models (VLMs) achieve strong performance on RGB imagery, but they do not generalize to thermal images. Thermal sensing plays a critical role in settings where visible light fails, including nighttime surv…

Visual Question AnsweringAutonomous Driving

Lightweight Multimodal Adaptation of Vision Language Models for Species Recognition and Habitat Context Interpretation in Drone Thermal Imagery

2026-04-07 · Hao Chen, Fang Qiu, Fangchao Dong, Defei Yang 외 arxiv

This study proposes a lightweight multimodal adaptation framework to bridge the representation gap between RGB-pretrained VLMs and thermal infrared imagery, and demonstrates its practical utility using a real drone-colle…

Multimodal Cognitive Reframing Therapy via Multi-hop Psychotherapeutic Reasoning

2025-02-08 · Subin Kim, Hoonrae Kim, Heejin Do, Gary Geunbae Lee

Previous research has revealed the potential of large language models (LLMs) to support cognitive reframing therapy; however, their focus was primarily on text-based methods, often overlooking the importance of non-verba…

Effective reduction of biofilm through photothermal therapy by gold core@shell based mesoporous silica nanoparticles

2021-10-15 · Ana Garcia, Blanca Gonzalez, Catherine Harvey, Isabel Izquierdo-Barba 외

Bacterial biofilms can initiate chronic infections that become difficult to eradicate. There is an unmet need for effective therapeutic strategies that control and inhibit the growth of these biofilms. Herein, light sens…

Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts

2024-03-20 · Guangzeng Han, Weisi Liu, Xiaolei Huang, Brian Borsari

Automatic coding patient behaviors is essential to support decision making for psychotherapists during the motivational interviewing (MI), a collaborative communication intervention approach to address psychiatric issues…

Decision Making