paper-with-me

Papers

Bronchoscopic video synchronization for interactive multimodal inspection of bronchial lesions

2023-03-20 · Qi Chang, Patrick D. Byrnes, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

With lung cancer being the most fatal cancer worldwide, it is important to detect the disease early. A potentially effective way of detecting early cancer lesions developing along the airway walls (epithelium) is bronchoscopy. To this end, developments in bronchoscopy offer three promising noninvasive modalities for imaging bronchial lesions: white-light bronchoscopy (WLB), autofluorescence bronchoscopy (AFB), and narrow-band imaging (NBI). While these modalities give complementary views of the airway epithelium, the physician must manually inspect each video stream produced by a given modality to locate the suspect cancer lesions. Unfortunately, no effort has been made to rectify this situation by providing efficient quantitative and visual tools for analyzing these video streams. This makes the lesion search process extremely time-consuming and error-prone, thereby making it impractical to utilize these rich data sources effectively. We propose a framework for synchronizing multiple bronchoscopic videos to enable an interactive multimodal analysis of bronchial lesions. Our methods first register the video streams to a reference 3D chest computed-tomography (CT) scan to produce multimodal linkages to the airway tree. Our methods then temporally correlate the videos to one another to enable synchronous visualization of the resulting multimodal data set. Pictorial and quantitative results illustrate the potential of the methods.

📄 PDF Abstract BibTeX arXiv:2303.11258

Code (0)

등록된 구현이 없습니다.

Tasks

Computed Tomography (CT)Video Synchronization

Similar Papers 제목 키워드 기반

ESFPNet: efficient deep learning architecture for real-time lesion segmentation in autofluorescence bronchoscopic video

2022-07-15 · Qi Chang, Danish Ahmad, Jennifer Toth, Rebecca Bascom 외

Lung cancer tends to be detected at an advanced stage, resulting in a high patient mortality rate. Thus, much recent research has focused on early disease detection Bronchoscopy is the procedure of choice for an effectiv…

Lesion DetectionLesion SegmentationMedical Image SegmentationSegmentation

EXPOTION: Facial Expression and Motion Control for Multimodal Music Generation

2025-07-07 · Fathinah Izzati, Xinyue Li, Gus Xia arxiv

We propose Expotion (Facial Expression and Motion Control for Multimodal Music Generation), a generative model leveraging multimodal visual controls - specifically, human facial expressions and upper-body motion - as wel…

parameter-efficient fine-tuningText-to-Music Generation

Wan-Streamer v0.1: End-to-end Real-time Interactive Foundation Models

2026-06-23 · Lianghua Huang, Zhi-Fan Wu, Wei Wang, Yupeng Shi 외 arxiv

We present Wan-Streamer, a native-streaming, end-to-end interactive foundation model designed from the ground up for real-time, low-latency, full-duplex audio-visual interaction. Wan-Streamer seamlessly models language, …

HunyuanVideo-HOMA: Generic Human-Object Interaction in Multimodal Driven Human Animation

2025-06-10 · Ziyao Huang, Zixiang Zhou, Juan Cao, Yifeng Ma 외

To address key limitations in human-object interaction (HOI) video generation -- specifically the reliance on curated motion data, limited generalization to novel objects/scenarios, and restricted accessibility -- we int…

Human AnimationHuman-Object Interaction DetectionVideo Generation

OmniShow: Unifying Multimodal Conditions for Human-Object Interaction Video Generation

2026-04-13 · Donghao Zhou, Guisheng Liu, Hao Yang, Jiatong Li 외 arxiv

In this work, we study Human-Object Interaction Video Generation (HOIVG), which aims to synthesize high-quality human-object interaction videos conditioned on text, reference images, audio, and pose. This task holds sign…

Video Generation