paper-with-me

홈 › Papers

Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification

2023-03-25 · CVPR 2023 1 · Yukang Zhang, Hanzi Wang

For the visible-infrared person re-identification (VIReID) task, one of the major challenges is the modality gaps between visible (VIS) and infrared (IR) images. However, the training samples are usually limited, while the modality gaps are too large, which leads that the existing methods cannot effectively mine diverse cross-modality clues. To handle this limitation, we propose a novel augmentation network in the embedding space, called diverse embedding expansion network (DEEN). The proposed DEEN can effectively generate diverse embeddings to learn the informative feature representations and reduce the modality discrepancy between the VIS and IR images. Moreover, the VIReID model may be seriously affected by drastic illumination changes, while all the existing VIReID datasets are captured under sufficient illumination without significant light changes. Thus, we provide a low-light cross-modality (LLCM) dataset, which contains 46,767 bounding boxes of 1,064 identities captured by 9 RGB/IR cameras. Extensive experiments on the SYSU-MM01, RegDB and LLCM datasets show the superiority of the proposed DEEN over several other state-of-the-art methods. The code and dataset are released at: https://github.com/ZYK100/LLCM

📄 PDF Abstract BibTeX arXiv:2303.14481

Code (1)

zyk100/llcm 공식 구현 pytorch

Tasks

Cross-Modal Person Re-IdentificationPerson Re-Identification

Similar Papers 제목 키워드 기반

TextME: Bridging Unseen Modalities Through Text Descriptions

2026-02-03 · Soyeon Hong, Jinchan Kim, Jaegook You, Seungtaek Choi 외 arxiv

Expanding multimodal representations to novel modalities is constrained by reliance on large-scale paired datasets (e.g., text-image, text-audio, text-3D, text-molecule), which are costly and often infeasible in domains …

Cross-Modal Retrieval

UniMoCo: Unified Modality Completion for Robust Multi-Modal Embeddings

2025-05-17 · Jiajun Qin, Yuan Pu, Zhuolun He, Seunggeun Kim 외

Current research has explored vision-language models for multi-modal embedding tasks, such as information retrieval, visual grounding, and classification. However, real-world scenarios often involve diverse modality comb…

Image to textInformation RetrievalModality completionVisual Grounding

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning

2026-05-10 · Xing Han, Shravan Chaudhari, Tanvi Ranade, Rama Chellappa 외 arxiv

Real-world model deployment across multiple domains requires multimodal models to operate under two complementary regimes: (1) multi-task pretraining, tasks are co-available at design time where related tasks could borro…

Multi-Task LearningContinual Learning

SegRGB-X: General RGB-X Semantic Segmentation Model

2026-03-30 · Jiong Liu, Yingjie Xu, Xingcheng Zhou, Rui Song 외 arxiv

Semantic segmentation across arbitrary sensor modalities faces significant challenges due to diverse sensor characteristics, and the traditional configurations for this task result in redundant development efforts. We ad…

Semantic SegmentationScene Understanding

TINS: Test-time ID-prototype-separated Negative Semantics Learning for OOD Detection

2026-05-11 · Yifeng Yang, Jubo Feng, Jing Xu, Xinbing Wang 외 arxiv

Vision-language models enable OOD detection by comparing image alignment with ID labels and negative semantics. Existing negative-label-based methods mainly rely on static negative labels constructed before inference, li…