paper-with-me

Papers

NOSE: Neural Olfactory-Semantic Embedding with Tri-Modal Orthogonal Contrastive Learning

2026-04-12 · Yanyi Su, Hongshuai Wang, Zhifeng Gao, Jun Cheng arxiv

Olfaction lies at the intersection of chemical structure, neural encoding, and linguistic perception, yet existing representation methods fail to fully capture this pathway. Current approaches typically model only isolated segments of the olfactory pathway, overlooking the complete chain from molecule to receptors to linguistic descriptions. Such fragmentation yields learned embeddings that lack both biological grounding and semantic interpretability. We propose NOSE (Neural Olfactory-Semantic Embedding), a representation learning framework that aligns three modalities along the olfactory pathway: molecular structure, receptor sequence, and natural language description. Rather than simply fusing these signals, we decouple their contributions via orthogonal constraints, preserving the unique encoded information of each modality. To address the sparsity of olfactory language, we introduce a weak positive sample strategy to calibrate semantic similarity, preventing erroneous repulsion of similar odors in the feature space. Extensive experiments demonstrate that NOSE achieves state-of-the-art (SOTA) performance and excellent zero-shot generalization, confirming the strong alignment between its representation space and human olfactory intuition.Code and data are available at https://github.com/Xianyusyy/NOSE

📄 PDF Abstract BibTeX arXiv:2604.10452

Code (0)

등록된 구현이 없습니다.

Tasks

Zero-shot GeneralizationRepresentation LearningContrastive LearningSemantic Similarity

Similar Papers 제목 키워드 기반

What Images Cannot Say: Language-Guided Olfactory Representation Learning

2026-07-07 · Eleftherios Tsonis, Xi Wang, Vicky Kalogeiton arxiv

Images tell us what a scene looks like, but rarely what it would feel like to be there. While recent datasets pair visual scenes with electronic-nose measurements, aligning smell signals with images remains challenging b…

Representation LearningText Retrieval

Human-Machine Cooperative Multimodal Learning Method for Cross-subject Olfactory Preference Recognition

2023-11-24 · Xiuxin Xia, Yuchen Guo, Yanwei Wang, Yuchao Yang 외

Odor sensory evaluation has a broad application in food, clothing, cosmetics, and other fields. Traditional artificial sensory evaluation has poor repeatability, and the machine olfaction represented by the electronic no…

EEGElectroencephalogram (EEG)

DeepNose: An Equivariant Convolutional Neural Network Predictive Of Human Olfactory Percepts

2024-12-11 · Sergey Shuvaev, Khue Tran, Khristina Samoilova, Cyrille Mascart 외

The olfactory system employs responses of an ensemble of odorant receptors (ORs) to sense molecules and to generate olfactory percepts. Here we hypothesized that ORs can be viewed as 3D spatial filters that extract molec…

See & Sniff: Learning Visuo-Olfactory Representations

2026-06-25 · Seongyu Kim, Seungwoo Lee, Hyeonggon Ryu, Joon Son Chung 외 arxiv

While modern multimodal models integrate vision with language, audio, or touch, olfaction remains largely unexplored due to the lack of paired visuo-olfactory data. We introduce SmellNet-V, a scalable visuo-olfactory dat…

Cross-Modal Retrieval

SCENT: Aligning Mass Spectra with Molecular Structure for Olfactory Perception

2026-05-26 · Ziqi Zhang, Eunyeong Jin, Miguel Vasco, Farzaneh Taleb 외 arxiv

Predicting human olfactory perception from molecular structure has seen remarkable progress, yet these approaches require explicit chemical structure at inference, which is not available in practical sensing settings. We…

Odor Descriptor PredictionContrastive Learning