paper-with-me

홈 › Papers

Chinese Synesthesia Detection: New Dataset and Models

2022-05-01 · Findings (ACL) 2022 5 · Xiaotong Jiang, Qingqing Zhao, Yunfei Long, Zhongqing Wang

In this paper, we introduce a new task called synesthesia detection, which aims to extract the sensory word of a sentence, and to predict the original and synesthetic sensory modalities of the corresponding sensory word. Synesthesia refers to the description of perceptions in one sensory modality through concepts from other modalities. It involves not only a linguistic phenomenon, but also a cognitive phenomenon structuring human thought and action, which makes it become a bridge between figurative linguistic phenomenon and abstract cognition, and thus be helpful to understand the deep semantics. To address this, we construct a large-scale human-annotated Chinese synesthesia dataset, which contains 7,217 annotated sentences accompanied by 187 sensory words. Based on this dataset, we propose a family of strong and representative baseline models. Upon these baselines, we further propose a radical-based neural network model to identify the boundary of the sensory word, and to jointly detect the original and synesthetic sensory modalities for the word. Through extensive experiments, we observe that the importance of the proposed task and dataset can be verified by the statistics and progressive performances. In addition, our proposed model achieves state-of-the-art results on the synesthesia dataset.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Similar Papers 제목 키워드 기반

A Machine-Synesthetic Approach To DDoS Network Attack Detection

2019-01-13 · Yuri Monakhov, Oleg Nikitin, Anna Kuznetsova, Alexey Kharlamov 외

In the authors' opinion, anomaly detection systems, or ADS, seem to be the most perspective direction in the subject of attack detection, because these systems can detect, among others, the unknown (zero-day) attacks. To…

Anomaly DetectionGeneral Classificationimage-classificationImage Classification

Synesthesia of Vehicles: Tactile Data Synthesis from Visual Inputs

2026-02-02 · Rui Wang, Yaoguang Cao, Yuyi Chen, Jianyi Xu 외 arxiv

Autonomous vehicles (AVs) rely on multi-modal fusion for safety, but current visual and optical sensors fail to detect road-induced excitations which are critical for vehicles' dynamic control. Inspired by human synesthe…

Autonomous Vehicles

Scatterer Recognition for Multi-Modal Intelligent Vehicular Channel Modeling via Synesthesia of Machines

2024-06-27 · Ziwei Huang, Lu Bai, Zengrui Han, Xiang Cheng

In this paper, a novel multi-modal intelligent vehicular channel model is proposed by scatterer recognition from light detection and ranging (LiDAR) point clouds via Synesthesia of Machines (SoM). The proposed model can …

SynthSoM: A synthetic intelligent multi-modal sensing-communication dataset for Synesthesia of Machines (SoM)

2025-01-13 · Xiang Cheng, Ziwei Huang, Yong Yu, Lu Bai 외

Given the importance of datasets for sensing-communication integration research, a novel simulation platform for constructing communication and multi-modal sensory dataset is developed. The developed platform integrates …

A corpus-based study on synesthesia in Korean ordinary language

2017-11-01 · PACLIC 2017 11 · Charmhun Jo