paper-with-me

홈 › Papers

Test-Time Code-Switching for Cross-lingual Aspect Sentiment Triplet Extraction

2025-01-24 · Dongming Sheng, Kexin Han, Hao Li, Yan Zhang, YuCheng Huang, Jun Lang, Wenqiang Liu

Aspect Sentiment Triplet Extraction (ASTE) is a thriving research area with impressive outcomes being achieved on high-resource languages. However, the application of cross-lingual transfer to the ASTE task has been relatively unexplored, and current code-switching methods still suffer from term boundary detection issues and out-of-dictionary problems. In this study, we introduce a novel Test-Time Code-SWitching (TT-CSW) framework, which bridges the gap between the bilingual training phase and the monolingual test-time prediction. During training, a generative model is developed based on bilingual code-switched training data and can produce bilingual ASTE triplets for bilingual inputs. In the testing stage, we employ an alignment-based code-switching technique for test-time augmentation. Extensive experiments on cross-lingual ASTE datasets validate the effectiveness of our proposed method. We achieve an average improvement of 3.7% in terms of weighted-averaged F1 in four datasets with different languages. Additionally, we set a benchmark using ChatGPT and GPT-4, and demonstrate that even smaller generative models fine-tuned with our proposed TT-CSW framework surpass ChatGPT and GPT-4 by 14.2% and 5.0% respectively.

📄 PDF Abstract BibTeX arXiv:2501.14144

Code (0)

등록된 구현이 없습니다.

Tasks

Aspect Sentiment Triplet ExtractionBoundary DetectionCross-Lingual TransferTriplet

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Optimizing Bilingual Neural Transducer with Synthetic Code-switching Text Generation

2022-10-21 · Thien Nguyen, Nathalie Tran, Liuhui Deng, Thiago Fraga da Silva 외

Code-switching describes the practice of using more than one language in the same sentence. In this study, we investigate how to optimize a neural transducer based bilingual automatic speech recognition (ASR) model for c…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Sentencespeech-recognition+2

Are Knowledge and Reference in Multilingual Language Models Cross-Lingually Consistent?

2025-07-17 · Xi Ai, Mahardika Krisna Ihsani, Min-Yen Kan arxiv

Cross-lingual consistency should be considered to assess cross-lingual transferability, maintain the factuality of the model knowledge across languages, and preserve the parity of language model performance. We are thus …

Word Alignment

Phonological Features for 0-shot Multilingual Speech Synthesis

2020-08-06 · Marlene Staib, Tian Huey Teh, Alexandra Torresquintero, Devang S Ram Mohan 외

Code-switching---the intra-utterance use of multiple languages---is prevalent across the world. Within text-to-speech (TTS), multilingual models have been found to enable code-switching. By modifying the linguistic input…

Speech Synthesistext-to-speechText to Speech

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching

2024-06-19 · Zhuoran Li, Chunming Hu, Junfan Chen, Zhijun Chen 외

Code-switching is a data augmentation scheme mixing words from multiple languages into source lingual text. It has achieved considerable generalization performance of cross-lingual transfer tasks by aligning cross-lingua…

Cross-Lingual TransferData AugmentationModel OptimizationSentence+1

Arabic Code-Switching Speech Recognition using Monolingual Data

2021-07-04 · Ahmed Ali, Shammur Chowdhury, Amir Hussein, Yasser Hifny

Code-switching in automatic speech recognition (ASR) is an important challenge due to globalization. Recent research in multilingual ASR shows potential improvement over monolingual systems. We study key issues related t…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition