paper-with-me

홈 › Papers

TEII: Think, Explain, Interact and Iterate with Large Language Models to Solve Cross-lingual Emotion Detection

2024-05-27 · Long Cheng, Qihao Shao, Christine Zhao, Sheng Bi, Gina-Anne Levow

Cross-lingual emotion detection allows us to analyze global trends, public opinion, and social phenomena at scale. We participated in the Explainability of Cross-lingual Emotion Detection (EXALT) shared task, achieving an F1-score of 0.6046 on the evaluation set for the emotion detection sub-task. Our system outperformed the baseline by more than 0.16 F1-score absolute, and ranked second amongst competing systems. We conducted experiments using fine-tuning, zero-shot learning, and few-shot learning for Large Language Model (LLM)-based models as well as embedding-based BiLSTM and KNN for non-LLM-based techniques. Additionally, we introduced two novel methods: the Multi-Iteration Agentic Workflow and the Multi-Binary-Classifier Agentic Workflow. We found that LLM-based approaches provided good performance on multilingual emotion detection. Furthermore, ensembles combining all our experimented models yielded higher F1-scores than any single approach alone.

📄 PDF Abstract BibTeX arXiv:2405.17129

Code (1)

cl-victor1/exalt_2024_bcsz 공식 구현

Tasks

Few-Shot LearningLanguage ModelingLanguage ModellingLarge Language ModelZero-Shot Learning

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…
BiLSTM A Bidirectional LSTM, or biLSTM, is a sequence processing model that consists of two LSTMs: one taking the input in a forward direction, and the other in a backwards…

Similar Papers 제목 키워드 기반

Exploring Prompt Engineering Practices in the Enterprise

2024-03-13 · Michael Desmond, Michelle Brachman

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language pr…

Prompt Engineering

Can Large Models Teach Student Models to Solve Mathematical Problems Like Human Beings? A Reasoning Distillation Method via Multi-LoRA Interaction

2025-08-18 · Xinhe Li, Jiajun Liu, Peng Wang arxiv

Recent studies have demonstrated that Large Language Models (LLMs) have strong mathematical reasoning abilities but rely on hundreds of billions of parameters. To tackle the challenge of poor reasoning in Small Language …

Mathematical Reasoning

Design Generative AI for Practitioners: Exploring Interaction Approaches Aligned with Creative Practice

2026-03-03 · Xiaohan Peng, Wendy E. Mackay, Janin Koch arxiv

Design is a non-linear, reflective process in which practitioners engage with visual, semantic, and other expressive materials to explore, iterate, and refine ideas. As Generative AI (GenAI) becomes integrated into profe…

Image Manipulation

Bias Amplification in Language Model Evolution: An Iterated Learning Perspective

2024-04-04 · Yi Ren, Shangmin Guo, Linlu Qiu, Bailin Wang 외

With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods all…

Language ModelingLanguage Modelling

Thinking Deeper With Recurrent Networks: Logical Extrapolation Without Overthinking

2021-09-29 · Arpit Bansal, Avi Schwarzschild, Eitan Borgnia, Zeyad Emam 외

Classical machine learning systems perform best when they are trained and tested on the same distribution, and they lack a mechanism to increase model power after training is complete. In contrast, recent work has observ…