paper-with-me

Papers

Transfer Learning in Conversational Analysis through Reusing Preprocessing Data as Supervisors

2021-12-02 · Joshua Yee Kim, Tongliang Liu, Kalina Yacef

Conversational analysis systems are trained using noisy human labels and often require heavy preprocessing during multi-modal feature extraction. Using noisy labels in single-task learning increases the risk of over-fitting. Auxiliary tasks could improve the performance of the primary task learning during the same training -- this approach sits in the intersection of transfer learning and multi-task learning (MTL). In this paper, we explore how the preprocessed data used for feature engineering can be re-used as auxiliary tasks, thereby promoting the productive use of data. Our main contributions are: (1) the identification of sixteen beneficially auxiliary tasks, (2) studying the method of distributing learning capacity between the primary and auxiliary tasks, and (3) studying the relative supervision hierarchy between the primary and auxiliary tasks. Extensive experiments on IEMOCAP and SEMAINE data validate the improvements over single-task approaches, and suggest that it may generalize across multiple primary tasks.

📄 PDF Abstract BibTeX arXiv:2112.03032

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringMulti-Task LearningTransfer Learning

Similar Papers 제목 키워드 기반

Reusing Preprocessing Data as Auxiliary Supervision in Conversational Analysis

2021-01-01 · Joshua Yee Kim, Kalina Yacef

Conversational analysis systems are trained using noisy human labels and often require heavy preprocessing during multi-modal feature extraction. Using noisy labels in single-task learning increases the risk of over-fitt…

Feature EngineeringMulti-Task Learning

Transfer learning for semantic similarity measures based on symbolic regression

2023-07-02 · Journal of Intelligent & Fuzzy Systems 2023 7 · Jorge Martinez-Gil, Jose M. Chaves Gonzalez

Recently, transfer learning strategies have become ideal for reusing acquired knowledge through a training phase. The key idea is that reusing such knowledge brings advantages such as increased accuracy and considerable …

regressionSemantic SimilaritySemantic Textual SimilaritySymbolic Regression+1

TAMUSA-Chat: A Domain-Adapted Large Language Model Conversational System for Research and Responsible Deployment

2026-02-14 · Izzat Alsmadi, Anas Alsobeh arxiv

This paper presents TAMUSA-Chat, a research-oriented framework for building domain-adapted large language model conversational systems. The work addresses critical challenges in adapting general-purpose foundation models…

Domain Adaptation

On Robustness and Transferability of Convolutional Neural Networks

2020-07-16 · CVPR 2021 1 · Josip Djolonga, Jessica Yung, Michael Tschannen, Rob Romijnders 외

Modern deep convolutional networks (CNNs) are often criticized for not generalizing under distributional shifts. However, several recent breakthroughs in transfer learning suggest that these networks can cope with severe…

image-classificationImage ClassificationTransfer Learning

SemShareKV: Efficient KVCache Sharing for Semantically Similar Prompts via Token-Level LSH Matching

2025-09-29 · Xinye Zhao, Spyridon Mastorakis arxiv

As large language models (LLMs) continue to scale, the memory footprint of key-value (KV) caches during inference has become a significant bottleneck. Existing approaches primarily focus on compressing KV caches within a…

Multi-Document Summarization