paper-with-me

홈 › Papers

UniGen: Universal Domain Generalization for Sentiment Classification via Zero-shot Dataset Generation

2024-05-02 · Juhwan Choi, Yeonghwa Kim, Seunguk Yu, Jungmin Yun, Youngbin Kim

Although pre-trained language models have exhibited great flexibility and versatility with prompt-based few-shot learning, they suffer from the extensive parameter size and limited applicability for inference. Recent studies have suggested that PLMs be used as dataset generators and a tiny task-specific model be trained to achieve efficient inference. However, their applicability to various domains is limited because they tend to generate domain-specific datasets. In this work, we propose a novel approach to universal domain generalization that generates a dataset regardless of the target domain. This allows for generalization of the tiny task model to any domain that shares the label space, thus enhancing the real-world applicability of the dataset generation paradigm. Our experiments indicate that the proposed method accomplishes generalizability across various domains while using a parameter set that is orders of magnitude smaller than PLMs.

📄 PDF Abstract BibTeX arXiv:2405.01022

Code (1)

c-juhwan/unigen 공식 구현 pytorch

Tasks

Dataset GenerationDomain GeneralizationFew-Shot LearningSentiment AnalysisSentiment Classification

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

UniGen: A Unified Framework for Textual Dataset Generation Using Large Language Models

2024-06-27 · Siyuan Wu, Yue Huang, Chujie Gao, Dongping Chen 외

Large Language Models (LLMs) such as GPT-4 and Llama3 have significantly impacted various fields by enabling high-quality synthetic data generation and reducing dependence on expensive human-generated datasets. Despite t…

AttributeBenchmarkingData AugmentationDataset Generation+3

USA: Universal Sentiment Analysis Model & Construction of Japanese Sentiment Text Classification and Part of Speech Dataset

2023-09-07 · Chengguang Gan, Qinghao Zhang, Tatsunori Mori

Sentiment analysis is a pivotal task in the domain of natural language processing. It encompasses both text-level sentiment polarity classification and word-level Part of Speech(POS) sentiment polarity determination. Suc…

ClassificationPOSSentiment AnalysisSentiment Classification+2

90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development

2025-09-30 · Runxin Yang, Yuxuan Wan, Shuqing Li, Michael R. Lyu arxiv

Developing 3D games requires specialized expertise across multiple domains, including programming, 3D modeling, and engine configuration, which limits access to millions of potential creators. Recently, researchers have …

UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generation

2025-05-20 · Rui Tian, Mingfei Gao, Mingze Xu, Jiaming Hu 외

We introduce UniGen, a unified multimodal large language model (MLLM) capable of image understanding and generation. We study the full training pipeline of UniGen from a data-centric perspective, including multi-stage pr…

Image GenerationLanguage ModelingLanguage ModellingLarge Language Model+1

UniGenDet: A Unified Generative-Discriminative Framework for Co-Evolutionary Image Generation and Generated Image Detection

2026-04-23 · Yanran Zhang, Wenzhao Zheng, Yifei Li, Bingyao Yu 외 arxiv

In recent years, significant progress has been made in both image generation and generated image detection. Despite their rapid, yet largely independent, development, these two fields have evolved distinct architectural …

Image Generation