paper-with-me

홈 › Papers

Fusian: Multi-LoRA Fusion for Fine-Grained Continuous MBTI Personality Control in Large Language Models

2026-03-16 · Zehao Chen, Rong Pan arxiv

Large Language Models (LLMs) have demonstrated impressive capabilities in simulating diverse human behaviors and personalities. However, existing methods for personality control, which include prompt engineering and standard Supervised Fine-Tuning (SFT), typically treat personality traits as discrete categories (e.g., "Extroverted" vs. "Introverted"), lacking the ability to precisely control the intensity of a trait on a continuous spectrum. In this paper, we introduce Fusian, a novel framework for fine-grained, continuous personality control in LLMs. Fusian operates in two stages: (1) Trajectory Collection, where we capture the dynamic evolution of personality adoption during SFT by saving a sequence of LoRA adapters, effectively mapping the continuous manifold of a trait; and (2) RL-based Dynamic Fusion, where we train a policy network using Reinforcement Learning to dynamically compute mixing weights for these frozen adapters. By sampling from a Dirichlet distribution parameterized by the policy network, Fusian fuses multiple adapters to align the model's output with a specific numerical target intensity. Experiments on the Qwen3-14B model demonstrate that Fusian achieves high precision in personality control, significantly outperforming baseline methods in aligning with user-specified trait intensities.

📄 PDF Abstract BibTeX arXiv:2603.15405

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningPrompt Engineering

Similar Papers 제목 키워드 기반

AutoLoRA: Automatic LoRA Retrieval and Fine-Grained Gated Fusion for Text-to-Image Generation

2025-08-04 · Zhiwen Li, Zhongjie Duan, Die Chen, Cen Chen 외 arxiv

Despite recent advances in photorealistic image generation through large-scale models like FLUX and Stable Diffusion v3, the practical deployment of these architectures remains constrained by their inherent intractabilit…

Text-to-Image Generation

ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets

2026-02-23 · Hoyoung Kim, Minwoo Jang, Jabin Koo, Sangdoo Yun 외 arxiv

Beyond general recognition tasks, specialized domains and fine-grained settings often encounter data scarcity, especially for tail classes. To obtain less biased and more reliable models under such scarcity, practitioner…

CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds

2026-08-01 · Peng Zheng, Ruiqi Liu, Rui Ma, Zuxuan Wu arxiv

Recent subject-to-image models have achieved impressive progress in personalized image generation, yet they still struggle to preserve fine-grained subject-specific details. A major reason is the lack of high-quality fin…

Personalized Image Generation

DreamWalk: Style Space Exploration using Diffusion Guidance

2024-04-04 · Michelle Shu, Charles Herrmann, Richard Strong Bowen, Forrester Cole 외

Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "p…

Prompt Engineering

A Diffusion-Driven Fine-Grained Nodule Synthesis Framework for Enhanced Lung Nodule Detection from Chest Radiographs

2026-03-02 · Aryan Goyal, Shreshtha Singh, Ashish Mittal, Manoj Tadepalli 외 arxiv

Early detection of lung cancer in chest radiographs (CXRs) is crucial for improving patient outcomes, yet nodule detection remains challenging due to their subtle appearance and variability in radiological characteristic…

Synthetic Data GenerationLung Nodule Detection