paper-with-me

홈 › Papers

Soft Inductive Bias Approach via Explicit Reasoning Perspectives in Inappropriate Utterance Detection Using Large Language Models

2025-12-09 · Ju-Young Kim, Ji-Hong Park, Se-Yeon Lee, Sujin Park, Gun-Woo Kim arxiv

Recent incidents in certain online games and communities, where anonymity is guaranteed, show that unchecked inappropriate remarks frequently escalate into verbal abuse and even criminal behavior, raising significant social concerns. Consequently, there is a growing need for research on techniques that can detect inappropriate utterances within conversational texts to help build a safer communication environment. Although large-scale language models trained on Korean corpora and chain-of-thought reasoning have recently gained attention, research applying these approaches to inappropriate utterance detection remains limited. In this study, we propose a soft inductive bias approach that explicitly defines reasoning perspectives to guide the inference process, thereby promoting rational decision-making and preventing errors that may arise during reasoning. We fine-tune a Korean large language model using the proposed method and conduct both quantitative performance comparisons and qualitative evaluations across different training strategies. Experimental results show that the Kanana-1.5 model achieves an average accuracy of 87.0046, improving by approximately 3.89 percent over standard supervised learning. These findings indicate that the proposed method goes beyond simple knowledge imitation by large language models and enables more precise and consistent judgments through constrained reasoning perspectives, demonstrating its effectiveness for inappropriate utterance detection.

📄 PDF Abstract BibTeX arXiv:2512.08480

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers

2023-04-01 · Awni Altabaa, Taylor Webb, Jonathan Cohen, John Lafferty

An extension of Transformers is proposed that enables explicit relational reasoning through a novel module called the Abstractor. At the core of the Abstractor is a variant of attention called relational cross-attention.…

Inductive BiasMathematical Problem-SolvingRelational Reasoning

Conceptual and Unbiased Reasoning in Language Models

2024-03-30 · Ben Zhou, Hongming Zhang, Sihao Chen, Dian Yu 외

Conceptual reasoning, the ability to reason in abstract and high-level perspectives, is key to generalization in human cognition. However, limited study has been done on large language models' capability to perform conce…

Decision Making

Graph Machine: Exploring Edge Mechanisms as an Inductive Bias

2026-08-07 · Lintai Hou arxiv

Transformers provide a powerful architecture for global content-based matching, but reasoning problems may benefit from a stronger inductive bias toward iterative traversal of latent relations. We introduce Graph Machine…

LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning

2021-01-15 · Yuhuai Wu, Markus Rabe, Wenda Li, Jimmy Ba 외

While designing inductive bias in neural architectures has been widely studied, we hypothesize that transformer networks are flexible enough to learn inductive bias from suitable generic tasks. Here, we replace architect…

Inductive BiasMathematical Reasoning

On the Inductive Bias of Stacking Towards Improving Reasoning

2024-09-27 · Nikunj Saunshi, Stefani Karp, Shankar Krishnan, Sobhan Miryoosefi 외

Given the increasing scale of model sizes, novel training strategies like gradual stacking [Gong et al., 2019, Reddi et al., 2023] have garnered interest. Stacking enables efficient training by gradually growing the dept…

Inductive BiasMathReading Comprehension