paper-with-me

Papers

Social Bias in Large Language Models For Bangla: An Empirical Study on Gender and Religious Bias

2024-07-03 · Jayanta Sadhu, Maneesha Rani Saha, Rifat Shahriyar

The rapid growth of Large Language Models (LLMs) has put forward the study of biases as a crucial field. It is important to assess the influence of different types of biases embedded in LLMs to ensure fair use in sensitive fields. Although there have been extensive works on bias assessment in English, such efforts are rare and scarce for a major language like Bangla. In this work, we examine two types of social biases in LLM generated outputs for Bangla language. Our main contributions in this work are: (1) bias studies on two different social biases for Bangla, (2) a curated dataset for bias measurement benchmarking and (3) testing two different probing techniques for bias detection in the context of Bangla. This is the first work of such kind involving bias assessment of LLMs for Bangla to the best of our knowledge. All our code and resources are publicly available for the progress of bias related research in Bangla NLP.

📄 PDF Abstract BibTeX arXiv:2407.03536

Code (1)

csebuetnlp/BanglaSocialBias 공식 구현

Tasks

BenchmarkingBias Detection

Similar Papers 제목 키워드 기반

An Empirical Study on the Characteristics of Bias upon Context Length Variation for Bangla

2024-06-25 · Jayanta Sadhu, Ayan Antik Khan, Abhik Bhattacharjee, Rifat Shahriyar

Pretrained language models inherently exhibit various social biases, prompting a crucial examination of their social impact across various linguistic contexts due to their widespread usage. Previous studies have provided…

BanStereoSet: A Dataset to Measure Stereotypical Social Biases in LLMs for Bangla

2024-09-18 · Mahammed Kamruzzaman, Abdullah Al Monsur, Shrabon Das, Enamul Hassan 외

This study presents BanStereoSet, a dataset designed to evaluate stereotypical social biases in multilingual LLMs for the Bangla language. In an effort to extend the focus of bias research beyond English-centric datasets…

An Empirical Study of Gendered Stereotypes in Emotional Attributes for Bangla in Multilingual Large Language Models

2024-07-08 · Jayanta Sadhu, Maneesha Rani Saha, Rifat Shahriyar

The influence of Large Language Models (LLMs) is rapidly growing, automating more jobs over time. Assessing the fairness of LLMs is crucial due to their expanding impact. Studies reveal the reflection of societal norms a…

Fairness

BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction

2026-03-16 · Tanvir Ahmed Sijan, S. M Golam Rifat, Pankaj Chowdhury Partha, Md. Tanjeed Islam 외 arxiv

Large Language Models have demonstrated strong multilingual fluency, yet fluency alone does not guarantee socially appropriate language use. In high-context languages, communicative competence requires sensitivity to soc…

BN-AuthProf: Benchmarking Machine Learning for Bangla Author Profiling on Social Media Texts

2024-12-03 · Raisa Tasnim, Mehanaz Chowdhury, Md Ataur Rahman

Author profiling, the analysis of texts to uncover attributes such as gender and age of the author, has become essential with the widespread use of social media platforms. This paper focuses on author profiling in the Ba…

Age And Gender ClassificationAge and Gender EstimationAge ClassificationAuthor Profiling+3