paper-with-me

Papers

Revisiting gender bias research in bibliometrics: Standardizing methodological variability using Scholarly Data Analysis (SoDA) Cards

2025-01-30 · Haejin Lee, Shubhanshu Mishra, Apratim Mishra, Zhiwen You, Jinseok Kim, Jana Diesner

Gender biases in scholarly metrics remain a persistent concern, despite numerous bibliometric studies exploring their presence and absence across productivity, impact, acknowledgment, and self-citations. However, methodological inconsistencies, particularly in author name disambiguation and gender identification, limit the reliability and comparability of these studies, potentially perpetuating misperceptions and hindering effective interventions. A review of 70 relevant publications over the past 12 years reveals a wide range of approaches, from name-based and manual searches to more algorithmic and gold-standard methods, with no clear consensus on best practices. This variability, compounded by challenges such as accurately disambiguating Asian names and managing unassigned gender labels, underscores the urgent need for standardized and robust methodologies. To address this critical gap, we propose the development and implementation of ``Scholarly Data Analysis (SoDA) Cards." These cards will provide a structured framework for documenting and reporting key methodological choices in scholarly data analysis, including author name disambiguation and gender identification procedures. By promoting transparency and reproducibility, SoDA Cards will facilitate more accurate comparisons and aggregations of research findings, ultimately supporting evidence-informed policymaking and enabling the longitudinal tracking of analytical approaches in the study of gender and other social biases in academia.

📄 PDF Abstract BibTeX arXiv:2501.18129

Code (1)

haejinlee41/scholarly_bias_study 공식 구현

Similar Papers 제목 키워드 기반

Revisiting The Classics: A Study on Identifying and Rectifying Gender Stereotypes in Rhymes and Poems

2024-03-18 · Aditya Narayan Sankaran, Vigneshwaran Shankaran, Sampath Lonka, Rajesh Sharma

Rhymes and poems are a powerful medium for transmitting cultural norms and societal roles. However, the pervasive existence of gender stereotypes in these works perpetuates biased perceptions and limits the scope of indi…

Language ModelingLanguage ModellingLarge Language Model

Towards Standardizing AI Bias Exploration

2024-05-29 · Emmanouil Krasanakis, Symeon Papadopoulos

Creating fair AI systems is a complex problem that involves the assessment of context-dependent bias concerns. Existing research and programming libraries express specific concerns as measures of bias that they aim to co…

Fairness

Editorial for the First Workshop on Mining Scientific Papers: Computational Linguistics and Bibliometrics

2015-06-17 · Iana Atanassova, Marc Bertin, Philipp Mayr

The workshop "Mining Scientific Papers: Computational Linguistics and Bibliometrics" (CLBib 2015), co-located with the 15th International Society of Scientometrics and Informetrics Conference (ISSI 2015), brought togethe…

WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case

2024-09-09 · Vagrant Gautam, Julius Steuer, Eileen Bingert, Ray Johns 외

While measuring bias and robustness in coreference resolution are important goals, such measurements are only as good as the tools we use to measure them. Winogender Schemas (Rudinger et al., 2018) are an influential dat…

coreference-resolutionCoreference ResolutionLanguage Modelling

Mining Scientific Papers for Bibliometrics: a (very) Brief Survey of Methods and Tools

2015-05-06 · Iana Atanassova, Marc Bertin, Philipp Mayr

The Open Access movement in scientific publishing and search engines like Google Scholar have made scientific articles more broadly accessible. During the last decade, the availability of scientific papers in full text h…

Articles