Streamlining Admission with LOR Insights: AI-Based Leadership Assessment in Online Master's Program
Letters of recommendation (LORs) provide valuable insights into candidates' capabilities and experiences beyond standardized test scores. However, reviewing these text-heavy materials is time-consuming and labor-intensive. To address this challenge and support the admission committee in providing feedback for students' professional growth, our study introduces LORI: LOR Insights, a novel AI-based detection tool for assessing leadership skills in LORs submitted by online master's program applicants. By employing natural language processing and leveraging large language models using RoBERTa and LLAMA, we seek to identify leadership attributes such as teamwork, communication, and innovation. Our latest RoBERTa model achieves a weighted F1 score of 91.6%, a precision of 92.4%, and a recall of 91.6%, showing a strong level of consistency in our test data. With the growing importance of leadership skills in the STEM sector, integrating LORI into the graduate admissions process is crucial for accurately assessing applicants' leadership capabilities. This approach not only streamlines the admissions process but also automates and ensures a more comprehensive evaluation of candidates' capabilities.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Organizational transformation: The impact of servant leadership on work ethic culture with burnout as a mediating factor in the hospitality industry
Orientation: The study explores the connections among servant leadership, burnout, and work ethic culture in organizations. It aims to provide a detailed understanding of how servant leadership influences work ethic cult…
Assessing perceived organizational leadership styles through twitter text mining
We propose a text classification tool based on support vector machines for the assessment of organizational leadership styles, as appearing to Twitter users. We collected Twitter data over 51 days, related to the first 3…
text-classificationText ClassificationLeadership Assessment in Pediatric Intensive Care Unit Team Training
This paper addresses the task of assessing PICU team's leadership skills by developing an automated analysis framework based on egocentric vision. We identify key behavioral cues, including fixation object, eye contact, …
Contact Detectionobject-detectionObject DetectionAdmission Prediction in Undergraduate Applications: an Interpretable Deep Learning Approach
This article addresses the challenge of validating the admission committee's decisions for undergraduate admissions. In recent years, the traditional review process has struggled to handle the overwhelmingly large amount…
Deep LearningLLMs as Educational Analysts: Transforming Multimodal Data Traces into Actionable Reading Assessment Reports
Reading assessments are essential for enhancing students' comprehension, yet many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition. This study inve…
FairnessLanguage ModelingLanguage ModellingLarge Language Model