paper-with-me

홈 › Papers

Improving Aviation Safety Analysis: Automated HFACS Classification Using Reinforcement Learning with Group Relative Policy Optimization

2025-08-28 · Arash Ahmadi, Sarah Sharif, Yaser Banad arxiv

Analyzing the human factors behind aviation accidents is crucial for preventing future incidents, yet traditional methods using the Human Factors Analysis and Classification System (HFACS) are limited by scalability and consistency. To address this, we introduce an automated HFACS classification framework for aviation safety analysis that utilizes Reinforcement Learning with Group Relative Policy Optimization (GRPO) to fine-tune a Llama-3.1 8B language model. Our approach incorporates a multi-component reward system tailored for aviation safety analysis and integrates synthetic data generation to overcome class imbalance in accident datasets. The resulting GRPO-optimized model achieved noticeable performance gains, including a 350% increase in exact match accuracy (from 0.0400 to 0.1800) and an improved partial match accuracy of 0.8800. Significantly, our specialized model outperforms state-of-the-art LLMs (Large Language Models), including GPT-5-mini and Gemini-2.5-fiash, on key metrics. This research also proposes exact match accuracy in multi-label HFACS classification problem as a new benchmarking methodology to evaluate the advanced reasoning capabilities of language models. Ultimately, our work validates that smaller, domain-optimized models can provide a computationally efficient and better solution for critical safety analysis. This approach makes powerful, low-latency deployment on resource-constrained edge devices feasible.

📄 PDF Abstract BibTeX arXiv:2508.21201

Code (0)

등록된 구현이 없습니다.

Tasks

Synthetic Data GenerationReinforcement Learning

Similar Papers 제목 키워드 기반

Aviation Safety Risk Analysis and Flight Technology Assessment Issues

2023-08-10 · Shuanghe Liu

This text highlights the significance of flight safety in China's civil aviation industry and emphasizes the need for comprehensive research. It focuses on two main areas: analyzing exceedance events and statistically ev…

Safety Analysis Methods for Complex Systems in Aviation

2022-08-03 · Ítalo Romani de Oliveira, José Alexandre T. Guerreiro Fregnani, Gláucia Costa Balvedi, Michael L. Ulrey 외

Each new concept of operation and equipment generation in aviation becomes more automated, integrated and interconnected. In the case of Unmanned Aircraft Systems (UAS), this evolution allows drastically decreasing aircr…

Natural Language Processing of Aviation Occurrence Reports for Safety Management

2023-01-13 · Patrick Jonk, Vincent de Vries, Rombout Wever, Georgios Sidiropoulos 외

Occurrence reporting is a commonly used method in safety management systems to obtain insight in the prevalence of hazards and accident scenarios. In support of safety data analysis, reports are often categorized accordi…

Management

Phase of Flight Classification in Aviation Safety using LSTM, GRU, and BiLSTM: A Case Study with ASN Dataset

2025-01-14 · Aziida Nanyonga, Hassan Wasswa, Graham Wild

Safety is the main concern in the aviation industry, where even minor operational issues can lead to serious consequences. This study addresses the need for comprehensive aviation accident analysis by leveraging natural …

Topic Modeling Analysis of Aviation Accident Reports: A Comparative Study between LDA and NMF Models

2024-03-04 · Aziida Nanyonga, Hassan Wasswa, Graham Wild

Aviation safety is paramount in the modern world, with a continuous commitment to reducing accidents and improving safety standards. Central to this endeavor is the analysis of aviation accident reports, rich textual res…