paper-with-me

홈 › Papers

EaSyGuide : ESG Issue Identification Framework leveraging Abilities of Generative Large Language Models

2023-06-11 · Hanwool Lee, Jonghyun Choi, Sohyeon Kwon, Sungbum Jung

This paper presents our participation in the FinNLP-2023 shared task on multi-lingual environmental, social, and corporate governance issue identification (ML-ESG). The task's objective is to classify news articles based on the 35 ESG key issues defined by the MSCI ESG rating guidelines. Our approach focuses on the English and French subtasks, employing the CerebrasGPT, OPT, and Pythia models, along with the zero-shot and GPT3Mix Augmentation techniques. We utilize various encoder models, such as RoBERTa, DeBERTa, and FinBERT, subjecting them to knowledge distillation and additional training. Our approach yielded exceptional results, securing the first position in the English text subtask with F1-score 0.69 and the second position in the French text subtask with F1-score 0.78. These outcomes underscore the effectiveness of our methodology in identifying ESG issues in news articles across different languages. Our findings contribute to the exploration of ESG topics and highlight the potential of leveraging advanced language models for ESG issue identification.

📄 PDF Abstract BibTeX arXiv:2306.06662

Code (1)

finmu/ml-esg_codes 공식 구현 pytorch

Tasks

ArticlesKnowledge DistillationPosition

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Causal AI-based Root Cause Identification: Research to Practice at Scale

2025-02-25 · Saurabh Jha, Ameet Rahane, Laura Shwartz, Marc Palaci-Olgun 외

Modern applications are built as large, distributed systems spanning numerous modules, teams, and data centers. Despite robust engineering and recovery strategies, failures and performance issues remain inevitable, riski…

Management

DXM-TransFuse U-net: Dual Cross-Modal Transformer Fusion U-net for Automated Nerve Identification

2022-02-27 · Baijun Xie, Gary Milam, Bo Ning, Jaepyeong Cha 외

Accurate nerve identification is critical during surgical procedures for preventing any damages to nerve tissues. Nerve injuries can lead to long-term detrimental effects for patients as well as financial overburdens. In…

Vessel Re-identification and Activity Detection in Thermal Domain for Maritime Surveillance

2024-06-12 · Yasod Ginige, Ransika Gunasekara, Darsha Hewavitharana, Manjula Ariyarathne 외

Maritime surveillance is vital to mitigate illegal activities such as drug smuggling, illegal fishing, and human trafficking. Vision-based maritime surveillance is challenging mainly due to visibility issues at night, wh…

Action DetectionActivity DetectionObject Tracking

ElectroCardioGuard: Preventing Patient Misidentification in Electrocardiogram Databases through Neural Networks

2023-06-09 · Michal Seják, Jakub Sido, David Žahour

Electrocardiograms (ECGs) are commonly used by cardiologists to detect heart-related pathological conditions. Reliable collections of ECGs are crucial for precise diagnosis. However, in clinical practice, the assignment …

ECG Patient IdentificationECG Patient Identification (gallery-probe)Efficient Neural Network

VULNERLIZER: Cross-analysis Between Vulnerabilities and Software Libraries

2023-09-18 · Irdin Pekaric, Michael Felderer, Philipp Steinmüller

The identification of vulnerabilities is a continuous challenge in software projects. This is due to the evolution of methods that attackers employ as well as the constant updates to the software, which reveal additional…