paper-with-me

홈 › Papers

Pharos-ESG: A Framework for Multimodal Parsing, Contextual Narration, and Hierarchical Labeling of ESG Report

2025-11-20 · Yan Chen, Yu Zou, Jialei Zeng, Haoran You, Xiaorui Zhou, Aixi Zhong arxiv

Environmental, Social, and Governance (ESG) principles are reshaping the foundations of global financial governance, transforming capital allocation architectures, regulatory frameworks, and systemic risk coordination mechanisms. However, as the core medium for assessing corporate ESG performance, the ESG reports present significant challenges for large-scale understanding, due to chaotic reading order from slide-like irregular layouts and implicit hierarchies arising from lengthy, weakly structured content. To address these challenges, we propose Pharos-ESG, a unified framework that transforms ESG reports into structured representations through multimodal parsing, contextual narration, and hierarchical labeling. It integrates a reading-order modeling module based on layout flow, hierarchy-aware segmentation guided by table-of-contents anchors, and a multi-modal aggregation pipeline that contextually transforms visual elements into coherent natural language. The framework further enriches its outputs with ESG, GRI, and sentiment labels, yielding annotations aligned with the analytical demands of financial research. Extensive experiments on annotated benchmarks demonstrate that Pharos-ESG consistently outperforms both dedicated document parsing systems and general-purpose multimodal models. In addition, we release Aurora-ESG, the first large-scale public dataset of ESG reports, spanning Mainland China, Hong Kong, and U.S. markets, featuring unified structured representations of multi-modal content, enriched with fine-grained layout and semantic annotations to better support ESG integration in financial governance and decision-making.

📄 PDF Abstract BibTeX arXiv:2511.16417

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Multimodal Contextualized Semantic Parsing from Speech

2024-06-10 · Jordan Voas, Raymond Mooney, David Harwath

We introduce Semantic Parsing in Contextual Environments (SPICE), a task designed to enhance artificial agents' contextual awareness by integrating multimodal inputs with prior contexts. SPICE goes beyond traditional sem…

Data Integrationgraph constructionSemantic Parsing

Semi-supervised multimodal coreference resolution in image narrations

2023-10-20 · Arushi Goel, Basura Fernando, Frank Keller, Hakan Bilen

In this paper, we study multimodal coreference resolution, specifically where a longer descriptive text, i.e., a narration is paired with an image. This poses significant challenges due to fine-grained image-text alignme…

coreference-resolutionCoreference ResolutionDescriptive

Integrating Audio Narrations to Strengthen Domain Generalization in Multimodal First-Person Action Recognition

2024-09-15 · Cagri Gungor, Adriana Kovashka

First-person activity recognition is rapidly growing due to the widespread use of wearable cameras but faces challenges from domain shifts across different environments, such as varying objects or background scenes. We p…

Action RecognitionActivity RecognitionDomain Generalization

Reliable and Efficient Evaluation of Adversarial Robustness for Deep Hashing-Based Retrieval

2023-03-22 · Xunguang Wang, Jiawang Bai, Xinyue Xu, Xiaomeng Li

Deep hashing has been extensively applied to massive image retrieval due to its efficiency and effectiveness. Recently, several adversarial attacks have been presented to reveal the vulnerability of deep hashing models a…

Adversarial RobustnessDeep HashingImage RetrievalMath+1

On the Limits of Tabular Hardness Metrics for Deep RL: A Study with the Pharos Benchmark

2025-09-21 · Michelangelo Conserva, Remo Sasso, Paulo Rauber arxiv

Principled evaluation is critical for progress in deep reinforcement learning (RL), yet it lags behind the theory-driven benchmarks of tabular RL. While tabular settings benefit from well-understood hardness measures lik…

Reinforcement Learning