paper-with-me

홈 › Papers

AIMSCheck: Leveraging LLMs for AI-Assisted Review of Modern Slavery Statements Across Jurisdictions

2025-06-02 · Adriana Eufrosina Bora, Akshatha Arodi, Duoyi Zhang, Jordan Bannister, Mirko Bronzi, Arsene Fansi Tchango, Md Abul Bashar, Richi Nayak, Kerrie Mengersen

Modern Slavery Acts mandate that corporations disclose their efforts to combat modern slavery, aiming to enhance transparency and strengthen practices for its eradication. However, verifying these statements remains challenging due to their complex, diversified language and the sheer number of statements that must be reviewed. The development of NLP tools to assist in this task is also difficult due to a scarcity of annotated data. Furthermore, as modern slavery transparency legislation has been introduced in several countries, the generalizability of such tools across legal jurisdictions must be studied. To address these challenges, we work with domain experts to make two key contributions. First, we present AIMS.uk and AIMS.ca, newly annotated datasets from the UK and Canada to enable cross-jurisdictional evaluation. Second, we introduce AIMSCheck, an end-to-end framework for compliance validation. AIMSCheck decomposes the compliance assessment task into three levels, enhancing interpretability and practical applicability. Our experiments show that models trained on an Australian dataset generalize well across UK and Canadian jurisdictions, demonstrating the potential for broader application in compliance monitoring. We release the benchmark datasets and AIMSCheck to the public to advance AI-adoption in compliance assessment and drive further research in this field.

📄 PDF Abstract BibTeX arXiv:2506.01671

Code (1)

mila-ai4h/ai4h_aims-au 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Do LLMs Favor LLMs? Quantifying Interaction Effects in Peer Review

2026-01-28 · Vibhhu Sharma, Thorsten Joachims, Sarah Dean arxiv

There are increasing indications that LLMs are not only used for producing scientific papers, but also as part of the peer review process. In this work, we provide the first comprehensive analysis of LLM use across the p…

AiReview: An Open Platform for Accelerating Systematic Reviews with LLMs

2025-04-05 · Xinyu Mao, Teerapong Leelanupab, Martin Potthast, Harrisen Scells 외

Systematic reviews are fundamental to evidence-based medicine. Creating one is time-consuming and labour-intensive, mainly due to the need to screen, or assess, many studies for inclusion in the review. Several tools hav…

The AI Imperative: Scaling High-Quality Peer Review in Machine Learning

2025-06-09 · Qiyao Wei, Samuel Holt, Jing Yang, Markus Wulfmeier 외

Peer review, the bedrock of scientific advancement in machine learning (ML), is strained by a crisis of scale. Exponential growth in manuscript submissions to premier ML venues such as NeurIPS, ICML, and ICLR is outpacin…

Mirror: A Multi-Agent System for AI-Assisted Ethics Review

2026-02-09 · Yifan Ding, Yuhui Shi, Zhiyan Li, Zilong Wang 외 arxiv

Ethics review is a foundational mechanism of modern research governance, yet contemporary systems face increasing strain as ethical risks arise as structural consequences of large-scale, interdisciplinary scientific prac…

PRAIB: Peer Review AI Benchmark of Behaviour of LLM-Assisted Reviewing

2026-05-28 · Krzysztof Żurawicki, Julia Farganus, Arkadiusz Gaweł, Mateusz Bystroński 외 arxiv

The growing number of submitted papers has motivated the exploration of Large Language Models (LLMs) as a means to support and augment the peer review process, particularly in terms of improving its speed and scalability…