paper-with-me

Papers

Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

2022-10-07 · Wesley Hanwen Deng, Bill Boyuan Guo, Alicia DeVrio, Hong Shen, Motahhare Eslami, Kenneth Holstein

Recent years have seen growing interest among both researchers and practitioners in user-engaged approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know little about industry practitioners' current practices and challenges around user-engaged auditing, nor what opportunities exist for them to better leverage such approaches in practice. To investigate, we conducted a series of interviews and iterative co-design activities with practitioners who employ user-engaged auditing approaches in their work. Our findings reveal several challenges practitioners face in appropriately recruiting and incentivizing user auditors, scaffolding user audits, and deriving actionable insights from user-engaged audit reports. Furthermore, practitioners shared organizational obstacles to user-engaged auditing, surfacing a complex relationship between practitioners and user auditors. Based on these findings, we discuss opportunities for future HCI research to help realize the potential (and the mitigate risks) of user-engaged auditing in industry practice.

📄 PDF Abstract BibTeX arXiv:2210.03709

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice

2023-06-10 · Wesley Hanwen Deng, Nur Yildirim, Monica Chang, Motahhare Eslami 외

An emerging body of research indicates that ineffective cross-functional collaboration -- the interdisciplinary work done by industry practitioners across roles -- represents a major barrier to addressing issues of fairn…

Fairness

Understanding the Information Needs and Practices of Human Supporters of an Online Mental Health Intervention to Inform Machine Learning Applications

2021-11-12 · Anja Thieme

In the context of digital therapy interventions, such as internet-delivered Cognitive Behavioral Therapy (iCBT) for the treatment of depression and anxiety, extensive research has shown how the involvement of a human sup…

Should they? Mobile Biometrics and Technopolicy meet Queer Community Considerations

2023-10-06 · Anaelia Ovalle, Davi Liang, Alicia Boyd

Smartphones are integral to our daily lives and activities, providing us with basic functions like texting and phone calls to more complex motion-based functionalities like navigation, mobile gaming, and fitness-tracking…

Questioning the AI: Informing Design Practices for Explainable AI User Experiences

2020-01-08 · Q. Vera Liao, Daniel Gruen, Sarah Miller

A surge of interest in explainable AI (XAI) has led to a vast collection of algorithmic work on the topic. While many recognize the necessity to incorporate explainability features in AI systems, how to address real-worl…

Explainable Artificial Intelligence (XAI)Open-Ended Question Answering

Investigating Artificial Intelligence Digital Sovereignty in Mobile Shopping Apps: A Case Study of Nigeria

2026-08-06 · George Grispos, Sajda Qureshi arxiv

The use of e-commerce mobile applications is expanding in Nigeria, creating both opportunities and risks, including fraud and reduced user control over digital technologies, raising concerns about digital sovereignty. Th…