paper-with-me

Papers

AI Telephone Surveying: Automating Quantitative Data Collection with an AI Interviewer

2025-07-23 · Danny D. Leybzon, Shreyas Tirumala, Nishant Jain, Summer Gillen, Michael Jackson, Cameron McPhee, Jennifer Schmidt arxiv

With the rise of voice-enabled artificial intelligence (AI) systems, quantitative survey researchers have access to a new data-collection mode: AI telephone surveying. By using AI to conduct phone interviews, researchers can scale quantitative studies while balancing the dual goals of human-like interactivity and methodological rigor. Unlike earlier efforts that used interactive voice response (IVR) technology to automate these surveys, voice AI enables a more natural and adaptive respondent experience as it is more robust to interruptions, corrections, and other idiosyncrasies of human speech. We built and tested an AI system to conduct quantitative surveys based on large language models (LLM), automatic speech recognition (ASR), and speech synthesis technologies. The system was specifically designed for quantitative research, and strictly adhered to research best practices like question order randomization, answer order randomization, and exact wording. To validate the system's effectiveness, we deployed it to conduct two pilot surveys with the SSRS Opinion Panel and followed-up with a separate human-administered survey to assess respondent experiences. We measured three key metrics: the survey completion rates, break-off rates, and respondent satisfaction scores. Our results suggest that shorter instruments and more responsive AI interviewers may contribute to improvements across all three metrics studied.

📄 PDF Abstract BibTeX arXiv:2507.17718

Code (0)

등록된 구현이 없습니다.

Tasks

Speech RecognitionSpeech Synthesis

Similar Papers 제목 키워드 기반

The IBM 2016 English Conversational Telephone Speech Recognition System

2016-04-27 · George Saon, Tom Sercu, Steven Rennie, Hong-Kwang J. Kuo

We describe a collection of acoustic and language modeling techniques that lowered the word error rate of our English conversational telephone LVCSR system to a record 6.6% on the Switchboard subset of the Hub5 2000 eval…

Language ModelingLanguage Modellingspeech-recognitionSpeech Recognition

Multi-language Speech Collection for NIST LRE

2016-05-01 · LREC 2016 5 · Karen Jones, Stephanie Strassel, Kevin Walker, David Graff 외

The Multi-language Speech (MLS) Corpus supports NIST{'}s Language Recognition Evaluation series by providing new conversational telephone speech and broadcast narrowband data in 20 languages/dialects. The corpus was buil…

Saying the Unsaid: Revealing the Hidden Language of Multimodal Systems Through Telephone Games

2025-11-12 · Juntu Zhao, Jialing Zhang, Chongxuan Li, Dequan Wang arxiv

Recent closed-source multimodal systems have made great advances, but their hidden language for understanding the world remains opaque because of their black-box architectures. In this paper, we use the systems' preferen…

Automating Infrastructure Surveying: A Framework for Geometric Measurements and Compliance Assessment Using Point Cloud Data

2025-05-09 · Amin Ghafourian, Andrew Lee, Dechen Gao, Tyler Beer 외

Automation can play a prominent role in improving efficiency, accuracy, and scalability in infrastructure surveying and assessing construction and compliance standards. This paper presents a framework for automation of g…

Survey

When prompt perturbations break your A/B test: A valid statistical test for generative surveying

2026-05-26 · Hayden Helm, Carey Priebe arxiv

Generative surveying -- where collections of LLM-based personas provide feedback on messages -- has emerged as a cheap and scalable alternative to traditional market research. However, LLMs are sensitive to small variati…