paper-with-me

홈 › Papers

Open vs Closed-ended questions in attitudinal surveys -- comparing, combining, and interpreting using natural language processing

2022-05-03 · Vishnu Baburajan, João de Abreu e Silva, Francisco Camara Pereira

To improve the traveling experience, researchers have been analyzing the role of attitudes in travel behavior modeling. Although most researchers use closed-ended surveys, the appropriate method to measure attitudes is debatable. Topic Modeling could significantly reduce the time to extract information from open-ended responses and eliminate subjective bias, thereby alleviating analyst concerns. Our research uses Topic Modeling to extract information from open-ended questions and compare its performance with closed-ended responses. Furthermore, some respondents might prefer answering questions using their preferred questionnaire type. So, we propose a modeling framework that allows respondents to use their preferred questionnaire type to answer the survey and enable analysts to use the modeling frameworks of their choice to predict behavior. We demonstrate this using a dataset collected from the USA that measures the intention to use Autonomous Vehicles for commute trips. Respondents were presented with alternative questionnaire versions (open- and closed- ended). Since our objective was also to compare the performance of alternative questionnaire versions, the survey was designed to eliminate influences resulting from statements, behavioral framework, and the choice experiment. Results indicate the suitability of using Topic Modeling to extract information from open-ended responses; however, the models estimated using the closed-ended questions perform better compared to them. Besides, the proposed model performs better compared to the models used currently. Furthermore, our proposed framework will allow respondents to choose the questionnaire type to answer, which could be particularly beneficial to them when using voice-based surveys.

📄 PDF Abstract BibTeX arXiv:2205.01317

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous Vehicles

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Similar Papers 제목 키워드 기반

Tell Me About Yourself: Using an AI-Powered Chatbot to Conduct Conversational Surveys with Open-ended Questions

2019-05-25 · Ziang Xiao, Michelle X. Zhou, Q. Vera Liao, Gloria Mark 외

The rise of increasingly more powerful chatbots offers a new way to collect information through conversational surveys, where a chatbot asks open-ended questions, interprets a user's free-text responses, and probes answe…

ChatbotInformativenessSpecificitySurvey

Explaining Neural NLP Models for the Joint Analysis of Open-and-Closed-Ended Survey Answers

2022-07-01 · NAACL (TrustNLP) 2022 7 · Edoardo Mosca, Katharina Harmann, Tobias Eder, Georg Groh

Large-scale surveys are a widely used instrument to collect data from a target audience. Beyond the single individual, an appropriate analysis of the answers can reveal trends and patterns and thus generate new insights …

SuperCLUE: A Comprehensive Chinese Large Language Model Benchmark

2023-07-27 · Liang Xu, Anqi Li, Lei Zhu, Hang Xue 외

Large language models (LLMs) have shown the potential to be integrated into human daily lives. Therefore, user preference is the most critical criterion for assessing LLMs' performance in real-world scenarios. However, e…

Language ModelingLanguage ModellingLarge Language Modelmodel

Multi-label classification of open-ended questions with BERT

2023-04-06 · Matthias Schonlau, Julia Weiß, Jan Marquardt

Open-ended questions in surveys are valuable because they do not constrain the respondent's answer, thereby avoiding biases. However, answers to open-ended questions are text data which are harder to analyze. Traditional…

ClassificationMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATION

O$^2$-Searcher: A Searching-based Agent Model for Open-Domain Open-Ended Question Answering

2025-05-22 · Jianbiao Mei, Tao Hu, Daocheng Fu, Licheng Wen 외

Large Language Models (LLMs), despite their advancements, are fundamentally limited by their static parametric knowledge, hindering performance on tasks requiring open-domain up-to-date information. While enabling LLMs t…

Answer GenerationOpen-Ended Question AnsweringQuestion AnsweringWorld Knowledge