paper-with-me

Papers

InstructableCrowd: Creating IF-THEN Rules for Smartphones via Conversations with the Crowd

2019-09-12 · Ting-Hao 'Kenneth' Huang, Amos Azaria, Oscar J. Romero, Jeffrey P. Bigham

Natural language interfaces have become a common part of modern digital life. Chatbots utilize text-based conversations to communicate with users; personal assistants on smartphones such as Google Assistant take direct speech commands from their users; and speech-controlled devices such as Amazon Echo use voice as their only input mode. In this paper, we introduce InstructableCrowd, a crowd-powered system that allows users to program their devices via conversation. The user verbally expresses a problem to the system, in which a group of crowd workers collectively respond and program relevant multi-part IF-THEN rules to help the user. The IF-THEN rules generated by InstructableCrowd connect relevant sensor combinations (e.g., location, weather, device acceleration, etc.) to useful effectors (e.g., text messages, device alarms, etc.). Our study showed that non-programmers can use the conversational interface of InstructableCrowd to create IF-THEN rules that have similar quality compared with the rules created manually. InstructableCrowd generally illustrates how users may converse with their devices, not only to trigger simple voice commands, but also to personalize their increasingly powerful and complicated devices.

📄 PDF Abstract BibTeX arXiv:1909.05725

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hey Alexa what did I just type? Decoding smartphone sounds with a voice assistant

2020-12-01 · Almos Zarandy, Ilia Shumailov, Ross Anderson

Voice assistants are now ubiquitous and listen in on our everyday lives. Ever since they became commercially available, privacy advocates worried that the data they collect can be abused: might private conversations be e…

Emotion Recognition in Conversation using Probabilistic Soft Logic

2022-07-14 · Eriq Augustine, Pegah Jandaghi, Alon Albalak, Connor Pryor 외

Creating agents that can both appropriately respond to conversations and understand complex human linguistic tendencies and social cues has been a long standing challenge in the NLP community. A recent pillar of research…

Emotion RecognitionEmotion Recognition in ConversationLogical ReasoningSentence+1

From Simulated Mixtures to Simulated Conversations as Training Data for End-to-End Neural Diarization

2022-04-02 · Federico Landini, Alicia Lozano-Diez, Mireia Diez, Lukáš Burget

End-to-end neural diarization (EEND) is nowadays one of the most prominent research topics in speaker diarization. EEND presents an attractive alternative to standard cascaded diarization systems since a single system is…

speaker-diarizationSpeaker Diarization

Data Efficient Child-Adult Speaker Diarization with Simulated Conversations

2024-09-13 · Anfeng Xu, Tiantian Feng, Helen Tager-Flusberg, Catherine Lord 외

Automating child speech analysis is crucial for applications such as neurocognitive assessments. Speaker diarization, which identifies ``who spoke when'', is an essential component of the automated analysis. However, pub…

speaker-diarizationSpeaker DiarizationTransfer Learning

Multimodal Personal Ear Authentication Using Smartphones

2021-03-23 · S. Itani, S. Kita, Y. Kajikawa

In recent years, biometric authentication technology for smartphones has become widespread, with the mainstream methods being fingerprint authentication and face recognition. However, fingerprint authentication cannot be…

Face Recognition