Follow-on Question Suggestion via Voice Hints for Voice Assistants
The adoption of voice assistants like Alexa or Siri has grown rapidly, allowing users to instantly access information via voice search. Query suggestion is a standard feature of screen-based search experiences, allowing users to explore additional topics. However, this is not trivial to implement in voice-based settings. To enable this, we tackle the novel task of suggesting questions with compact and natural voice hints to allow users to ask follow-up questions. We define the task, ground it in syntactic theory and outline linguistic desiderata for spoken hints. We propose baselines and an approach using sequence-to-sequence Transformers to generate spoken hints from a list of questions. Using a new dataset of 6681 input questions and human written hints, we evaluated the models with automatic metrics and human evaluation. Results show that a naive approach of concatenating suggested questions creates poor voice hints. Our approach, which applies a linguistically-motivated pretraining task was strongly preferred by humans for producing the most natural hints.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
How Users React to Proactive Voice Assistant Behavior While Driving
Nowadays Personal Assistants (PAs) are available in multiple environments and become increasingly popular to use via voice. Therefore, we aim to provide proactive PA suggestions to car drivers via speech. These suggestio…
Would You Like to Hear the News? Investigating Voice-BasedSuggestions for Conversational News Recommendation
One of the key benefits of voice-based personal assistants is the potential to proactively recommend relevant and interesting information. One of the most valuable sources of such information is the News. However, in ord…
News RecommendationOpen-Ended Question AnsweringEnhanced Voice Post Processing Using Voice Decoder Guidance Indicators
Voice enhancement and voice coding are imperative and important functions in a voice-communication system. However, both functions are commonly treated independently, even though both utilize similar features of the unde…
DecoderVoiceBBQ: Investigating Effect of Content and Acoustics in Social Bias of Spoken Language Model
We introduce VoiceBBQ, a spoken extension of the BBQ (Bias Benchmark for Question Answering) - a dataset that measures social bias by presenting ambiguous or disambiguated contexts followed by questions that may elicit s…
Question AnsweringA Crowdsourcing Smartphone Application for Swiss German: Putting Language Documentation in the Hands of the Users
This contribution describes an on-going projects a smartphone application called Voice {\~A}pp, which is a follow-up of a previous application called Dial{\"a}kt {\~A}pp. The main purpose of both apps is to identify the …
speech-recognitionSpeech Recognition