Emotionless: Privacy-Preserving Speech Analysis for Voice Assistants
Voice-enabled interactions provide more human-like experiences in many popular IoT systems. Cloud-based speech analysis services extract useful information from voice input using speech recognition techniques. The voice signal is a rich resource that discloses several possible states of a speaker, such as emotional state, confidence and stress levels, physical condition, age, gender, and personal traits. Service providers can build a very accurate profile of a user's demographic category, personal preferences, and may compromise privacy. To address this problem, a privacy-preserving intermediate layer between users and cloud services is proposed to sanitize the voice input. It aims to maintain utility while preserving user privacy. It achieves this by collecting real time speech data and analyzes the signal to ensure privacy protection prior to sharing of this data with services providers. Precisely, the sensitive representations are extracted from the raw signal by using transformation functions and then wrapped it via voice conversion technology. Experimental evaluation based on emotion recognition to assess the efficacy of the proposed method shows that identification of sensitive emotional state of the speaker is reduced by ~96 %.
Code (1)
Tasks
Emotion RecognitionPrivacy Preservingspeech-recognitionSpeech RecognitionVoice ConversionSimilar Papers 제목 키워드 기반
An Attribute-Aligned Strategy for Learning Speech Representation
Advancement in speech technology has brought convenience to our life. However, the concern is on the rise as speech signal contains multiple personal attributes, which would lead to either sensitive information leakage o…
AttributeEmotion RecognitionPrivacy PreservingSpeaker Verification+1Configurable Privacy-Preserving Automatic Speech Recognition
Voice assistive technologies have given rise to far-reaching privacy and security concerns. In this paper we investigate whether modular automatic speech recognition (ASR) can improve privacy in voice assistive systems b…
Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Privacy Preservingspeech-recognition+2Hiding speaker's sex in speech using zero-evidence speaker representation in an analysis/synthesis pipeline
The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to transform the speaker embedding and the pitch…
Voice ConversionGenerating gender-ambiguous voices for privacy-preserving speech recognition
Our voice encodes a uniquely identifiable pattern which can be used to infer private attributes, such as gender or identity, that an individual might wish not to reveal when using a speech recognition service. To prevent…
AttributeGenerative Adversarial NetworkPrivacy PreservingRepresentation Learning+2Evaluation of Speaker Anonymization on Emotional Speech
Speech data carries a range of personal information, such as the speaker's identity and emotional state. These attributes can be used for malicious purposes. With the development of virtual assistants, a new generation o…
Automatic Speech RecognitionEmotion RecognitionSpeaker anonymizationspeech-recognition+2