📝 Original Paper Info
- Title: Indian EmoSpeech Command Dataset A dataset for emotion based speech recognition in the wild
- ArXiv ID: 1910.13801
- Date: 2019-10-31
- Authors: Subham Banga, Ujjwal Upadhyay, Piyush Agarwal, Aniket Sharma and Prerana Mukherjee
📝 Abstract
Speech emotion analysis is an important task which further enables several application use cases. The non-verbal sounds within speech utterances also play a pivotal role in emotion analysis in speech. Due to the widespread use of smartphones, it becomes viable to analyze speech commands captured using microphones for emotion understanding by utilizing on-device machine learning models. The non-verbal information includes the environment background sounds describing the type of surroundings, current situation and activities being performed. In this work, we consider both verbal (speech commands) and non-verbal sounds (background noises) within an utterance for emotion analysis in real-life scenarios. We create an indigenous dataset for this task namely "Indian EmoSpeech Command Dataset". It contains keywords with diverse emotions and background sounds, presented to explore new challenges in audio analysis. We exhaustively compare with various baseline models for emotion analysis on speech commands on several performance metrics. We demonstrate that we achieve a significant average gain of 3.3% in top-one score over a subset of speech command dataset for keyword spotting.
💡 Summary & Analysis
The authors are from two different institutions located in India: Bharati Vidyapeeth’s College of Engineering in Paschim Vihar, New Delhi and the Indian Institute of Information Technology in Sri City, Andhra Pradesh. The paper appears to be a collaborative work among four researchers who have contributed equally, indicating a joint effort across departments within the same college as well as between different institutions.
📄 Full Paper Content (ArXiv Source)
[^1]: S. Banga and P. Agarwal are with the Department of Information
Technology, Bharati Vidyapeeth’s College of Engineering, Paschim
Vihar, New Delhi, 110063 India. (e-mail: subhambanga26@gmail.com and
me@ipiyush.com)
U. Upadhyay and A. Sharma are with the Department of Computer
Science, Bharati Vidyapeeth’s College of Engineering, Paschim Vihar,
New Delhi, 110063 India. (e-mail: ujjwalupadhyay8@gmail.com and
aniket965.as@gmail.com)
P. Mukherjee is with the Department of Computer Science, Indian
Institute of Information Technology, Sri City, Andhra Pradesh,
517646 India. (e-mail: prerana.m@iiits.in)
S. Banga, P. Agarwal, U. Upadhyay and A. Sharma contributed equally
& their names are in random order.
A Note of Gratitude
The copyright of this content belongs to the respective researchers. We deeply appreciate their hard work and contribution to the advancement of human civilization.