KuralHubStar

KuralHubDatasetsHindi

Hindi speech emotion recognition datasets

KuralHub lists 3 speech emotion recognition datasets for Hindi, 1 of them openly available. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. Hindi is also part of the benchmark. The best of 11 models reached 71.0% test accuracy (whisper-small).

Language family
Indo-European (Indo-Aryan)
ISO code
hi
Spoken mainly in
India
Datasets listed
3
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
Bansal And Dev et al.Audio604828ActedOn request
IITKGP-SEHSCAudio1200010ActedOn request
VishalBAudio3200ActedOpen

Benchmark results

Hindi is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 11 runs the mean test accuracy was 48.8% (median 61.0%). The best run reached 71.0% with whisper-small. Compare with other languages.

VishalB (run ID Hindi-Dataset). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960HuBERT0.720.700.700.71logs
hubert-large-ls960-ftHuBERT0.330.310.260.25logs
wav2vec2-basewav2vec 2.00.620.610.600.61logs
wav2vec2-large-960hwav2vec 2.00.220.230.130.12logs
wav2vec2-large-lv60wav2vec 2.00.200.200.120.11logs
wav2vec2-xls-r-300mwav2vec 2.00.220.220.140.13logs
wav2vec2-xls-r-1bwav2vec 2.00.350.350.340.34logs
wavlm-base-plusWavLM0.700.650.640.65logs
wavlm-largeWavLM0.690.700.700.69logs
whisper-smallbestWhisper0.680.710.700.70logs
whisper-largeWhisper0.670.690.680.69logs

Bansal And Dev et al.

Type
Audio
Size
samples - 6048, speakers - 28
Speakers
28
Recording
Acted
Access
On request
Licence
Not stated
File format
.wav
Paper
Paper Link
Contact
amita.dev24@gmail.com

The Emotional Hindi Speech Corpus developed at IPEC includes recordings from 28 speakers (14 male, 14 female) aged 20–30, expressing six emotions across 12 sentences. It is designed for applications in speech recognition, synthesis, speaker identification, and emotion analysis. The dataset also examines the impact of emotions on F0 contour and spectrum.

Citation

@INPROCEEDINGS{6709867,
  author={Bansal, Sweeta and Dev, Amita},
  booktitle={2013 International Conference Oriental COCOSDA held jointly with 2013 Conference on Asian Spoken Language Research and Evaluation (O-COCOSDA/CASLRE)}, 
  title={Emotional hindi speech database}, 
  year={2013},
  volume={},
  number={},
  pages={1-4},
  keywords={Speech;Databases;Speech recognition;Mobile communication;Spectrogram;Educational institutions;Time-frequency analysis;Speech corpus;Emotional speech;F0Contour},
  doi={10.1109/ICSDA.2013.6709867}}

Source: datasets/Hindi/BansalAndDev.md · Suggest an edit

IITKGP-SEHSC

Type
Audio
Emotion labels
Anger, Disgust, Fear, Happy, Neutral, Sad, Sarcastic and Surprise
Size
samples - 12000, speakers - 10, duration - 9hour
Speakers
10
Recording
Acted
Access
On request
Licence
Not stated
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Request
Contact
ksrao1969@gmail.com

The dataset created by Koolagudi et al. in 2011 is an emotional speech corpus recorded in Hindi, featuring 10 speakers (5 male and 5 female) within the age ranges of 28–48 years for males and 20–30 years for females. Each speaker expressed 8 different emotions by speaking 15 sentences in a single session, with a total of 10 sessions conducted for corpus collection. The dataset comprises 12,000 utterances, amounting to 9 hours of recordings. The number of syllables per sentence ranges from 9 to 17, while the word count varies between 4 and 7. This dataset is valuable for emotional speech analysis and natural language processing applications.

Note: Fill the requested form and send it.

Citation

@INPROCEEDINGS{5738540,
  author={Koolagudi, Shashidhar G. and Reddy, Ramu and Yadav, Jainath and Rao, K. Sreenivasa},
  booktitle={2011 International Conference on Devices and Communications (ICDeCom)}, 
  title={IITKGP-SEHSC : Hindi Speech Corpus for Emotion Analysis}, 
  year={2011},
  volume={},
  number={},
  pages={1-5},
  keywords={Speech;Databases;Emotion recognition;Support vector machines;Feature extraction;Speech recognition;Computational modeling},
  doi={10.1109/ICDECOM.2011.5738540}}

Source: datasets/Hindi/IITKGP-SEHSC.md · Suggest an edit

VishalB

Vishal B. (2021). Speech Emotion Recognition (Hindi) Dataset. Kaggle.

Type
Audio
Emotion labels
Anger, Disgust, Fear, Happy, Neutral, Sad, Sarcastic and Surprise
Size
samples - 3200
Recording
Acted
Access
Open
Licence
Not stated
File format
.wav
Website
Dataset Homepage
Download
Download

This is a dataset found on Kaggle for Hindi Speech Emotion with 3,200 samples.

Used in the KuralHub benchmark (run ID Hindi-Dataset). See the results above.

Citation

@misc{vishal2021speech,
  author       = {Vishal B.},
  title        = {Speech Emotion Recognition (Hindi)},
  year         = {2021},
  publisher    = {Kaggle},
  url          = {https://www.kaggle.com/datasets/vishlb/speech-emotion-recognition-hindi}
}

Source: datasets/Hindi/VishalB.md · Suggest an edit


Know another Hindi speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/Hindi/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.