KuralHubStar

KuralHubDatasetsBengali

Bengali speech emotion recognition datasets

KuralHub lists 4 speech emotion recognition datasets for Bengali, 4 of them openly available. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. Bengali is also part of the benchmark. The best of 11 models reached 89.0% test accuracy (whisper-large).

Language family
Indo-European (Indo-Aryan)
ISO code
bn
Spoken mainly in
Bangladesh, and India
Datasets listed
4
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
BANSpEmoAudio79222ActedOpenCC-BY 4.0
BanglaSERAudio146734ActedOpenCC-BY 4.0
KBESAudio90035ActedOpenCC-BY 4.0
SUBESCOAudio700020ActedOpenCC-BY 4.0

Benchmark results

Bengali is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 22 runs the mean test accuracy was 46.0% (median 39.0%). The best run reached 89.0% with whisper-large. Compare with other languages.

BANSpEmo (run ID BANSpEmo). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960bestHuBERT0.520.410.420.41logs
hubert-large-ls960-ftHuBERT0.240.230.220.22logs
wav2vec2-basewav2vec 2.00.410.320.310.30logs
wav2vec2-large-960hwav2vec 2.00.230.230.230.24logs
wav2vec2-large-lv60wav2vec 2.00.260.250.250.26logs
wav2vec2-xls-r-300mwav2vec 2.00.250.230.230.23logs
wav2vec2-xls-r-1bwav2vec 2.00.190.260.250.25logs
wavlm-base-plusWavLM0.490.350.360.35logs
wavlm-largeWavLM0.410.400.380.39logs
whisper-smallWhisper0.300.380.340.37logs
whisper-largeWhisper0.350.400.360.39logs
SUBESCO (run ID SUBESCO). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960HuBERT0.770.780.780.78logs
hubert-large-ls960-ftHuBERT0.560.540.530.52logs
wav2vec2-basewav2vec 2.00.690.680.680.68logs
wav2vec2-large-960hwav2vec 2.00.240.240.180.17logs
wav2vec2-large-lv60wav2vec 2.00.280.270.230.22logs
wav2vec2-xls-r-300mwav2vec 2.00.510.480.470.47logs
wav2vec2-xls-r-1bwav2vec 2.00.360.380.330.34logs
wavlm-base-plusWavLM0.760.780.770.77logs
wavlm-largeWavLM0.760.740.740.74logs
whisper-smallWhisper0.880.890.880.89logs
whisper-largebestWhisper0.880.890.890.89logs

BANSpEmo

Type
Audio
Emotion labels
Disgust, Happy, Sad, Surprised, Anger, Fear
Size
samples - 792, speakers - 22
Speakers
22
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Download

BANSpEmo is the third Bangla emotional speech dataset for SER, containing 792 recordings of six basic emotions—Disgust, Happy, Sad, Surprised, Anger, and Fear. The dataset includes recordings from 22 unprofessional speakers (11 male, 11 female) using two sets of six sentences each, recorded in a realistic manner.

Used in the KuralHub benchmark (run ID BANSpEmo). See the results above.

Citation

@article{hussain2023banspemo,
  title={Banspemo: A bangla emotional speech recognition dataset},
  author={Hussain, Md Gulzar and Rahman, Mahmuda and Sultana, Babe and Shiren, Ye},
  journal={arXiv preprint arXiv:2312.14020},
  year={2023}
}

Source: datasets/Bengali/BANSpEmo.md · Suggest an edit

BanglaSER

Type
Audio
Emotion labels
Angry, Happy, Neutral, Sad, and Surprise
Size
samples - 1467, speakers - 34
Speakers
34
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Download

BanglaSER is a Bangla speech emotion recognition dataset featuring 1,467 recordings from 34 speakers (17 male, 17 female) across five emotions: angry, happy, neutral, sad, and surprise. The dataset is recorded using smartphones and laptops in real-life conditions, ensuring balanced gender distribution and compatibility with deep learning models like CNN, LSTM, and BiLSTM.

Citation

@article{das2022banglaser,
  title={BanglaSER: A speech emotion recognition dataset for the Bangla language},
  author={Das, Rakesh Kumar and Islam, Nahidul and Ahmed, Md Rayhan and Islam, Salekul and Shatabda, Swakkhar and Islam, AKM Muzahidul},
  journal={Data in Brief},
  volume={42},
  pages={108091},
  year={2022},
  publisher={Elsevier}
}

Source: datasets/Bengali/BanglaSER.md · Suggest an edit

KBES

Type
Audio
Emotion labels
Neutral, Happy (Low), Happy (High), Sad (Low), Sad (High), Angry (Low), Angry (High), Disgust (Low), Disgust (High)
Size
samples - 900, speakers - 35
Speakers
35
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Download

The KUET Bangla Emotional Speech (KBES) dataset is a Bangla speech emotion recognition (SER) dataset containing 900 speech samples from 35 actors (20 females and 15 males) across diverse age ranges. The dataset includes five emotional categories: Neutral, Happy, Sad, Angry, and Disgust. Except for Neutral, each emotion is further divided into two intensity levels: Low and High, resulting in a total of nine classes. The speech samples are sourced from Bangla Telefilms, Dramas, TV Series, and Web Series, making the dataset more natural and expressive. Each class contains 100 gender-balanced samples, ensuring data symmetry for effective emotion classification.

Citation

@article{billah2023kbes,
  title={KBES: A dataset for realistic Bangla speech emotion recognition with intensity level},
  author={Billah, Md Masum and Sarker, Md Likhon and Akhand, MAH},
  journal={Data in Brief},
  volume={51},
  pages={109741},
  year={2023},
  publisher={Elsevier}
}

Source: datasets/Bengali/KBES.md · Suggest an edit

SUBESCO

Type
Audio
Emotion labels
Anger, Disgust, Fear, Happiness, Neutral, Sadness, and Surprise
Size
samples - 7000, speakers - 20, duration - 7h 40min
Speakers
20
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Download, Download

SUBESCO is a Bangla emotional speech corpus containing 7,000 sentence-level utterances recorded by 20 professional actors (10 male, 10 female) across seven emotions: Anger, Disgust, Fear, Happiness, Neutral, Sadness, and Surprise. The dataset spans 7 hours and 40 minutes, totaling 2.03 GB. Evaluated by 50 raters, it achieved a human perception accuracy of 71%. Details on its creation and analysis are available in its PLOS ONE journal publication.

Used in the KuralHub benchmark (run ID SUBESCO). See the results above.

Citation

@article{sultana2021sust,
  title={SUST Bangla Emotional Speech Corpus (SUBESCO): An audio-only emotional speech corpus for Bangla},
  author={Sultana, Sadia and Rahman, M Shahidur and Selim, M Reza and Iqbal, M Zafar},
  journal={Plos one},
  volume={16},
  number={4},
  pages={e0250173},
  year={2021},
  publisher={Public Library of Science San Francisco, CA USA}
}

Source: datasets/Bengali/SUBESCO.md · Suggest an edit


Know another Bengali speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/Bengali/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.