KuralHubStar

KuralHubDatasetsKazakh

Kazakh speech emotion recognition datasets

KuralHub lists 2 speech emotion recognition datasets for Kazakh. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. Kazakh is also part of the benchmark. The best of 11 models reached 65.0% test accuracy (whisper-small).

Language family
Turkic (Kipchak)
ISO code
kk
Spoken mainly in
Kazakhstan, Russia, China, Uzbekistan
Datasets listed
2
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
KazEmoTTSAudio + Text54,7603StudioOn requestCC-BY 4.0
Kazakh-Russian Emotion CorpusAudio16160101ActedOn request

Benchmark results

Kazakh is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 11 runs the mean test accuracy was 44.0% (median 51.0%). The best run reached 65.0% with whisper-small. Compare with other languages.

KazEmoTTS (run ID KazakhEmotionalTTS). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960HuBERT0.540.510.500.50logs
hubert-large-ls960-ftHuBERT0.280.290.250.25logs
wav2vec2-basewav2vec 2.00.520.530.520.52logs
wav2vec2-large-960hwav2vec 2.00.220.240.200.20logs
wav2vec2-large-lv60wav2vec 2.00.210.210.140.14logs
wav2vec2-xls-r-300mwav2vec 2.00.370.350.340.33logs
wav2vec2-xls-r-1bwav2vec 2.00.300.320.300.30logs
wavlm-base-plusWavLM0.520.510.490.50logs
wavlm-largeWavLM0.580.580.570.56logs
whisper-smallbestWhisper0.700.650.640.65logs
whisper-largeWhisper0.700.650.630.64logs

KazEmoTTS

Kazakh Emotional Text-to-Speech Synthesis

Type
Audio + Text
Emotion labels
Happy, Sad, Angry, Neutral, Scared, and Surprised
Size
Number of samples: 54,760, speakers: 3(2M,1F), duration: 74.85h
Speakers
3
Recording
Studio
Access
On request
Licence
CC-BY 4.0
File format
.wav
Paper
Paper Link
Download
Request

KazEmoTTS is a specialized dataset designed for Kazakh emotional text-to-speech (TTS) synthesis. It comprises 54,760 audio-text pairs totaling 74.85 hours of speech, recorded by three narrators (one female and two male) covering six emotions: "neutral," "angry," "happy," "sad," "scared," and "surprised" 148. The dataset is structured to include diverse vocal expressions, with the female narrator contributing 34.23 hours and the male narrators 40.62 hours combined

Used in the KuralHub benchmark (run ID KazakhEmotionalTTS). See the results above.

Citation

@article{abilbekov2024kazemotts,
  title={KazEmoTTS: A Dataset for Kazakh Emotional Text-to-Speech Synthesis},
  author={Abilbekov, Adal and Mussakhojayeva, Saida and Yeshpanov, Rustem and Varol, Huseyin Atakan},
  journal={arXiv preprint arXiv:2404.01033},
  year={2024}
}

Source: datasets/Kazakh/KazEmoTTS.md · Suggest an edit

Kazakh-Russian Emotion Corpus

Type
Audio
Emotion labels
Happiness, Sadness, Anger, Neutral, Boredom, Disgust, Fear
Size
Number of samples: 16160, speakers: 101, duration: 14+ hours
Speakers
101
Recording
Acted
Access
On request
Licence
Not stated
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Contact
nazerke.sultanova@sdu.edu.kz

The Kazakh-Russian Emotion Corpus is a multilingual dataset designed fmor speech emotion recognition (SER) in both Kazakh and Russian languages. It contains over 16,000 audio recordings labeled with 8 emotion categories, collected from 101 participants to ensure diversity in vocal expressions. The dataset is divided into training (80%), validation (10%), and testing (10%) sets, facilitating robust model evaluation and development for SER tasks.

Citation

@article{kozhakhmet2020speech,
  title={Speech emotion recognition for Kazakh and Russian languages},
  author={Kozhakhmet, Kanat and Zhumaliyeva, Rakhima and Shoinbek, A and Sultanova, Nazerke},
  journal={Appl. Math. Inf. Sci},
  volume={14},
  pages={65--68},
  year={2020}
}

Source: datasets/Kazakh/Kazakh-Russian-Emotion-Corpus.md · Suggest an edit


Know another Kazakh speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/Kazakh/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.