KuralHubStar

KuralHubDatasetsPolish

Polish speech emotion recognition datasets

KuralHub lists 3 speech emotion recognition datasets for Polish, 1 of them openly available. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. Polish is also part of the benchmark. The best of 11 models reached 87.0% test accuracy (whisper-large).

Language family
Indo-European (Slavic)
ISO code
pl
Spoken mainly in
Poland
Datasets listed
3
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
Cichosz and Slot (2005)Audio240 utterances8ActedOn request
Sapinski et al. (2019)Audio-Visual560 per modality16StudioOn request
nEMOAudio44819StudioOpenCC BY-NC-SA 4.0

Benchmark results

Polish is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 11 runs the mean test accuracy was 56.6% (median 66.0%). The best run reached 87.0% with whisper-large. Compare with other languages.

nEMO (run ID nEMO). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960HuBERT0.770.790.790.79logs
hubert-large-ls960-ftHuBERT0.400.390.370.37logs
wav2vec2-basewav2vec 2.00.670.690.680.68logs
wav2vec2-large-960hwav2vec 2.00.240.240.160.16logs
wav2vec2-large-lv60wav2vec 2.00.230.220.150.15logs
wav2vec2-xls-r-300mwav2vec 2.00.360.370.360.36logs
wav2vec2-xls-r-1bwav2vec 2.00.430.410.400.40logs
wavlm-base-plusWavLM0.730.740.730.74logs
wavlm-largeWavLM0.660.660.670.67logs
whisper-smallWhisper0.850.850.850.85logs
whisper-largebestWhisper0.880.870.870.87logs

Cichosz and Slot (2005)

Polish Emotional Database

Type
Audio
Emotion labels
Neutral, Joy, Anger, Sadness, Fear, Boredom
Size
240 utterances recorded by 8 speakers (4 female, 4 male)
Speakers
8
Recording
Acted
Access
On request
Licence
Not stated
File format
.wav
Paper
Low-dimensional feature space derivation for emotion recognition
Contact
Jaroslaw Cichosz

The Polish Emotional Database consists of emotionally expressive speech recordings in Polish. It contains utterances spoken by professional actors who were instructed to express specific emotions. The database was created for research on emotion recognition systems and feature space derivation for affective speech processing. Each utterance was recorded to represent one of six emotional states: neutral, joy, anger, sadness, fear, and boredom.

Note: The dataset is not publicly available. You may need to contact the authors for access.

Citation

@inproceedings{cichosz2005low,
  title={Low-dimensional feature space derivation for emotion recognition},
  author={Cichosz, Jaroslaw and Slot, Krzysztof},
  booktitle={Interspeech},
  volume={5},
  pages={477--480},
  year={2005}
}

Source: datasets/Polish/Cichosz_and_Slot_2005.md · Suggest an edit

Sapinski et al. (2019)

Type
Audio-Visual
Emotion labels
Happy, Sad, Angry, Disgust, Fear, Surprise
Size
16 professional actors, 8 males, 8 females, 560 samples per modality (face, speech and gestures)
Speakers
16
Recording
Studio
Access
On request
Licence
Not stated
Paper
Multimodal database of emotional speech, video and gestures
Contact
mail

The Polish Multimodal Database of Emotional Speech, Video and Gestures is a comprehensive collection of emotional expressions in three modalities: facial expressions, body movements/gestures, and speech. Created by Sapinski et al. (2019), this dataset features recordings of 16 professional actors (8 males and 8 females, aged 25-64) from Teatr Nowy performing various emotional expressions.

The data was collected in a controlled environment - a quiet, well-lit theater rehearsal room with a green background. For facial expression recording, medium shots were used to keep the actor's face in frame while allowing for natural movement during emotional expressions. For body movement capture using Kinect, the recording frame included the entire body down to the legs.

This multimodal approach allows researchers to study emotional expressions across different communication channels simultaneously, making it a valuable resource for multimodal emotion recognition research, affective computing, and human-computer interaction studies focused on the Polish language.

Citation

@inproceedings{sapinski2019multimodal,
  title={Multimodal database of emotional speech, video and gestures},
  author={Sapi{\'n}ski, Tomasz and Kami{\'n}ska, Dorota and Pelikant, Adam and Ozcinar, Cagri and Avots, Egils and Anbarjafari, Gholamreza},
  booktitle={Pattern Recognition and Information Forensics: ICPR 2018 International Workshops, CVAUI, IWCF, and MIPPSNA, Beijing, China, August 20-24, 2018, Revised Selected Papers 24},
  pages={153--163},
  year={2019},
  organization={Springer}
}

Source: datasets/Polish/Sapinski_et_al_2019.md · Suggest an edit

nEMO

Type
Audio
Emotion labels
Anger, Fear, Happiness, Sadness, Surprise, Neutral
Size
Over 3 hours, 9 actors, 4481 samples, average length of 2.47s
Speakers
9
Recording
Studio
Access
Open
Licence
CC BY-NC-SA 4.0
File format
.wav
Website
nEMO Dataset Repository
Paper
nEMO: Dataset of Emotional Speech in Polish
Download
GitHub Repository, HuggingFace

The nEMO dataset is a Polish speech emotion corpus designed for Speech Emotion Recognition (SER) research. The corpus contains over 3 hours of emotional speech recordings performed by 9 professional actors. The dataset covers six basic emotions: anger, fear, happiness, sadness, surprise, and neutral.

The recordings are high-quality audio files suitable for developing and testing emotion recognition algorithms. The dataset was created by a Polish research team and has been made available for research purposes under a Creative Commons license.

Note: Use according to CC BY-NC-SA 4.0 license terms.

Used in the KuralHub benchmark (run ID nEMO). See the results above.

Citation

@inproceedings{christop-2024-nemo-dataset,
    title = "n{EMO}: Dataset of Emotional Speech in {P}olish",
    author = "Christop, Iwona",
    editor = "Calzolari, Nicoletta  and
      Kan, Min-Yen  and
      Hoste, Veronique  and
      Lenci, Alessandro  and
      Sakti, Sakriani  and
      Xue, Nianwen",
    booktitle = "Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)",
    month = may,
    year = "2024",
    address = "Torino, Italia",
    publisher = "ELRA and ICCL",
    url = "https://aclanthology.org/2024.lrec-main.1059",
    pages = "12111--12116",
    abstract = "Speech emotion recognition has become increasingly important in recent years due to its potential applications in healthcare, customer service, and personalization of dialogue systems. However, a major issue in this field is the lack of datasets that adequately represent basic emotional states across various language families. As datasets covering Slavic languages are rare, there is a need to address this research gap. This paper presents the development of nEMO, a novel corpus of emotional speech in Polish. The dataset comprises over 3 hours of samples recorded with the participation of nine actors portraying six emotional states: anger, fear, happiness, sadness, surprise, and a neutral state. The text material used was carefully selected to represent the phonetics of the Polish language adequately. The corpus is freely available under the terms of a Creative Commons license (CC BY-NC-SA 4.0).",
}

Source: datasets/Polish/nEMO.md · Suggest an edit


Know another Polish speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/Polish/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.