KuralHubStar

KuralHubDatasetsGreek

Greek speech emotion recognition datasets

KuralHub lists 3 speech emotion recognition datasets for Greek, 2 of them openly available. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. Greek is also part of the benchmark. The best of 11 models reached 75.0% test accuracy (hubert-base-ls960).

Language family
Indo-European (Hellenic)
ISO code
el
Spoken mainly in
Greece, Cyprus
Datasets listed
3
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
AESDDAudio5005ActedOpen
GreThEAudio50090Acted (Theatrical Plays)Open
SEWAMultimodal (Audio, Video)1990398Spontaneous (natural interactions)On requestDataset-Specific - SEWA EULA

Benchmark results

Greek is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 11 runs the mean test accuracy was 46.6% (median 54.0%). The best run reached 75.0% with hubert-base-ls960. Compare with other languages.

AESDD (run ID AESDD). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960bestHuBERT0.690.750.730.74logs
hubert-large-ls960-ftHuBERT0.430.320.270.28logs
wav2vec2-basewav2vec 2.00.580.540.530.55logs
wav2vec2-large-960hwav2vec 2.00.370.320.220.24logs
wav2vec2-large-lv60wav2vec 2.00.280.250.240.24logs
wav2vec2-xls-r-300mwav2vec 2.00.380.360.280.30logs
wav2vec2-xls-r-1bwav2vec 2.00.210.260.200.20logs
wavlm-base-plusWavLM0.620.630.600.61logs
wavlm-largeWavLM0.700.570.520.53logs
whisper-smallWhisper0.600.570.560.58logs
whisper-largeWhisper0.570.560.560.57logs

AESDD

Acted Emotional Speech Dynamic Database

Type
Audio
Emotion labels
Happy, Sad, Angry, Fear, Disgust
Size
utterances - 500, speakers - 05
Speakers
5
Recording
Acted
Access
Open
Licence
Not stated
File format
.wav
Website
AESDD
Paper
Paper Link 1, Paper Link 2
Download
Download
Contact
nvryzas@auth.gr

AESDD v1.0 was created on October 2017 in the Laboratory of Electronic Media, School of Journalism and Mass Communications, Aristotle University of Thessaloniki, for the needs of Speech Emotion Recognition research of the Multidisciplinary Media & Mediated Communication Research Group (M3C, http://m3c.web.auth.gr/). It is a collection of utterances of emotional speech acted by professional actors. This version is the initial state of AESDD. The purpose of this project the continuous growth of the database through the collaborative effort of the M3C research group and theatrical teams.

Used in the KuralHub benchmark (run ID AESDD). See the results above.

Citation

@inproceedings{vryzas2018speech,
  title={Speech emotion recognition adapted to multimodal semantic repositories},
  author={Vryzas, Nikolaos and Vrysis, Lazaros and Kotsakis, Rigas and Dimoulas, Charalampos},
  booktitle={2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)},
  pages={31--35},
  year={2018},
  organization={IEEE}
}
@article{vryzas2018speech,
  title={Speech emotion recognition for performance interaction},
  author={Vryzas, Nikolaos and Kotsakis, Rigas and Liatsou, Aikaterini and Dimoulas, Charalampos A and Kalliris, George},
  journal={Journal of the Audio Engineering Society},
  volume={66},
  number={6},
  pages={457--467},
  year={2018},
  publisher={Audio Engineering Society}
}

Source: datasets/Greek/AESDD.md · Suggest an edit

GreThE

Greek Theatrical Emotion Dataset

Type
Audio
Emotion labels
emotions are characterized using Valence(Negative/Neutral/Positive) and Arousal(Weak/Neutral/Strong).
Size
500 samples, 90 speakers, 46 minutes duration
Speakers
90
Recording
Acted (Theatrical Plays)
Access
Open
Licence
Not stated
File format
.npy -> the standard binary file format in NumPy for persisting a single arbitrary NumPy array on disk
Paper
Paper Link
Download
GitHub
Contact
mail

The GreThE (Greek Theatrical Emotion Dataset) is a collection of 500 audio samples from 90 unique speakers across 23 Greek theatrical plays. The dataset is annotated for valence(negative/neutral/positive) and arousal (weak/neutral/strong). It is designed for Speech Emotion Recognition (SER) tasks, particularly in the context of theatrical performances. The dataset includes Mel-spectrograms and segment feature vectors for each audio sample, making it suitable for machine learning and deep learning experiments.

Citation

@article{moutti2022dataset,
  title={A Dataset for Speech Emotion Recognition in Greek Theatrical Plays},
  author={Moutti, Maria and Eleftheriou, Sofia and Koromilas, Panagiotis and Giannakopoulos, Theodoros},
  journal={arXiv preprint arXiv:2203.15568},
  year={2022}
}

Source: datasets/Greek/GreThE.md · Suggest an edit

SEWA

Type
Multimodal (Audio, Video)
Emotion labels
emotions are characterized using valence and arousal.
Size
duration: 44 hours, samples: 1990, speakers:398
Speakers
398
Recording
Spontaneous (natural interactions)
Access
On request
Licence
Dataset-Specific - SEWA EULA
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Request Access
Contact
mail

The SEWA dataset is a multimodal dataset designed for emotion recognition and analysis. It includes audio and video data collected from participants during natural interactions. The dataset aims to study emotional states in real-world scenarios, focusing on cross-cultural differences and spontaneous emotional expressions. Data was collected using wearable devices and audio-visual recordings, making it a rich resource for affective computing research.

Citation

@article{kossaifi2019sewa,
  title={Sewa db: A rich database for audio-visual emotion and sentiment research in the wild},
  author={Kossaifi, Jean and Walecki, Robert and Panagakis, Yannis and Shen, Jie and Schmitt, Maximilian and Ringeval, Fabien and Han, Jing and Pandit, Vedhas and Toisoul, Antoine and Schuller, Bj{\"o}rn and others},
  journal={IEEE transactions on pattern analysis and machine intelligence},
  volume={43},
  number={3},
  pages={1022--1040},
  year={2019},
  publisher={IEEE}
}

Source: datasets/Greek/SEWA.md · Suggest an edit


Know another Greek speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/Greek/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.