KuralHubStar

KuralHubDatasetsFrench

French speech emotion recognition datasets

KuralHub lists 2 speech emotion recognition datasets for French, 2 of them openly available. Each entry below gives the emotion labels, size, recording setup, licence, where to get it and how to cite it. French is also part of the benchmark. The best of 11 models reached 70.0% test accuracy (wavlm-large).

Language family
Indo-European (Romance)
ISO code
fr
Spoken mainly in
France
Datasets listed
2
In benchmark
Yes

Datasets at a glance

DatasetTypeSamplesSpeakersRecordingAccessLicence
CaFEAudio93612ActedOpenCC-BY 4.0
OréauFRAudio502ActedOpenCC-BY 4.0

Benchmark results

French is one of the 29 languages in the KuralHub benchmark. Each of the 11 frozen speech models was trained with a small classification head on the shared emotions and scored on a held-out test split. Over all 11 runs the mean test accuracy was 42.1% (median 38.0%). The best run reached 70.0% with wavlm-large. Compare with other languages.

CaFE (run ID CaFE). Scores on the test split, best run highlighted.
ModelFamilyVal acc.Test acc.Macro-F1Weighted-F1Logs
hubert-base-ls960HuBERT0.640.600.600.60logs
hubert-large-ls960-ftHuBERT0.330.330.320.33logs
wav2vec2-basewav2vec 2.00.460.380.360.35logs
wav2vec2-large-960hwav2vec 2.00.260.240.220.21logs
wav2vec2-large-lv60wav2vec 2.00.200.210.170.15logs
wav2vec2-xls-r-300mwav2vec 2.00.290.250.210.19logs
wav2vec2-xls-r-1bwav2vec 2.00.260.250.190.18logs
wavlm-base-plusWavLM0.530.530.520.53logs
wavlm-largebestWavLM0.720.700.690.70logs
whisper-smallWhisper0.550.610.600.60logs
whisper-largeWhisper0.490.530.520.53logs

CaFE

A Canadian French Emotional Speech Dataset

Type
Audio
Emotion labels
Sadness, Happiness, Anger, Fear, Disgust, Surprise, and Neutral
Size
samples - 936, speakers - 12
Speakers
12
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Paper
Paper Link
Download
Download

The Canadian French Emotional (CaFE) speech dataset focuses on emotional speech in Canadian French, featuring six sentences spoken by 12 actors (6 male, 6 female) across six basic emotions plus neutral speech. Each emotion is expressed in two intensity levels (mild and strong). The dataset is available in high-resolution (192 kHz, 24-bit) and a downsampled version (48 kHz, 16-bit) under a Creative Commons (CC BY-NC-SA 4.0) license.

Used in the KuralHub benchmark (run ID CaFE). See the results above.

Citation

@inproceedings{gournay2018canadian,
  title={A canadian french emotional speech dataset},
  author={Gournay, Philippe and Lahaie, Olivier and Lefebvre, Roch},
  booktitle={Proceedings of the 9th ACM multimedia systems conference},
  pages={399--402},
  year={2018}
}

Source: datasets/French/CaFE.md · Suggest an edit

OréauFR

French Emotional Speech Database

Type
Audio
Emotion labels
Anger, Disgust, Fear, Happiness, Sadness, Surprise, Neutral
Size
samples - 502
Recording
Acted
Access
Open
Licence
CC-BY 4.0
File format
.wav
Website
Dataset Homepage
Download
Download

The Oréau French emotional speech database was recorded in a quiet environment to support research on emotional speech and speech synthesis. It includes 79 classroom-relevant utterances covering 7 emotions, spoken by 32 non-professional speakers. Two versions exist: the first with 502 utterances, and the second with 434 utterances retained after a perception test confirmed 90% accuracy in emotion recognition and naturalness.

Citation

@misc{kerkeni2020french,
  title={French emotional speech database-or{\'e}au},
  author={KERKENI, Leila and CLEDER, Catherine and Youssef, SER-RESTOU and RAOOF, Kosai},
  year={2020},
  publisher={Dec}
}

Source: datasets/French/OréauFR.md · Suggest an edit


Know another French speech emotion dataset, or a newer version of one listed here? Suggest it or open a pull request.

This page is generated from datasets/French/ in the KuralHub repository. If you use a dataset, cite its authors. If KuralHub helped you find it, please also cite the KuralHub paper.