Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/SuperKogito/SER-datasets
A collection of datasets for the purpose of emotion recognition/detection in speech.
https://github.com/SuperKogito/SER-datasets
audio audio-datasets datasets emotions emotions-recognition multimodal-emotion-recognition speech speech-emotion-recognition
Last synced: about 2 months ago
JSON representation
A collection of datasets for the purpose of emotion recognition/detection in speech.
- Host: GitHub
- URL: https://github.com/SuperKogito/SER-datasets
- Owner: SuperKogito
- License: mit
- Created: 2019-11-20T10:10:59.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2024-06-23T18:16:35.000Z (3 months ago)
- Last Synced: 2024-06-24T05:35:19.455Z (3 months ago)
- Topics: audio, audio-datasets, datasets, emotions, emotions-recognition, multimodal-emotion-recognition, speech, speech-emotion-recognition
- Language: HTML
- Homepage: https://superkogito.github.io/SER-datasets
- Size: 3.86 MB
- Stars: 259
- Watchers: 12
- Forks: 35
- Open Issues: 18
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project
- awesome-ai-list-guide - SER-datasets
README
***Speech Emotion Recognition (SER) Datasets:*** *A collection of datasets (count=75) for the purpose of emotion recognition/detection in speech.
The table is chronologically ordered and includes a description of the content of each dataset along with the emotions included.
The table can be browsed, sorted and searched under https://superkogito.github.io/SER-datasets/*
| Dataset | Year | Content | Emotions | Format | Size | Language | Paper | Access | License |
|:--------------------------------------------------------------------------------------------------------------------------------------------------|:----------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------|:---------------------|:------------------------------------------------------------------|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:--------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------|
| [nEmo](https://github.com/amu-cai/nEMO) | 2024 | 3 hours of samples recorded with the participation of nine actors. | 6 emotions: anger, fear, happiness, sadness, surprised, and neutral. | Audio | 0.434 GB | Polish | [nEMO: Dataset of Emotional Speech in Polish](https://arxiv.org/abs/2404.06292) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [EMOVOME](https://zenodo.org/records/10694370) | 2024 | 999 spontaneous voice messages from 100 Spanish speakers, collected from real conversations on a messaging app. | Valence & arrousal dimensions and 7 emotions: happiness, disgust, anger, surprise, fear, sadness, and neutral. | Audio | -- | Spanish | [EMOVOME Database: Advancing Emotion Recognition in Speech Beyond Staged Scenarios](https://arxiv.org/abs/2403.02167) | Partially open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [EMNS](http://www.openslr.org/136/) | 2023 | 1206 high quality labeled utterances by one female speaker (2-3 hours). | Anger, excitement, disgust, happiness, surprise, sadness, and neutral (plus sarcasm) | Audio | 0.042 GB | English (British) | [EMNS /Imz/ Corpus: An emotive single-speaker dataset for narrative storytelling in games, television and graphic novels](https://arxiv.org/abs/2305.13137) | Open | [Apache 2.0](https://apache.org/licenses/LICENSE-2.0) |
| [CAVES](https://rds.westernsydney.edu.au/Institutes/MARCS/2024/Christopher_Davis/) | 2023 | Full hd visual recordings of 10 native cantonese speakers uttering 50 sentences. | Anger, happiness, sadness, surprise, fear, disgust and neutral | Audio | 47 GB | Chinese (cantonese) | [A Cantonese Audio-Visual Emotional Speech (CAVES) dataset](https://link.springer.com/article/10.3758/s13428-023-02270-7) | Open | Available for research purposes only |
| [BANSpEmo](https://data.mendeley.com/datasets/rdwn4bs5ky/2) | 2023 | 792 utterance recordings from 22 unprofessional speakers (11 males and 11 females) of six basic emotional reactions of two sets of sentences. | angry, disgusted, happy, surprised, sad, fear | Audio | 0.555 GB | Bangla | [BANSpEmo: A Bangla Emotional Speech Recognition Dataset](https://arxiv.org/abs/2312.14020) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [KBES](https://data.mendeley.com/datasets/vsn37ps3rx/4) | 2023 | 900 audio signals from 35 actors (20 females and 15 males). Each emotion is represented with two intensity levels (low & high) | angry, disgusted, happy, neutral, sad | Audio | 0.337 GB | Bangla | [KBES: A dataset for realistic Bangla speech emotion recognition with intensity level](https://www.sciencedirect.com/science/article/pii/S2352340923008107) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Hi, KIA](https://zenodo.org/records/7091465) | 2022 | A shared short Wakeup Word database focusing on perceived emotion in speech The dataset contains 488 Wakeup Word speech | angry, happy, sad, neutral | Audio | 0.75 GB | Korean | [Hi, KIA: A Speech Emotion Recognition Dataset for Wake-Up Words](https://arxiv.org/abs/2211.03371) | Open | [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/) |
| [Emozionalmente](https://zenodo.org/records/6569824) | 2022 | 6902 labeled samples acted out by 431 amateur actors while verbalizing 18 different sentences | anger, disgust, fear, joy, sadness, surprise, neutral | Audio | 0.581 GB | Italian | -- | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [BanglaSER](https://data.mendeley.com/datasets/t9h6p943xy/5) | 2022 | 1467 Bangla speech-audio recordings by 34 non-professional participating actors (17 male and 17 female) from diverse age groups between 19 and 47 years. | angry, happy, neutral, sad, surprise | Audio | 0.425 GB | Bangla | [BanglaSER: A speech emotion recognition dataset for the Bangla language](https://www.sciencedirect.com/science/article/pii/S235234092200302X) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [B-SER](https://data.mendeley.com/datasets/t9h6p943xy/3) | 2022 | 1224 speech-audio recordings by 34 non-professional participating actors (17 male and 17 female) from diverse age groups between 19 and 47 years. | angry, happy, sad and surprise | Audio | 0.363 GB | Bangla | -- | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Kannada](https://zenodo.org/records/6345107) | 2022 | 468 audio samples, six different sentences, pronounced by thirteen people (four male and nine female), in five basic emotions plus one neutral emotion | Anger, Sadness, Surprise, Happiness, Fear, Neutral | Audio | 0.1661 GB | Kannada | -- | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Quechua-SER](https://figshare.com/articles/media/Quechua_Collao_for_Speech_Emotion_Recognition/20292516) | 2022 | 12420 audio recordings (~15 hours) and their transcriptions by 7 native speakers. | Emotional labels using dimensions: valence, arousal, and dominance. | Audio | 3.53 GB | Quechua Collao | [A speech corpus of Quechua Collao for automatic dimensional emotion recognition](https://www.nature.com/articles/s41597-022-01855-9) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [MESD](https://data.mendeley.com/datasets/cy34mh68j9/5) | 2022 | 864 audio files of single-word emotional utterances with Mexican cultural shaping. | 6 emotions provides single-word utterances for anger, disgust, fear, happiness, neutral, and sadness. | Audio | 0.097 GB | Spanish (Mexican) | [The Mexican Emotional Speech Database (MESD): elaboration and assessment based on machine learning](https://pubmed.ncbi.nlm.nih.gov/34891601/) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [SyntAct](https://zenodo.org/record/6573016#.ZAjy_9LMJpj) | 2022 | Synthesized database with 997 utterances of three basic emotions and neutral expression based on rule-based manipulation for a diphone synthesizer which we release to the public | 6 emotions: angry, bored, happy, neutral, sad and scared | Audio | 0.941 GB | German | [SyntAct: A Synthesized Database of Basic Emotions](http://felix.syntheticspeech.de/publications/synthetic_database.pdf) | Open | [CC BY-SA 4.0](https://creativecommons.org/licenses/by/4.0) |
| [BEAT](https://drive.google.com/drive/folders/1EKuWH8q178QOtFUYaNohdkZbBHQYAmhL) | 2022 | 76-Hour and 30-Speaker of 4 different languages: English (60h), Chinese (12h), Spanish (2h) and Japanese (2h). | 8 emotions: happiness, anger, disgust, sadness, contempt, surprise, fear, and neutral | Audio, Video | 42 GB | English, Chinese, Spanish, Japanese | [A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis](https://www.ecva.net/papers/eccv_2022/papers_ECCV/papers/136670605.pdf) | Open | Non-commercial license |
| [Dusha](https://github.com/salute-developers/golos/tree/master/dusha) | 2022 | 300000 audio recordings (~350 hours) of Russian speech, their transcripts and emotiomal labels. The dataset has two subsets: acted and real-life | 4 emotions: angry, happy, sad and neutral. Arousal and valence metrics are also available. | Audio | 58 GB | Russian | [Large Raw Emotional Dataset with Aggregation Mechanism](https://arxiv.org/abs/2212.12266) | Open | [Public license with attribution and conditions reserved](https://github.com/salute-developers/golos/blob/master/license/en_us.pdf) |
| [MAFW](https://mafw-database.github.io/MAFW/) | 2022 | 10045 video-audio clips in the wild. | 11 single-label emotion categories (anger, disgust, fear, happiness, neutral, sadness, surprise, contempt, anxiety, helplessness, and disappointment) and 32 multi-label emotion categories. | Audio, Video | -- | -- | [MAFW: A Large-scale, Multi-modal, Compound Affective Database for Dynamic Facial Expression Recognition in the Wild](https://arxiv.org/abs/2208.00847) | Restricted | Non-commercial research purposes |
| [EMOVIE](https://viem-ccy.github.io/EMOVIE/dataset_release.html) | 2021 | 9724 samples with audio files and its emotion human-labeled annotation. | Polarity metrics (positive:+1, negative:-1) | Audio | 0.572 GB | Chinese (Mandarin) | [EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model](https://arxiv.org/abs/2106.09317) | Open | [CC BY-NC-SA 2.0](https://creativecommons.org/licenses/by-nc-sa/2.0/legalcode) |
| [emoUERJ](https://zenodo.org/records/5427549) | 2021 | Ten sentences from eight actors, equally divided between genders, and they were free to choose the phrases for record audios in four emotions (377 audios). | happiness, anger, sadness or neutral | Audio | 0.1051 GB | Portuguese (Brazilian) | -- | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Thorsten-Voice Dataset 2021.06 emotional](https://zenodo.org/records/5525023) | 2021 | 2400 normalized mono recordings by one person (Thorsten Müller) representing 300 sentences. | Amusement, Disgust Anger, Suprise and Neutral (plus drunk, whispering and sleepy states) | Audio | 0.399 GB | German | -- | Open | [CC0: Public Domain](https://creativecommons.org/publicdomain/zero/1.0/) |
| [ASED](https://github.com/Ethio2021/ASED_V1) | 2021 | 2474 recordings by 65 participants (25 females and 40 males)). Recordings were judged and rejected according to the opionion of eight judges. | Five emotions: anger, happiness, fear, sadness and neutral | Audio | 0.135 GB | Amharic | [A New Amharic Speech Emotion Dataset and Classification Benchmark](https://dl.acm.org/doi/10.1145/3529759) | Open | -- |
| [ESCorpus-PE](https://zenodo.org/records/5793223) | 2021 | Spanish peruvian speech gathered from Spanish interviews, TV reports, political debate and testimonials. It contains 3749 utterances, 80 speakers (44 male and 36 female), created from Youtube audios | Valence, Arousal and Dominance | Audio | 1.9 GB | Spanish (Peruvian) | -- | Open | [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/) |
| [SUBSECO](https://zenodo.org/record/6339787) | 2021 | 7000 sentence-level utterances of the Bangla language, 20 professional actors (10 males and 10 females), recordings, 10 sentences for 7 target emotions. | Anger, Disgust, Fear, Happiness, Neutral, Sadness and Surprise | Audio | 1.7 GB | English | [SUST Bangla Emotional Speech Corpus (SUBESCO): An audio-only emotional speech corpus for Bangla](https://doi.org/10.1371/journal.pone.0250173) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Audio-Speech-Sentiment](https://www.kaggle.com/imsparsh/audio-speech-sentiment-analysis) | 2021 | Audio Speech Sentiment Dataset | 4 emotions provides audio recordings of spoken sentences for anger, happiness, sadness, and neutral emotions. | Audio | 1.1 GB | English | -- | Open | [CC0: Public Domain](https://creativecommons.org/publicdomain/zero/1.0/) |
| [LSSED](https://github.com/tobefans/LSSED) | 2021 | LSSED: A Large-Scale Dataset and Benchmark for Speech Emotion Recognition | Anger, happiness, sadness, disappointment, boredom, disgust, excitement, fear, surprise, normal, and other. | Audio | 90 GB | English | [LSSED: A Large-Scale Spanish Emotional Speech Database for Speech Processing and Machine Learning](https://arxiv.org/abs/2102.01754) | Restricted | [-](https://github.com/tobefans/LSSED/blob/main/EULA.pdf) |
| [MLEnd](https://www.kaggle.com/datasets/jesusrequena/mlend-spoken-numerals) | 2021 | ~32700 audio recordings files produced by 154 speakers. Each audio recording corresponds to one English numeral (from "zero" to "billion") | Intonations: neutral, bored, excited and question | Audio | 2.27 GB | -- | -- | Open | Unknown |
| [ASVP-ESD](https://www.kaggle.com/datasets/dejolilandry/asvpesdspeech-nonspeech-emotional-utterances) | 2021 | ~13285 audio files collected from movies, tv shows and youtube containing speech and non-speech. | 12 different natural emotions (boredom, neutral, happiness, sadness, anger, fear, surprise, disgust, excitement, pleasure, pain, disappointment) with 2 levels of intensity. | Audio | 2 GB | Chinese, English, French, Russian and others | -- | Open | Unknown |
| [ESD](https://hltsingapore.github.io/ESD/) | 2021 | 29 hours, 3500 sentences, by 10 native English speakers and 10 native Chinese speakers. | 5 emotions: angry, happy, neutral, sad, and surprise. | Audio, Text | 2.4 GB | Chinese, English | [Seen And Unseen Emotional Style Transfer For Voice Conversion With A New Emotional Speech Dataset](https://arxiv.org/pdf/2010.14794.pdf) | Open | Academic License |
| [MuSe-CAR](https://zenodo.org/record/4134758) | 2021 | 40 hours, 6,000+ recordings of 25,000+ sentences by 70+ English speakers (see db link for details). | continuous emotion dimensions characterized using valence, arousal, and trustworthiness. | Audio, Video, Text | 15 GB | English | [The Multimodal Sentiment Analysis in Car Reviews (MuSe-CaR) Dataset: Collection, Insights and Improvements](https://arxiv.org/pdf/2101.06053.pdf) | Restricted | Academic License & Commercial License |
| [THAI SER](https://github.com/vistec-AI/dataset-releases/releases/tag/v1) | 2021 | The recordings are 41 hours, 36 minutes long (27,854 utterances), and were performed by 200 professional actors (112 female, 88 male). | 5 main emotions assigned to actors: Neutral, Anger, Happiness, Sadness, and Frustration. | Audio | 12 GB | Thai | -- | Open | [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0) |
| [French Emotional Speech Database - Oréau](https://zenodo.org/records/4405783#.Yqjq_9JBxph) | 2020 | 79 utterances with 10 to 13 utterances pro emotion by 32 non-professional speakers. | 7 emotions: sadness, anger, disgust, fear, surprise, joy, neutral. | Audio | 0.264 GB | French | -- | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [Att-HACK ](http://www.openslr.org/88/) | 2020 | 25 speakers interpreting 100 utterances in 4 social attitudes, with 3-5 repetitions each per attitude for a total of around 30 hours of speech. | expressive speech in French, 100 phrases with multiple versions (3 to 5) in four social attitudes (friendly, distant, dominant and seductive). | Audio | 6.6 GB | French | [Att-HACK: An Expressive Speech Database with Social Attitudes](https://arxiv.org/abs/2004.04410) | Open | [CC BY-NC-ND 4.0](https://creativecommons.org/licenses/by-nc-nd/4.0/) |
| [MSP-Podcast corpus](https://ecs.utdallas.edu/research/researchlabs/msp-lab/MSP-Podcast.html) | 2020 | 100 hours by over 100 speakers (see db link for details). | This corpus is annotated with emotional labels using attribute-based descriptors (activation, dominance and valence) and categorical labels (anger, happiness, sadness, disgust, surprised, fear, contempt, neutral and other). | Audio | 13.4 GB | English | [The MSP-Conversation Corpus](http://www.interspeech2020.org/index.php?m=content&c=index&a=show&catid=290&id=684) | Restricted | Academic License & Commercial License |
| [AISHELL-3](https://www.openslr.org/93/) | 2020 | Roughly 85 hours of emotion-neutral recordings spoken by 218 native Chinese mandarin speakers and total 88035 utterances. | Neutral | Audio | 19 GB | Chinese (Mandarin) | [AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines](https://arxiv.org/abs/2010.11567) | Open | [Apache 2.0](https://apache.org/licenses/LICENSE-2.0) |
| [BEASC](https://doi.org/10.6084/m9.figshare.12498033) | 2020 | Bangla Emotional Audio-Speech Corpus | 6 emotions provides Bangla spoken utterances for anger, happiness, sadness, fear, surprise, and neutral. | Audio | 9 GB | Bangla | [BEASC: Bangla Emotional Audio-Speech Corpus - A Speech Emotion Recognition Corpus for the Low-Resource Bangla Language](https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:236649) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [emotiontts open db](https://github.com/emotiontts/emotiontts_open_db) | 2020 | Recordings and their associated transcriptions by a diverse group of speakers. | 4 emotions: general, joy, anger, and sadness. | Audio, Text | -- | Korean | -- | Partially open | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
| [URDU-Dataset](https://github.com/siddiquelatif/urdu-dataset) | 2020 | 400 utterances by 38 speakers (27 male and 11 female). | 4 emotions: angry, happy, neutral, and sad. | Audio | 0.072 GB | Urdu | [Cross Lingual Speech Emotion Recognition: Urdu vs. Western Languages](https://arxiv.org/pdf/1812.10411.pdf) | Open | -- |
| [BAVED](https://www.kaggle.com/a13x10/basic-arabic-vocal-emotions-dataset) | 2020 | 1935 recording by 61 speakers (45 male and 16 female). | 3 levels of emotion. | Audio | 0.195 GB | Arabic | -- | Open | -- |
| [VIVAE](https://zenodo.org/record/4066235) | 2020 | non-speech, 1085 audio file by 11 speakers. | non-speech 6 emotions: achievement, anger, fear, pain, pleasure, and surprise with 3 emotional intensities (low, moderate, strong, peak). | Audio | 0.0935 GB | Nonverbal (English) | [The Variably Intense Vocalizations of Affect and Emotion (VIVAE) corpus prompts new perspective on nonspeech perception](http://dx.doi.org/10.1037/emo0001048) | Restricted | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
| [VESUS](https://engineering.jhu.edu/nsa/vesus/) | 2019 | 252 distinct phrases, each read by 10 actors totalling 6 hours of speech. | 5 emotions: anger, happiness, sadness, fear and neutral. | Audio | -- | English | [VESUS: A Crowd-Annotated Database to Study Emotion Production and Perception in Spoken English](https://engineering.jhu.edu/nsa/wp-content/uploads/2019/10/IS191413.pdf) | Restricted | Academic EULA |
| [Morgan Emotional Speech Set](https://arxiv.org/abs/2403.02167) | 2019 | 999 spontaneous voice messages from 100 Spanish speakers, collected from real conversations on a messaging app. | Valence & arrousal dimensions and 4 emotions: happiness, anger, sadness, and calmness. | Audio | 0.192 GB | English | [Categorical and Dimensional Ratings of Emotional Speech: Behavioral Findings From the Morgan Emotional Speech Set](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7203525/) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [PMEmo](https://github.com/HuiZhangDB/PMEmo) | 2019 | Dataset containing emotion annotations of 794 songs as well as the simultaneous electrodermal activity (EDA) signals. A Music Emotion Experiment was well-designed for collecting the affective-annotated music corpus of high quality, which recruited 457 subjects. | Valence, Arousal | Audio, EDA | 1.3 GB | Chinese, English | [The PMEmo Dataset for Music Emotion Recognition](https://dl.acm.org/doi/10.1145/3206025.3206037) | Open | [CC BY-SA 4.0](https://huisblog.cn/PMEmo//) |
| [SEWA](https://db.sewaproject.eu/) | 2019 | more than 2000 minutes of audio-visual data of 398 people (201 male and 197 female) coming from 6 cultures. | emotions are characterized using valence and arousal. | Audio, Video | -- | Chinese, English, German, Greek, Hungarian and Serbian | [SEWA DB: A Rich Database for Audio-Visual Emotion and Sentiment Research in the Wild](https://arxiv.org/pdf/1901.02839.pdf) | Restricted | [SEWA EULA](https://db.sewaproject.eu/media/doc/eula.pdf) |
| [MELD](https://affective-meld.github.io/) | 2019 | 1400 dialogues and 14000 utterances from Friends TV series by multiple speakers. | 7 emotions: Anger, disgust, sadness, joy, neutral, surprise and fear. MELD also has sentiment (positive, negative and neutral) annotation for each utterance. | Audio, Video, Text | 10.1 GB | English | [MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations](https://arxiv.org/pdf/1810.02508.pdf) | Open | [MELD: GPL-3.0 License](https://github.com/declare-lab/MELD/blob/master/LICENSE) |
| [ShEMO](https://github.com/mansourehk/ShEMO) | 2019 | 3000 semi-natural utterances, equivalent to 3 hours and 25 minutes of speech data from online radio plays by 87 native-Persian speakers. | 6 emotions: anger, fear, happiness, sadness, neutral and surprise. | Audio | 0.101 GB | Persian | [ShEMO: a large-scale validated database for Persian speech emotion detection](https://link.springer.com/article/10.1007/s10579-018-9427-x) | Open | -- |
| [DEMoS](https://zenodo.org/record/2544829) | 2019 | 9365 emotional and 332 neutral samples produced by 68 native speakers (23 females, 45 males). | 7/6 emotions: anger, sadness, happiness, fear, surprise, disgust, and the secondary emotion guilt. | Audio | 2.5 GB | Italian | [DEMoS: An Italian emotional speech corpus. Elicitation methods, machine learning, and perception](https://link.springer.com/epdf/10.1007/s10579-019-09450-y?author_access_token=5pf0w_D4k9z28TM6n4PbVPe4RwlQNchNByi7wbcMAY5hiA-aXzXNbZYfsMDDq2CdHD-w5ArAxIwlsk2nC_26pSyEAcu1xlKJ1c9m3JZj2ZlFmlVoCZUTcG3Hq2_2ozMLo3Hq3Y0CHzLdTxihQwch5Q%3D%3D) | Restricted | EULA: End User License Agreement |
| [AESDD](http://m3c.web.auth.gr/research/aesdd-speech-emotion-recognition/) | 2018 | around 500 utterances by a diverse group of actors (over 5 actors) siumlating various emotions. | 5 emotions: anger, disgust, fear, happiness, and sadness. | Audio | 0.392 GB | Greek | [Speech Emotion Recognition for Performance Interaction](https://www.researchgate.net/publication/326005164_Speech_Emotion_Recognition_for_Performance_Interaction) | Open | -- |
| [Emov-DB](https://mega.nz/#F!KBp32apT!gLIgyWf9iQ-yqnWFUFuUHg!mYwUnI4K) | 2018 | Recordings for 4 speakers- 2 males and 2 females. | The emotional styles are neutral, sleepiness, anger, disgust and amused. | Audio | 5.88 GB | English | [The emotional voices database: Towards controlling the emotion dimension in voice generation systems](https://arxiv.org/pdf/1806.09514.pdf) | Open | -- |
| [OMG Emotion](https://www2.informatik.uni-hamburg.de/wtm/OMG-EmotionChallenge/) | 2018 | 420 relatively long emotion videos with an average length of 1 minute, collected from a variety of Youtube channels. | 7 emotions:anger, disgust, fear, happy, sad, surprise and neutral. Plus valence, arousal. | Audio, Video | -- | English | [The OMG-Emotion Behavior Dataset](https://arxiv.org/abs/1803.05434) | Open | [CC BY-NC-SA 3.0](https://creativecommons.org/licenses/by-nc-sa/3.0/) |
| [RAVDESS](https://zenodo.org/record/1188976#.XrC7a5NKjOR) | 2018 | 7356 recordings by 24 actors. | 7 emotions: calm, happy, sad, angry, fearful, surprise, and disgust | Audio, Video | 24.8 GB | English | [The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English](https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0196391) | Open | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
| [JL corpus](https://www.kaggle.com/tli725/jl-corpus) | 2018 | 2400 recording of 240 sentences by 4 actors (2 males and 2 females). | 5 primary emotions: angry, sad, neutral, happy, excited. 5 secondary emotions: anxious, apologetic, pensive, worried, enthusiastic. | Audio | 1.9 GB | English | [An Open Source Emotional Speech Corpus for Human Robot Interaction Applications](https://www.isca-speech.org/archive/Interspeech_2018/pdfs/1349.pdf) | Open | [CC0 1.0](https://creativecommons.org/publicdomain/zero/1.0/) |
| [CaFE](https://zenodo.org/record/1478765) | 2018 | 6 different sentences by 12 speakers (6 fmelaes + 6 males). | 7 emotions: happy, sad, angry, fearful, surprise, disgust and neutral. Each emotion is acted in 2 different intensities. | Audio | 2 GB | French (Canadian) | -- | Open | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
| [EmoFilm](https://zenodo.org/record/1326428) | 2018 | 1115 audio instances sentences extracted from various films. | 5 emotions: anger, contempt, happiness, fear, and sadness. | Audio | 0.277 GB | English, Italian, Spanish | [Categorical vs Dimensional Perception of Italian Emotional Speech](https://pdfs.semanticscholar.org/e70e/fcf7f5b4c366a7b7e2c16267d7f7691a5391.pdf) | Restricted | EULA: End User License Agreement |
| [ANAD](https://www.kaggle.com/suso172/arabic-natural-audio-dataset) | 2018 | 1384 recording by multiple speakers. | 3 emotions: angry, happy, surprised. | Audio | 2 GB | Arabic | [Arabic Natural Audio Dataset](https://data.mendeley.com/datasets/xm232yxf7t/1) | Open | [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) |
| [EmoSynth](https://zenodo.org/record/3727593) | 2018 | 144 audio file labelled by 40 listeners. | Emotion (no speech) defined in regard of valence and arousal. | Audio | 0.1034 GB | -- | [The Perceived Emotion of Isolated Synthetic Audio: The EmoSynth Dataset and Results](https://dl.acm.org/doi/10.1145/3243274.3243277) | Open | [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/) |
| [CMU-MOSEI](https://www.amir-zadeh.com/datasets) | 2018 | 65 hours of annotated video from more than 1000 speakers and 250 topics. | 6 Emotion (happiness, sadness, anger,fear, disgust, surprise) + Likert scale. | Audio, Video | 190.1 GB | English | [Multi-attention Recurrent Network for Human Communication Comprehension](https://arxiv.org/pdf/1802.00923.pdf) | Open | [CMU-MOSEI License](https://github.com/A2Zadeh/CMU-MultimodalSDK/blob/master/LICENSE.txt) |
| [VERBO](https://sites.google.com/view/verbodatabase/home) | 2018 | 14 different phrases by 12 speakers (6 female + 6 male) for a total of 1167 recordings. | 7 emotions: Happiness, Disgust, Fear, Neutral, Anger, Surprise, Sadness | Audio | -- | Portuguese | [VERBO: Voice Emotion Recognition dataBase in Portuguese Language](https://thescipub.com/pdf/jcssp.2018.1420.1430.pdf) | Restricted | Available for research purposes only |
| [CMU-MOSI](https://www.amir-zadeh.com/datasets) | 2017 | 2199 opinion utterances with annotated sentiment. | Sentiment annotated between very negative to very positive in seven Likert steps. | Audio, Video | 4.3 GB | English | [Multi-attention Recurrent Network for Human Communication Comprehension](https://arxiv.org/pdf/1802.00923.pdf) | Open | [CMU-MOSI License](https://github.com/A2Zadeh/CMU-MultimodalSDK/blob/master/LICENSE.txt) |
| [MSP-IMPROV](https://ecs.utdallas.edu/research/researchlabs/msp-lab/MSP-Improv.html) | 2017 | 20 sentences by 12 actors. | 4 emotions: angry, sad, happy, neutral, other, without agreement | Audio, Video | 3.4 GB | English | [MSP-IMPROV: An Acted Corpus of Dyadic Interactions to Study Emotion Perception](https://ecs.utdallas.edu/research/researchlabs/msp-lab/publications/Busso_2017.pdf) | Restricted | Academic License & Commercial License |
| [CREMA-D](https://github.com/CheyneyComputerScience/CREMA-D) | 2017 | 7442 clip of 12 sentences spoken by 91 actors (48 males and 43 females). | 6 emotions: angry, disgusted, fearful, happy, neutral, and sad | Audio, Video | 0.607 GB | English | [CREMA-D: Crowd-sourced Emotional Multimodal Actors Dataset](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4313618/) | Open | [Open Database License & Database Content License](https://github.com/CheyneyComputerScience/CREMA-D/blob/master/LICENSE.txt) |
| [Example emotion videos used in investigation of emotion perception in schizophrenia](https://espace.library.uq.edu.au/view/UQ:446541) | 2017 | 6 videos:Two example videos from each emotion category (angry, happy and neutral) by one female speaker. | 3 emotions: angry, happy and neutral. | Audio, Video | 0.063 GB | English | -- | Open | [Permitted Non-commercial Re-use with Acknowledgment](https://guides.library.uq.edu.au/deposit_your_data/terms_and_conditions) |
| [EMOVO](http://voice.fub.it/activities/corpora/emovo/index.html) | 2014 | 6 actors who played 14 sentences. | 6 emotions: disgust, fear, anger, joy, surprise, sadness. | Audio | 0.355 GB | Italian | [EMOVO Corpus: an Italian Emotional Speech Database](https://core.ac.uk/download/pdf/53857389.pdf) | Open | -- |
| [RECOLA](https://diuf.unifr.ch/main/diva/recola/download.html) | 2013 | 3.8 hours of recordings by 46 participants. | negative and positive sentiment (valence and arousal). | Audio, Video | -- | -- | [Introducing the RECOLA Multimodal Corpus of Remote Collaborative and Affective Interactions](https://drive.google.com/file/d/0B2V_I9XKBODhNENKUnZWNFdVXzQ/view) | Restricted | Academic License & Commercial License |
| [GEMEP corpus](https://www.unige.ch/cisa/gemep) | 2012 | Videos10 actors portraying 10 states. | 12 emotions: amusement, anxiety, cold anger (irritation), despair, hot anger (rage), fear (panic), interest, joy (elation), pleasure(sensory), pride, relief, and sadness. Plus, 5 additional emotions: admiration, contempt, disgust, surprise, and tenderness. | Audio, Video | -- | French | [Introducing the Geneva Multimodal Expression Corpus for Experimental Research on Emotion Perception](https://www.researchgate.net/publication/51796867_Introducing_the_Geneva_Multimodal_Expression_Corpus_for_Experimental_Research_on_Emotion_Perception) | Restricted | -- |
| [OGVC](https://sites.google.com/site/ogcorpus/home/en) | 2012 | 9114 spontaneous utterances and 2656 acted utterances by 4 professional actors (two male and two female). | 9 emotional states: fear, surprise, sadness, disgust, anger, anticipation, joy, acceptance and the neutral state. | Audio | 5.3 GB | Japanese | [Naturalistic emotional speech collectionparadigm with online game and its psychological and acoustical assessment](https://www.jstage.jst.go.jp/article/ast/33/6/33_E1175/_pdf) | Restricted | -- |
| [LEGO corpus](https://www.ultes.eu/ressources/lego-spoken-dialogue-corpus/) | 2012 | 347 dialogs with 9,083 system-user exchanges. | Emotions classified as garbage, non-angry, slightly angry and very angry. | Audio | 1.1 GB | -- | [A Parameterized and Annotated Spoken Dialog Corpus of the CMU Let’s Go Bus Information System](http://www.lrec-conf.org/proceedings/lrec2012/pdf/333_Paper.pdf) | Open | License available with the data. Free of charges for research purposes only. |
| [SEMAINE](https://semaine-db.eu/) | 2012 | 95 dyadic conversations from 21 subjects. Each subject converses with another playing one of four characters with emotions. | 5 FeelTrace annotations: activation, valence, dominance, power, intensity | Audio, Video, Text | 104 GB | English | [The SEMAINE Database: Annotated Multimodal Records of Emotionally Colored Conversations between a Person and a Limited Agent](https://ieeexplore.ieee.org/document/5959155) | Restricted | Academic EULA |
| [SAVEE](http://kahlan.eps.surrey.ac.uk/savee/Database.html) | 2011 | 480 British English utterances by 4 males actors. | 7 emotions: anger, disgust, fear, happiness, sadness, surprise and neutral. | Audio, Video | -- | English (British) | [Multimodal Emotion Recognition](http://personal.ee.surrey.ac.uk/Personal/P.Jackson/pub/ma10/HaqJackson_MachineAudition10_approved.pdf) | Restricted | Free of charges for research purposes only. |
| [TESS](https://tspace.library.utoronto.ca/handle/1807/24487) | 2010 | 2800 recording by 2 actresses. | 7 emotions: anger, disgust, fear, happiness, pleasant surprise, sadness, and neutral. | Audio | -- | English | [BEHAVIOURAL FINDINGS FROM THE TORONTO EMOTIONAL SPEECH SET](https://www.semanticscholar.org/paper/BEHAVIOURAL-FINDINGS-FROM-THE-TORONTO-EMOTIONAL-SET-Dupuis-Pichora-Fuller/d7f746b3aee801a353b6929a65d9a34a68e71c6f/figure/2) | Open | [CC BY-NC-ND 4.0](https://creativecommons.org/licenses/by-nc-nd/4.0/) |
| [EEKK](https://metashare.ut.ee/repository/download/4d42d7a8463411e2a6e4005056b40024a19021a316b54b7fb707757d43d1a889/) | 2007 | 26 text passage read by 10 speakers. | 4 main emotions: joy, sadness, anger and neutral. | -- | 0.352 GB | Estonian | [Estonian Emotional Speech Corpus](https://www.researchgate.net/publication/261724574_Estonian_Emotional_Speech_Corpus_Release_1) | Open | [CC-BY license](https://metashare.ut.ee/repository/download/4d42d7a8463411e2a6e4005056b40024a19021a316b54b7fb707757d43d1a889/) |
| [IEMOCAP](https://sail.usc.edu/iemocap/iemocap_release.htm) | 2007 | 12 hours of audiovisual data by 10 actors in 5 sessions. | Full: neutral state; happiness; sadness; anger; surprise; fear; disgust; frustration; excited; other. Balance 5 emotions: happiness, anger, sadness, frustration and neutral. Three dimensions: valence, arousal, dominance | Audio, Video, Text | 17.7 GB | English | [IEMOCAP: Interactive emotional dyadic motion capture database](https://sail.usc.edu/iemocap/Busso_2008_iemocap.pdf) | Restricted | [IEMOCAP license](https://sail.usc.edu/iemocap/Data_Release_Form_IEMOCAP.pdf) |
| [Keio-ESD](http://research.nii.ac.jp/src/en/Keio-ESD.html) | 2006 | A set of human speech with vocal emotion spoken by a Japanese male speaker. | 47 emotions including angry, joyful, disgusting, downgrading, funny, worried, gentle, relief, indignation, shameful, etc. | Audio | 0.0435 GB | Japanese | [EMOTIONAL SPEECH SYNTHESIS USING SUBSPACE CONSTRAINTS IN PROSODY](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.420.8899&rep=rep1&type=pdf) | Restricted | Available for research purposes only. |
| [EMO-DB](http://emodb.bilderbar.info/index-1280.html) | 2005 | 800 recording spoken by 10 actors (5 males and 5 females). | 7 emotions: anger, neutral, fear, boredom, happiness, sadness, disgust. | Audio | 0.049 GB | German | [A Database of German Emotional Speech](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.130.8506&rep=rep1&type=pdf) | Open | -- |
| [eNTERFACE05](http://www.enterface.net/enterface05/docs/results/databases/project2_database.zip) | 2005 | Videos by 42 subjects, coming from 14 different nationalities. | 6 emotions: anger, fear, surprise, happiness, sadness and disgust. | Audio, Video | 0.8 GB | German | -- | Open | Free of charges for research purposes only. |
| [DES](http://kom.aau.dk/~tb/speech/Emotions/) | 2002 | 4 speakers (2 males and 2 females). | 5 emotions: neutral, surprise, happiness, sadness and anger | -- | -- | Danish | [Documentation of the Danish Emotional Speech Database](http://kom.aau.dk/~tb/speech/Emotions/des.pdf) | -- | -- |## References
- Swain, Monorama & Routray, Aurobinda & Kabisatpathy, Prithviraj, Databases, features and classifiers for speech emotion recognition: a review, International Journal of Speech Technology, [paper](https://www.researchgate.net/publication/322602563_Databases_features_and_classifiers_for_speech_emotion_recognition_a_review#pf19)
- Dimitrios Ververidis and Constantine Kotropoulos, A State of the Art Review on Emotional Speech Databases, Artificial Intelligence & Information Analysis Laboratory, Department of Informatics Aristotle, University of Thessaloniki, [paper](http://poseidon.csd.auth.gr/papers/PUBLISHED/CONFERENCE/pdf/Ververidis2003b.pdf)
- A. Pramod Reddy and V. Vijayarajan, Extraction of Emotions from Speech-A Survey, VIT University, International Journal of Applied Engineering Research, [paper](https://www.ripublication.com/ijaer17/ijaerv12n16_46.pdf)
- Emotional Speech Databases, [document](https://link.springer.com/content/pdf/bbm%3A978-90-481-3129-7%2F1.pdf)
- Expressive Synthetic Speech, [website](http://emosamples.syntheticspeech.de/)
- Towards a standard set of acoustic features for the processing of emotion in speech, Technical university Munich, [document](https://asa.scitation.org/doi/pdf/10.1121/1.4739483)
## Contribution
- All contributions are welcome! If you know a dataset that belongs here (see [criteria](https://github.com/SuperKogito/SER-datasets/blob/master/CONTRIBUTING.md#criteria)) but is not listed, please feel free to add it. For more information on Contributing, please refer to [CONTRIBUTING.md](https://github.com/SuperKogito/SER-datasets/blob/master/CONTRIBUTING.md).
- If you notice a typo or a mistake, please [report this as an issue](https://github.com/SuperKogito/SER-datasets/issues/new) and help us improve the quality of this list.
## Disclaimer
- The mainter and the contributors try their best to keep this list up-to-date, and to only include working links (using automated verification with the help of the [urlchecker-action](https://github.com/marketplace/actions/urlchecker-action)). However, we cannot guarantee that all listed links are up-to-date. Read more in [DISCLAIMER.md](https://github.com/SuperKogito/SER-datasets/blob/master/DISCLAIMER.md).
## Recommended tools
- [Nkululeko](https://github.com/felixbur/nkululeko)
This toolkit has a [data](https://github.com/felixbur/nkululeko/tree/main/data) directory with each python-preprocessing script that can load most datasets in this list. The processing script there will split the data into train, validation, and test sets, and save them as CSV files with file paths and labels. Then, you can make make experiments to detect emotions from speech using that dataset with Nkululeko or other tools.
- [ERTK](https://github.com/Strong-AI-Lab/emotion)
Similar to Nkululeko, ERTK (emotion recognition toolkit) also has [dataset](https://github.com/Strong-AI-Lab/emotion/tree/master/datasets) directory that can load most datasets in this list.