Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

awesome-audio-visual

A curated list of different papers and datasets in various areas of audio-visual processing
https://github.com/krantiparida/awesome-audio-visual

Last synced: 16 days ago
JSON representation

Datasets

  • AudioSet - Audio-Visual Classification
  • Visually Engaged and Grounded AudioSet (VEGAS) - Sound generation from video
  • Audio-Visual Event (AVE) - Audio-Visual Event Localization
  • EPIC-Kitchens - Egocentric Audio-Visual Action Recogniton
  • Audio-Visually Indicated Actions Dataset - Multimodal dataset (RGB, acoustic data as raw audio) acquired using the acoustic-optical camera
  • IMSDb dataset - Movie scripts downloaded from The Internet Script Movie Database
  • ACAV100M - 140 million full-length videos (total duration 1,030 years) and produce a dataset of 100 million 10-second clips (31 years) with high audio-visual correspondence.
  • UnAV-100 - The dataset consists of more than 10K untrimmed videos with over 30K audio-visual events covering 100 different event categories. There are often multiple audio-visual events that might be very short or long, and occur concurrently in each video as in real-life audio-visual scenes.
  • AVSpeech
  • Kinetics-Sounds - Subset of Kinetics dataset
  • MUSIC - Audio-Visual Source Separation
  • AudioSetZSL - Audio-Visual Zero-shot Learning
  • YOUTUBE-ASMR-300K dataset - ASMR videos collected from YouTube that contains stereo audio
  • FAIR-Play - 1,871 video clips and their corresponding binaural audio clips recorded in a music room
  • XD-Violence - weakly annotated dataset for audio-visual violence detection
  • AuDio Visual Aerial sceNe reCognition datasEt (ADVANCE) - Geotagged aerial images and sounds, classified into 13 scene classes
  • AIST++ - A large-scale 3D human dance motion dataset, which contains a wide variety of 3D motion paired with music It is built upon the AIST Dance Database, which is an uncalibrated multi-view collection of dance videos.
  • VideoCC - A dataset containing (video-URL, caption) pairs for training video-text machine learning models. It is created using an automatic pipeline starting from the Conceptual Captions Image-Captioning Dataset.
  • ssw60 - A dataset for research on adiovisual fine-grained categorization. The dataset covers 60 species of birds that all occur in a specific geographic location: Sapsucker Woods, Ithaca, NY. It is comprised of images from existing datasets, and brand new, expert curated audio and video data.
  • PACS - A dataset designed to help create and evaluate
  • AVSBench - A dataset for audio-visual pixel-wise segmentation task.
  • Speech2Gesture - Gesture prediction from speech
  • VoxCeleb - Audio-Visual Speaker Identification, contains two versions
  • auDIoviSual Crowd cOunting dataset (DISCO) - 1,935 Images and audios from various typical scenes, a total of 170, 270 instances annotated with the head locations.
  • MUSIC-Synthetic dataset - Category-balanced multi-source videos by artificially synthesizing solo videos from the MUSIC dataset, to facilitate the learning and evaluation of multiple-soundings-sources localization in the cocktail-party scenario.
  • EmoVoxCeleb
  • LRW Dataset
  • LRS2 - lang.html) - Lip Reading Datasets

Licenses