https://github.com/jackbdu/mouth-synth

Mouth-controlled synthesizer built with p5.js and ml5.js.
https://github.com/jackbdu/mouth-synth

facemesh ml5js music p5js synthesizer

Last synced: 4 months ago
JSON representation

Mouth-controlled synthesizer built with p5.js and ml5.js.

• Host: GitHub
• URL: https://github.com/jackbdu/mouth-synth
• Owner: jackbdu
• Created: 2024-11-19T00:25:48.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-01-06T17:11:00.000Z (over 1 year ago)
• Last Synced: 2025-01-06T18:27:33.798Z (over 1 year ago)
• Topics: facemesh, ml5js, music, p5js, synthesizer
• Language: JavaScript
• Homepage: https://jackbdu.com/mouth-synth/
• Size: 5.99 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Mouth Synth

![](assets/mouth-synth-demo-clip-360p@15fps.gif)

Title: Mouth Synth

Date: 2024

Mediums: computer, camera, custom software (written in JavaScript)

Dimensions: variable

Links: [video demo](https://www.instagram.com/p/C46Qy2LJ8Na/), [live demo](https://jackbdu.com/mouth-synth/), [blog post](https://jackbdu.com/blog/mouth-controlled-synthesizer/)

**Mouth Synth** is an interactive audio-visual installation that synthesizes whimsical, surreal sounds in response to a viewer’s facial movements. As the viewer stands before the installation, their head and mouth gestures are captured and processed by a machine-learning-powered program that translates these movements into playful, expressive music.

Viewers are invited to interact, perform, and experiment, making them an integral part of the artwork itself. By centering the mouth as the primary means of interaction, _Mouth Synth_ challenges conventional modes of control, offering a unique and intimate way to shape sound and engage with art.