https://github.com/collidingscopes/arpeggiator
Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Built with mediapipe computer vision, threejs, tonejs
https://github.com/collidingscopes/arpeggiator
arpeggio audio-reactive augmented-reality computer-vision drum-machine hand-gesture-recognition hand-tracking mediapipe music spatial-computing synthesizer threejs tonejs visualizer
Last synced: 4 months ago
JSON representation
Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Built with mediapipe computer vision, threejs, tonejs
- Host: GitHub
- URL: https://github.com/collidingscopes/arpeggiator
- Owner: collidingScopes
- Created: 2025-06-16T13:37:01.000Z (4 months ago)
- Default Branch: main
- Last Pushed: 2025-06-16T13:58:23.000Z (4 months ago)
- Last Synced: 2025-06-16T14:47:52.877Z (4 months ago)
- Topics: arpeggio, audio-reactive, augmented-reality, computer-vision, drum-machine, hand-gesture-recognition, hand-tracking, mediapipe, music, spatial-computing, synthesizer, threejs, tonejs, visualizer
- Language: JavaScript
- Homepage: https://collidingscopes.github.io/arpeggiator/
- Size: 450 KB
- Stars: 3
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
Awesome Lists containing this project
README
# Hand Gesture Arpeggiator
Hand-controlled arpeggiator, drum machine, and audio reactive visualizer. Raise your hands to raise the roof!
An interactive web app built with threejs, mediapipe computer vision, rosebud AI, and tone.js.
- Hand #1 controls the arpeggios (raise hand to raise pitch, pinch to change volume)
- Hand #2 controls the drums (raise different fingers to change the pattern)
[Video](https://x.com/measure_plan/status/1934618478524199126) | [Live Demo](https://collidingscopes.github.io/arpeggiator/)
## Requirements
- Modern web browser with WebGL support
- Camera access enabled for hand tracking
## Technologies
- **MediaPipe** for hand tracking and gesture recognition
- **Three.js** for audio reactive visual rendering
- **Tone.js** for synthesizer sounds
- **HTML5 Canvas** for visual feedback
- **JavaScript** for real-time interaction
## Setup for Development
```bash
# Clone this repository
git clone https://github.com/collidingScopes/arpeggiator
# Navigate to the project directory
cd arpeggiator
# Serve with your preferred method (example using Python)
python -m http.server
```
Then navigate to `http://localhost:8000` in your browser.
## License
MIT License
## Credits
- Three.js - https://threejs.org/
- MediaPipe - https://mediapipe.dev/
- Rosebud AI - https://rosebud.ai/
- Tone.js - https://tonejs.github.io/
## Related Projects
You might also like some of my other open source projects:
- [3D Model Playground](https://collidingScopes.github.io/3d-model-playground) - control 3D models with voice and hand gestures
- [Threejs hand tracking tutorial](https://collidingScopes.github.io/threejs-handtracking-101) - Basic hand tracking setup with threejs and MediaPipe computer vision
- [Particular Drift](https://collidingScopes.github.io/particular-drift) - Turn photos into flowing particle animations
- [Liquid Logo](https://collidingScopes.github.io/liquid-logo) - Transform logos and icons into liquid metal animations
- [Video-to-ASCII](https://collidingScopes.github.io/ascii) - Convert videos into ASCII pixel art
## Contact
- Instagram: [@stereo.drift](https://www.instagram.com/stereo.drift/)
- Twitter/X: [@measure_plan](https://x.com/measure_plan)
- Email: [stereodriftvisuals@gmail.com](mailto:stereodriftvisuals@gmail.com)
- GitHub: [collidingScopes](https://github.com/collidingScopes)
## Donations
If you found this tool useful, feel free to buy me a coffee.
My name is Alan, and I enjoy building open source software for computer vision, games, and more. This would be much appreciated during late-night coding sessions!
[](https://www.buymeacoffee.com/stereoDrift)