Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/meething/meething-ml-camera

Machine-Learning powered Virtual Camera with SVG Animation (alpha)
https://github.com/meething/meething-ml-camera

animation camera conference dwebrtc facemesh machine-learning meething pose privacy privacy-protection virtual-camera webrtc

Last synced: 15 days ago
JSON representation

Machine-Learning powered Virtual Camera with SVG Animation (alpha)

Host: GitHub
URL: https://github.com/meething/meething-ml-camera
Owner: meething
License: apache-2.0
Created: 2020-05-25T13:11:10.000Z (over 4 years ago)
Default Branch: master
Last Pushed: 2022-03-26T18:57:31.000Z (almost 3 years ago)
Last Synced: 2024-04-16T11:27:42.665Z (9 months ago)
Topics: animation, camera, conference, dwebrtc, facemesh, machine-learning, meething, pose, privacy, privacy-protection, virtual-camera, webrtc
Language: JavaScript
Homepage: https://web.meething.space
Size: 6.75 MB
Stars: 74
Watchers: 8
Forks: 13
Open Issues: 3
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

mozilla-builders

### Meething : Machine-Learning Camera
Machine-Learning powered Virtual MediaDevice extension for any browser-based conferencing service.

![ezgif com-optimize (66)](https://user-images.githubusercontent.com/1423657/83061179-de958e00-a05c-11ea-844f-141f55d4e092.gif)

Behind the scenes, the actual camera frames are being processed by PoseNet and FaceMesh producing coordinates used to animate an [SVG Character](https://github.com/yemount/pose-animator) which replaces the camera output, never streaming your real image.

#### Usage
To test the model without installing any extension, run the following or use glitch:
```
npm install
npm run build
npm start
```

#### Usage as Extension (alpha)
Nothing to compile if you want to use the extension - Follow the instructions to install in your preferred browser:

##### Chromium
* download or clone the repo
* go to chrome://extensions
* enable Developer Mode
* Load unpacked
* Browse to the `dist` folder with the extension (where the `manifest.json` file is)

##### Firefox
* download or clone the repo
* go to about:debugging#/runtime/this-firefox
* Click _"Load Temporary Add-on..."_
* Browse to the `dist` folder with the extension and select the `manifest.json` file

#### Usage without Extension
If you want to use this without extension, try our decentralized conference project [Meething](https://github.com/meething/meething)

#### Credits
This humble _hack-speriment_ would not be possible without the following projects:
* [Virtual Browser Camera shaders](https://github.com/spite/virtual-webcam) by [spite](https://github.com/spite)
* [Pose Animator](https://github.com/yemount/pose-animator) by [yemount](https://github.com/yemount)
* [Meething](https://us.meething.space) by [Team Meething](https://github.com/meething/meething/graphs/contributors)