{"id":23907496,"url":"https://github.com/loustoc/sentiers-aveugles","last_synced_at":"2026-05-08T14:50:22.853Z","repository":{"id":246319718,"uuid":"820678713","full_name":"Loustoc/sentiers-aveugles","owner":"Loustoc","description":"2nd Year project at Gobelins Paris - Sound mapping using Kinect v1, Three.JS and M5StickC-Plus","archived":false,"fork":false,"pushed_at":"2024-06-27T05:06:19.000Z","size":28832,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-23T14:43:04.979Z","etag":null,"topics":["art","bluetooth","computer-vision","electron","hardware","installation","interactive","kinect","libfreenect","osc","threejs"],"latest_commit_sha":null,"homepage":"","language":"C","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Loustoc.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-27T00:53:43.000Z","updated_at":"2025-01-28T14:55:18.000Z","dependencies_parsed_at":"2024-06-27T06:39:15.098Z","dependency_job_id":null,"html_url":"https://github.com/Loustoc/sentiers-aveugles","commit_stats":null,"previous_names":["loustoc/sentiers-aveugles"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Loustoc/sentiers-aveugles","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Loustoc%2Fsentiers-aveugles","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Loustoc%2Fsentiers-aveugles/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Loustoc%2Fsentiers-aveugles/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Loustoc%2Fsentiers-aveugles/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Loustoc","download_url":"https://codeload.github.com/Loustoc/sentiers-aveugles/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Loustoc%2Fsentiers-aveugles/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260194807,"owners_count":22972643,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["art","bluetooth","computer-vision","electron","hardware","installation","interactive","kinect","libfreenect","osc","threejs"],"created_at":"2025-01-05T03:12:22.759Z","updated_at":"2026-05-08T14:50:17.818Z","avatar_url":"https://github.com/Loustoc.png","language":"C","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Sentiers Aveugles \u003cspan style=\"font-size:0.5em;\"\u003e(Blind Paths)\u003c/span\u003e\n\nFinal Year Project / POC of my 2nd Year at Gobelins - Paris. \u003cbr/\u003e\n**Theme :** `The 5 Senses and the 4 Elements`. \u003cbr/\u003e\n\n---\n\nA defined area is subdivided in a (by default 3x3) grid, each subdivision then having a random sound mapped onto it. \u003cbr/\u003e\nThe user's position in that space is calculated by weighting out the number of points in each subdivision, by depth and position on the X axis.\nThe gyroscope allows for the app to take full advantage of the Web Audio Spatialization API.\n\n**1. Building the Kinect App:** \u003cbr/\u003e\n\n```\ncd ./kinect\ncmake .\ncmake --build .\n```\n\n**2. Building and running the Electron app:** \u003cbr/\u003e\n\n```\ncd ../app\nnpm i\nnpm run start\n```\n\nYou should then see (by default) 9 spheres in a grid, along with a Sphere Mesh. The red section of the latter represents the eyes of the user.\u003cbr/\u003e\u003cbr/\u003e\n**3. Setting up and Connecting the M5StickC-Plus:** \u003cbr/\u003e\u003cbr/\u003e\nYou'll need the following libs :\n\n- [EasyButton](https:/github.com/evert-arias/EasyButton)\n- [OSC](https:/github.com/CNMAT/OSC)\n- [M5StickCPlus](https:/www.github.com/m5stack/M5StickC-Plus.git) \u003cbr/\u003e\n\nKeep in mind you'll need to add the M5Stack boards to your board manager, by using the following link :\n[Boards JSON](https://static-cdn.m5stack.com/resource/arduino/package_m5stack_index.json)\n\u003cbr/\u003e\u003cbr/\u003e\nAfter uploading the firmware to the board, you'll need to connect it to **the same WiFi network as the computer the apps run on**.\n\u003cbr/\u003e\nTo do this, install the BlueFruit Connect app: [Android](https:/play.google.com/store/apps/details?id=com.adafruit.bluefruit.le.connect) / [iOS](https:/apps.apple.com/us/app/bluefruit-connect/id830125974).\u003cbr/\u003e\u003cbr/\u003e\nThen, connect to the M5Stick. It should be called \"SentiersAveugles-Gyro-XX\".\nYou can now send your network info in that order (Check the M5Stick's screen for any error) :\n\n- SSID\n- PWD\n- Local IP Address of the computer (you can scan the QRCode on the electron app to get it)\n- OSC Port (default is 9419)\n  \u003cbr/\u003e\u003cbr/\u003e\n\n**4. Calibration:** \u003cbr/\u003e\n\n- Press `E`\n  on the Kinect App to calibrate the depth. This will allow the program to detect pixels that have changed depth (thus if something moved at that specific position), compared to a reference frame.\n- After ensuring the red section on the Sphere Mesh moves when rotating the gyroscope along the Z axis, click on the `A` button when the red section faces the left side. Then, strap the gyroscope onto the headphones, face the kinect, and press the `A` button again. You're now all set !\n\n## Additionnal Information\n\nI'm using the M5StickC-Plus solely for the fact that it packs a gyroscope/accelerometer, WiFi, Bluetooth and a battery, without the need to plug anything else in. Since it's based off a widely used chip, the ESP32, and that I'm not using any specific chip reliant functionnality, it should be fairly easy to adapt.\n\n## Shortcuts\n\n- Kinect App\n  - `E` : Calibration\n  - `O` and `P`: Decrease / Increase Depth Threshold\n  - `W` and `S`: Zoom in/out\n  - `V`: Reset Calibration and deactivate OSC connection\n- M5StickC-Plus\n  - `A`(Short-Press): Toggle OSC connection\n  - `A`(Long-Press): Reset Conections (Both OSC and WiFi, Bluetooth will remain)\n  - `B`(Long-Press): Turn ON/OFF\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Floustoc%2Fsentiers-aveugles","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Floustoc%2Fsentiers-aveugles","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Floustoc%2Fsentiers-aveugles/lists"}