{"id":20681560,"url":"https://github.com/googlecreativelab/creatability-seeing-music","last_synced_at":"2025-04-05T23:10:15.624Z","repository":{"id":44003421,"uuid":"179125275","full_name":"googlecreativelab/creatability-seeing-music","owner":"googlecreativelab","description":"Experience music visually.","archived":false,"fork":false,"pushed_at":"2025-02-13T04:26:34.000Z","size":83113,"stargazers_count":107,"open_issues_count":26,"forks_count":16,"subscribers_count":11,"default_branch":"master","last_synced_at":"2025-03-29T22:07:59.710Z","etag":null,"topics":["magenta-js","music","tensorflowjs","tonejs","visualization","webrtc"],"latest_commit_sha":null,"homepage":"https://experiments.withgoogle.com/seeing-music","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/googlecreativelab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-04-02T17:20:11.000Z","updated_at":"2025-03-22T00:16:03.000Z","dependencies_parsed_at":"2025-02-27T21:34:03.310Z","dependency_job_id":null,"html_url":"https://github.com/googlecreativelab/creatability-seeing-music","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/googlecreativelab%2Fcreatability-seeing-music","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/googlecreativelab%2Fcreatability-seeing-music/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/googlecreativelab%2Fcreatability-seeing-music/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/googlecreativelab%2Fcreatability-seeing-music/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/googlecreativelab","download_url":"https://codeload.github.com/googlecreativelab/creatability-seeing-music/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247411235,"owners_count":20934653,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["magenta-js","music","tensorflowjs","tonejs","visualization","webrtc"],"created_at":"2024-11-16T22:11:17.362Z","updated_at":"2025-04-05T23:10:15.608Z","avatar_url":"https://github.com/googlecreativelab.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"Seeing Music is part of [Creatability](https://experiments.withgoogle.com/collection/creatability) which explores how creative tools can be made more accessible for everyone. The live site can be [found here](https://creatability.withgoogle.com/seeing-music/).\n\n# Overview\n\nSeeing Music is a tool for visualizing music. You can turn on your mic to sing or play sounds. You can also drop in your own audio or video file. Some modes – like Hilbert Scope and Spectrogram – show the subtle textures of sound while others show the paths and shapes of different melodies.\n\nUse **Basic Mode** to visualize monophonic music such as a human voice. Use **Piano Mode** to visualize polyphonic music such as piano recordings. You can also use Piano Mode to visualize a live performance using a MIDI keyboard.\n\nThe pitch detection is based on [this code](https://github.com/peterkhayes/pitchfinder). The Hilbert Scope is based on [this code](https://github.com/conundrumer/audioscope). The piano transcription is built with [Onsets and Frames](https://magenta.tensorflow.org/onsets-frames), a machine learning model made by the Magenta team at Google.\n\n# Install and Run\n\nTo install and run make sure you have node.js and npm\n\n```bash\nnpm install\nnpm run start\n```\n\nThis will bundle all of the javascript files and start a local server on port 8080. Now to access the site you can visit http://localhost:8080/build\n\n# Tools\n\n* [Creatability Components](https://github.com/googlecreativelab/creatability-components)\n* [Audioscope](https://github.com/conundrumer/audioscope)\n* [PitchFinder](https://github.com/peterkhayes/pitchfinder)\n* [Tone.js](https://github.com/Tonejs/Tone.js)\n* [Magenta.js](https://github.com/tensorflow/magenta-js)\n\n# Credits\n\nThis experiment was made by Jay Alan Zimmerman, Yotam Mann, Claire Kearney-Volpe, Luisa Pereira, Kyle Phillips, and Google Creative Lab. Music performed by Jacquelyn Briggs (voice), Sam Posner (saxophone), Matt Lewcowicz (guitar), Melissa Tong (violin), and Jonathan Singer (tabla). Special thanks to Hanna Ehrenberg, Julia Silvestri, and our friends at Henry Viscardi School at The Viscardi Center, Tech Kids Unlimited, and ADAPT Community Network.\n\n# License\n\nCopyright 2019 Google LLC\n\nThis program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License version 3 as published by the Free Software Foundation. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.\n\nThis is an experiment, not an official Google product. We’ll do our best to support and maintain this experiment but your mileage may vary.\n\nWe encourage open sourcing projects as a way of learning from each other. Please respect our and other creators’ rights, including copyright and trademark rights when present, when sharing these works and creating derivative work. If you want more info on Google's policy, you can find that [here](https://www.google.com/permissions/).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecreativelab%2Fcreatability-seeing-music","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fgooglecreativelab%2Fcreatability-seeing-music","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fgooglecreativelab%2Fcreatability-seeing-music/lists"}