{"id":17756186,"url":"https://github.com/intel/openvino-plugins-ai-audacity","last_synced_at":"2025-03-15T06:32:35.985Z","repository":{"id":195810992,"uuid":"688195394","full_name":"intel/openvino-plugins-ai-audacity","owner":"intel","description":"A set of AI-enabled effects, generators, and analyzers for Audacity®.","archived":false,"fork":false,"pushed_at":"2024-04-12T18:53:58.000Z","size":4281,"stargazers_count":539,"open_issues_count":36,"forks_count":25,"subscribers_count":21,"default_branch":"main","last_synced_at":"2024-04-13T22:57:39.840Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/intel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.txt","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"security.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-09-06T21:10:29.000Z","updated_at":"2024-07-22T15:40:10.646Z","dependencies_parsed_at":"2024-03-07T23:23:15.356Z","dependency_job_id":"7429e765-ab3f-4746-8a76-1a9699093482","html_url":"https://github.com/intel/openvino-plugins-ai-audacity","commit_stats":null,"previous_names":["intel/openvino-plugins-ai-audacity"],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fopenvino-plugins-ai-audacity","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fopenvino-plugins-ai-audacity/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fopenvino-plugins-ai-audacity/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fopenvino-plugins-ai-audacity/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/intel","download_url":"https://codeload.github.com/intel/openvino-plugins-ai-audacity/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243695454,"owners_count":20332622,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-26T16:00:37.865Z","updated_at":"2025-03-15T06:32:35.979Z","avatar_url":"https://github.com/intel.png","language":"C++","funding_links":[],"categories":["C++","Table of content"],"sub_categories":["AI Audio"],"readme":"# OpenVINO™ AI Plugins for Audacity* :metal:\n![updated_audacity_top_level](https://github.com/user-attachments/assets/f7c911db-fb98-43ff-972d-f66473b4c921)\n[![License: GPL v3](https://img.shields.io/badge/License-GPL%20v3-blue.svg)](https://www.gnu.org/licenses/gpl-3.0) [![Mentioned in Awesome OpenVINO](https://awesome.re/mentioned-badge-flat.svg)](https://github.com/openvinotoolkit/awesome-openvino)\n\nA set of AI-enabled effects, generators, and analyzers for [Audacity®](https://www.audacityteam.org/). These AI features run 100% locally on your PC :computer: -- no internet connection necessary! [OpenVINO™](https://github.com/openvinotoolkit/openvino) is used to run AI models on supported accelerators found on the user's system such as CPU, GPU, and NPU.\n\n- [**Music Separation**](doc/feature_doc/music_separation/README.md):musical_note: -- Separate a mono or stereo track into individual stems -- Drums, Bass, Vocals, \u0026 Other Instruments. \n- [**Noise Suppression**](doc/feature_doc/noise_suppression/README.md):broom: -- Removes background noise from an audio sample.\n- [**Music Generation \u0026 Continuation**](doc/feature_doc/music_generation/README.md):notes: -- Uses MusicGen LLM to generate snippets of music, or to generate a continuation of an existing snippet of music.\n- [**Whisper Transcription**](doc/feature_doc/whisper_transcription/README.md):microphone: -- Uses [whisper.cpp](https://github.com/ggerganov/whisper.cpp) to generate a label track containing the transcription or translation for a given selection of spoken audio or vocals.\n- [**Super Resolution**](doc/feature_doc/super_resolution/README.md):sparkles: -- Upscales and enriches audio for improved clarity and detail.\n\n## Installation :floppy_disk: \n  Go [here](https://github.com/intel/openvino-plugins-ai-audacity/releases) to find installation packages \u0026 instructions for the latest Windows release. \n\n## Build Instructions :hammer:\n  - [Windows Build Instructions](doc/build_doc/windows/README.md)  \n  - [Linux Build Instructions](doc/build_doc/linux/README.md)\n\n## Help, Feedback, \u0026 Bug Reports 🙋‍♂️\n  We welcome you to submit an issue [here](https://github.com/intel/openvino-plugins-ai-audacity/issues) for\n  * Questions\n  * Bug Reports\n  * Feature Requests\n  * Feedback of any kind -- how can we improve this project?\n    \n## Contribution :handshake:\n  Your contributions are welcome and valued, no matter how big or small. Feel free to submit a pull-request!\n\n## Acknowledgements \u0026 Citations :pray:\n* Audacity® development team \u0026 Muse Group-- Thank you for your support!  \n* Audacity® GitHub -- https://github.com/audacity/audacity  \n* Whisper transcription \u0026 translation analyzer uses whisper.cpp (with OpenVINO™ backend): https://github.com/ggerganov/whisper.cpp  \n* Music Generation \u0026 Continuation use MusicGen model, from Meta.\n  - We currently have support for [MusicGen-Small](https://huggingface.co/facebook/musicgen-small), and [MusicGen-Small-Stereo](https://huggingface.co/facebook/musicgen-stereo-small)\n  - The txt-to-music pipelines were ported from python to C++, referencing logic from the Hugging Face transformers project: https://github.com/huggingface/transformers \n* Music Separation effect uses Meta's Demucs v4 model (https://github.com/facebookresearch/demucs), which has been ported to work with OpenVINO™\n* Noise Suppression:\n  * noise-suppression-denseunet-ll:  from OpenVINO™'s Open Model Zoo: https://github.com/openvinotoolkit/open_model_zoo   \n  * DeepFilterNet2 \u0026 DeepFilterNet3:\n    * Ported the models \u0026 pipeline from here: https://github.com/Rikorose/DeepFilterNet  \n    * We also made use of @grazder's fork / branch (https://github.com/grazder/DeepFilterNet/tree/torchDF-changes) to better understand the Rust implementation, and so we also based some of our C++ implementation on ```torch_df_offline.py``` found here.  \n    * Citations:\n      ```bibtex\n      @inproceedings{schroeter2022deepfilternet2,\n      title = {{DeepFilterNet2}: Towards Real-Time Speech Enhancement on Embedded Devices for Full-Band Audio},\n      author = {Schröter, Hendrik and Escalante-B., Alberto N. and Rosenkranz, Tobias and Maier, Andreas},\n      booktitle={17th International Workshop on Acoustic Signal Enhancement (IWAENC 2022)},\n      year = {2022},\n      }\n        \n      @inproceedings{schroeter2023deepfilternet3,\n      title = {{DeepFilterNet}: Perceptually Motivated Real-Time Speech Enhancement},\n      author = {Schröter, Hendrik and Rosenkranz, Tobias and Escalante-B., Alberto N. and Maier, Andreas},\n      booktitle={INTERSPEECH},\n      year = {2023},\n      }\n      ```\n* Super Resolution feature is a port (python -\u003e C++, pytorch -\u003e OpenVINO IR) of this project: https://github.com/haoheliu/versatile_audio_super_resolution\n  * Citations:\n    ```bibtex\n    @article{liu2023audiosr,\n    title={{AudioSR}: Versatile Audio Super-resolution at Scale},\n    author={Liu, Haohe and Chen, Ke and Tian, Qiao and Wang, Wenwu and Plumbley, Mark D},\n    journal={arXiv preprint arXiv:2309.07314},\n    year={2023}\n    }\n    ```\n* [OpenVINO™ Notebooks](https://github.com/openvinotoolkit/openvino_notebooks) -- We have learned a lot from this awesome set of python notebooks, and are still using it to learn latest / best practices for implementing AI pipelines using OpenVINO™!\n  \n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fintel%2Fopenvino-plugins-ai-audacity","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fintel%2Fopenvino-plugins-ai-audacity","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fintel%2Fopenvino-plugins-ai-audacity/lists"}