https://github.com/ate329/sentimusic

A text-to-audio application that turns words and sentiments into melodies.
https://github.com/ate329/sentimusic

audiocraft huggingface-transformers music music-composition musicgen phi2 python pytorch sentiment sentiment-analysis tensorflow text-to-audio transformers twitter-roberta-base-sentiment twitter-sentiment-analysis

Last synced: 7 months ago
JSON representation

A text-to-audio application that turns words and sentiments into melodies.

• Host: GitHub
• URL: https://github.com/ate329/sentimusic
• Owner: Ate329
• License: mit
• Created: 2024-02-23T09:45:10.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-11-10T12:06:46.000Z (12 months ago)
• Last Synced: 2025-03-23T21:45:56.122Z (7 months ago)
• Topics: audiocraft, huggingface-transformers, music, music-composition, musicgen, phi2, python, pytorch, sentiment, sentiment-analysis, tensorflow, text-to-audio, transformers, twitter-roberta-base-sentiment, twitter-sentiment-analysis
• Language: Python
• Homepage:
• Size: 3.38 MB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# SentiMusic

***This project should be running with Python 3.9 (only if you want to use AudioCraft) or higher***

SentiMusic is an innovative project that bridges the gap between your emotions and the music. It utilises the power of artificial intelligence to transform the sentiment of your text into a unique and personalised musical piece.

1. Input a sentence, a paragraph or a story.

2. SentiMusic analyses the sentiment of your text.

3. Based on the emotions it finds, SentiMusic creates a unique piece of music that reflects your words.

## Here is a graph showing how it works

![SentiMusicGraph drawio](https://github.com/Ate329/SentiMusic/assets/74974216/cffbb033-2b13-4e60-bd22-2fbda0b7f88f)  

This graph is created by using [draw.io](https://app.diagrams.net)  

## Video

Here is a video to introduce this project [SentiMusic](https://youtu.be/uqk_niZ5mSs?si=hfDz3VbO2y89n8Qv)  

## Models used

[cardiffnlp/twitter-roberta-base-sentiment-latest](https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest)  

[microsoft/phi-2](https://huggingface.co/microsoft/phi-2)  

[facebook/musicgen-small](https://huggingface.co/facebook/musicgen-small)  

## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.