Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/GuoYiFantastic/IMelodist

Music large model based on InternLM2-chat.
https://github.com/GuoYiFantastic/IMelodist

Last synced: about 1 month ago
JSON representation

Music large model based on InternLM2-chat.

Awesome Lists containing this project

README

        

# [旋律大师-IMelodist](#-快速体验)

Melodist ABC-notation music model based on InternLM2-chat.

> _Music is a higher revelation than all wisdom and philosophy._ — Ludwig van Beethoven

[📖Technical Report](assets/TechnicalReport/) |
[🌐Video Demo](https://www.bilibili.com/video/BV13j421o7nZ/?spm_id_from=333.999.0.0&vd_source=ed4c533bf4cce5e0d0329d8c60182037) |
[🎼IMelodist-app](https://openxlab.org.cn/apps/detail/EchoPeter/IMelodist-app)

[![Open in OpenXLab](https://cdn-static.openxlab.org.cn/header/openxlab_models.svg)](https://openxlab.org.cn/models/detail/EchoPeter/IMelodist)
[![HF Model](https://img.shields.io/badge/Models-Models?style=flat&logoColor=%235c5c5c&label=%F0%9F%A4%97Huggingface&color=%23d9b125)]()
[![HF Dataset Increment](https://img.shields.io/badge/Datasets(increment)-Datasets?style=flat&logoColor=%235c5c5c&label=%F0%9F%A4%97Huggingface&color=%23d9b125)](https://huggingface.co/datasets/PommesPeter/imelodist-increment)
[![HF Dataset SFT](https://img.shields.io/badge/Datasets(sft)-Datasets?style=flat&logoColor=%235c5c5c&label=%F0%9F%A4%97Huggingface&color=%23d9b125)](https://huggingface.co/datasets/PommesPeter/imelodist-sft)

《旋律大师-IMelodist》项目获上海人工智能实验室主办的2024浦源大模型系列挑战赛春季赛创新创意奖!!!

![image](https://github.com/user-attachments/assets/c05d57a6-b85f-4878-8536-b4da826458c7)

## 📝 目录

- [🥰 快速体验](#-快速体验)
- [🤖 模型架构](#-模型架构)
- [🛠️ 本地运行](#-本地运行)
* [安装依赖](#-安装依赖)
* [下载模型](#-下载模型)
* [运行 Web Demo](####-运行-Web-Demo)
- [📄 项目相关资源和消息](#-项目相关资源和消息)
- [❤️ 致谢](#-致谢)
- [🖊️ 引用](#-BibTeX-entry-and-citation-info)
- [🧾 开源许可证](#-开源许可证)

## 🥰 快速体验
已部署在[openXLab](https://openxlab.org.cn/apps/detail/EchoPeter/IMelodist-app)上啦,若应用休眠,请点击`重新启动`后耐心等待。
![image](https://github.com/GuoYiFantastic/IMelodist/assets/130634988/3b6a6b25-a640-487d-ba76-c56e710562b5)

## 🤖 模型架构

## 本地运行

#### 安装依赖

```shell
# 此处我们使用的环境是 Ubuntu 20.04, 其他系统自行寻找相应的库安装
sudo xargs -r -a packages.txt apt-get install -y
pip install -r requirements.txt
```
#### 下载模型

提供了两种下载方式:

- 从 OpenXLab 上下载
```shell
git lfs install
git clone https://code.openxlab.org.cn/EchoPeter/IMelodist.git
```

或者

参考 [下载模型](https://openxlab.org.cn/docs/models/%E4%B8%8B%E8%BD%BD%E6%A8%A1%E5%9E%8B.html) 。

```bash
pip install openxlab
```

```python
from openxlab.model import download
download(model_repo='EchoPeter/IMelodist',
model_name='IMelodist', output='./')
```

- 从 Modelscope 下载
参考 [模型的下载](https://www.modelscope.cn/docs/%E6%A8%A1%E5%9E%8B%E7%9A%84%E4%B8%8B%E8%BD%BD) 。

```bash
pip install modelscope
```

```python
from modelscope.hub.snapshot_download import snapshot_download
model_dir = snapshot_download('PommesPeter/IMelodist-chat-7b', cache_dir='./')
```

#### 运行 Web Demo

将 [IMelodist_demo.py](https://github.com/GuoYiFantastic/IMelodist/blob/main/chat/IMelodist_demo.py) 文件中第42行的 `model_path` 改成本地 IMelodist **模型**所在路径后,运行以下指令。

```shell
# 确保terminal所在位置为repo主目录
streamlit run chat/IMelodist_demo.py --server.address=0.0.0.0 --server.port 7860
```

## 📄 项目相关资源和消息
- **[2024/3]** 2024浦源大模型系列挑战赛(春季赛)|创新创意奖 [GDC2024](https://mp.weixin.qq.com/s/RkYYSGpDVznRhDjC0KQnzQ)
- **[2024/3]** 推送分享 [InternLM](),[机智流](https://mp.weixin.qq.com/s/_wm04eYxzh-05czEb5ZggA)
- **[2024/3/17]** 书生·浦语 训练营 SIG小组 圆桌分享 [[视频](https://www.bilibili.com/video/BV1xr421n7MA/?vd_source=ed4c533bf4cce5e0d0329d8c60182037), [slide](https://github.com/GuoYiFantastic/IMelodist/blob/main/assets/TechnicalReport/IMelodist_0317%E5%9C%86%E6%A1%8C%E5%88%86%E4%BA%AB.pdf)]

## ❤️ 致谢

- 感谢 [**上海人工智能实验室**](https://www.shlab.org.cn) 举办的各项赛事和活动~
- 感谢 [**书生·浦语开源实训营**](https://github.com/InternLM) 的技术指导以及算力支持~
- 感谢 **OpenXLab** 对项目部署的算力支持~
- 感谢 **浦语小助手** 对项目的支持~
- 感谢 [**sander-wood**](https://huggingface.co/datasets/sander-wood/irishman) 和 [**m-a-p**](https://huggingface.co/m-a-p) 的开源数据集
- [**InternLM-tutorial**](https://github.com/InternLM/tutorial)、[**InternStudio**](https://studio.intern-ai.org.cn/)、[**xtuner**](https://github.com/InternLM/xtuner)

## 贡献者



## 星矢😆

[![Star History Chart](https://api.star-history.com/svg?repos=GuoYiFantastic/IMelodist&type=Date)](https://star-history.com/#GuoYiFantastic/IMelodist&Date)

## BibTeX entry and citation info

```bibtex
@inproceedings{DBLP:conf/hcmir/WuLY023,
author = {Shangda Wu and
Xiaobing Li and
Feng Yu and
Maosong Sun},
editor = {Lorenzo Porcaro and
Roser Batlle{-}Roca and
Emilia G{\'{o}}mez},
title = {TunesFormer: Forming Irish Tunes with Control Codes by Bar Patching},
booktitle = {Proceedings of the 2nd Workshop on Human-Centric Music Information
Retrieval 2023 co-located with the 24th International Society for
Music Information Retrieval Conference {(ISMIR} 2023), Milan, Italy,
November 10, 2023},
series = {{CEUR} Workshop Proceedings},
volume = {3528},
publisher = {CEUR-WS.org},
year = {2023},
url = {https://ceur-ws.org/Vol-3528/paper1.pdf},
timestamp = {Tue, 19 Dec 2023 17:15:12 +0100},
biburl = {https://dblp.org/rec/conf/hcmir/WuLY023.bib},
bibsource = {dblp computer science bibliography, https://dblp.org}
}
```
```bibtex
@misc{yuan2024chatmusician,
title={ChatMusician: Understanding and Generating Music Intrinsically with LLM},
author={Ruibin Yuan and Hanfeng Lin and Yi Wang and Zeyue Tian and Shangda Wu and Tianhao Shen and Ge Zhang and Yuhang Wu and Cong Liu and Ziya Zhou and Ziyang Ma and Liumeng Xue and Ziyu Wang and Qin Liu and Tianyu Zheng and Yizhi Li and Yinghao Ma and Yiming Liang and Xiaowei Chi and Ruibo Liu and Zili Wang and Pengfei Li and Jingcheng Wu and Chenghua Lin and Qifeng Liu and Tao Jiang and Wenhao Huang and Wenhu Chen and Emmanouil Benetos and Jie Fu and Gus Xia and Roger Dannenberg and Wei Xue and Shiyin Kang and Yike Guo},
year={2024},
eprint={2402.16153},
archivePrefix={arXiv},
primaryClass={cs.SD}
```

```bibtex
@misc{2024imelodist,
title={IMelodist: Music Large Language Model from Internlm2-7B finetuning},
author={IMelodist Contributor},
year={2024},
url={https://github.com/GuoYiFantastic/IMelodist}
}
```

## 🧾 开源许可证

该项目采用 Apache License 2.0 开源许可证 同时,请遵守所使用的模型与数据集的许可证。