https://github.com/waikato-llm/xtuner
Docker images for the XTuner library for tuning large language models.
https://github.com/waikato-llm/xtuner
fine-tuning llm xtuner
Last synced: 12 months ago
JSON representation
Docker images for the XTuner library for tuning large language models.
- Host: GitHub
- URL: https://github.com/waikato-llm/xtuner
- Owner: waikato-llm
- License: apache-2.0
- Created: 2024-02-18T22:21:45.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-04-22T21:33:52.000Z (about 2 years ago)
- Last Synced: 2025-03-01T20:29:42.984Z (over 1 year ago)
- Topics: fine-tuning, llm, xtuner
- Language: Python
- Homepage: https://github.com/InternLM/xtuner
- Size: 65.4 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# xtuner
Docker images for the [XTuner library](https://github.com/InternLM/xtuner) for tuning large language models.
Available versions:
* [0.1.18 (CUDA 11.7)](0.1.18_cuda11.7)
* [0.1.15 (CUDA 11.7)](0.1.15_cuda11.7)
* [2024-02-19 (CUDA 11.7)](2024-02-19_cuda11.7)
* [0.1.14 (CUDA 11.7)](0.1.14_cuda11.7)
## Huggingface restricted access
In case models or datasets require being logged into Huggingface, you can give your
Docker container access via an access token.
### Create access token
In order to create an access token, do the following:
- Log into https://huggingface.co
- Go to *Settings* -> *Access tokens*
- Create a token (*read* access is sufficient, unless you want to push models back to huggingface)
- Copy the token onto the clipboard
- Save the token in a [.env file](https://hexdocs.pm/dotenvy/0.2.0/dotenv-file-format.html), using `HF_TOKEN` as the variable name
### Provide token to container
Add the following parameter to make all the environment variables stored in the `.env` file in
the current directory available to your Docker container:
```
--env-file=`pwd`/.env
```
### Log into Huggingface
With the `HF_TOKEN` environment variable set, you can now log into Huggingface inside your Docker
container using the following command:
```
huggingface-cli login --token=$HF_TOKEN
```