https://github.com/brando90/ultimate-utils
Brando's utils
https://github.com/brando90/ultimate-utils
artificial-intelligence deep-learning machine-learning python
Last synced: over 1 year ago
JSON representation
Brando's utils
- Host: GitHub
- URL: https://github.com/brando90/ultimate-utils
- Owner: brando90
- License: mit
- Created: 2020-04-27T16:10:41.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2024-10-17T04:17:57.000Z (over 1 year ago)
- Last Synced: 2024-10-20T07:39:43.821Z (over 1 year ago)
- Topics: artificial-intelligence, deep-learning, machine-learning, python
- Language: Python
- Homepage:
- Size: 3.53 MB
- Stars: 11
- Watchers: 6
- Forks: 11
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Ultimate-utils
Ulitmate-utils (or uutils) is collection of useful code that Brando has collected through the years that has been useful accross his projects.
Mainly for machine learning and programming languages tasks.
## Installing Ultimate-utils
> WARNING: YOU HAVE TO INSTALL PYTORCH ON YOUR OWN (WITH CUDA IF YOU NEED A GPU)
# Installation [Dev]
To install with code do:
```bash
conda create -n uutils python=3.11 -y
conda activate uutils
# conda remove --all --name uutils
pip install -e ~/ultimate-utils
```
To install with venv do:
```bash
deactivate
mkdir ~/.virtualenvs
ls ~/.virtualenvs
python3.11 -m venv ~/.virtualenvs/uutils
# python3 -m venv ~/.virtualenvs/uutils
source ~/.virtualenvs/uutils/bin/activate
pip install --upgrade pip
which python
pip install -e ~/ultimate-utils
```
To test (any) pytorch do:
```bash
python -c "import uutils; uutils.torch_uu.gpu_test_torch_any_device()"
```
## Install vLLM
To install vllm:
```bash
# - Recommended vllm (it works with lora adapters)
# install all deps first
pip install -e ~/ultimate-utils
# right version for vllm lora
pip install torch==2.4.0
pip install vllm==0.5.5
# make sure the local lib is installed
pip install -e ~/ultimate-utils --no-deps
# [Optional] make sure you really have the right torch and vllm version
pip list | grep vllm
pip list | grep torch
pip install torch==2.4.0
pip install vllm==0.5.5
# test vllm lora (for unsloth to work since merge save doesn't seem to work)
python ~/ultimate-utils/experiments/experiments/2024/september/vllm_lora_test.py
# save env now (given how fragile it can be if it works)
pip freeze > ~/ultimate-utils/requirements.txt
# # - Install vllm
# # FAILED: bellow failed to install vllm with uutils first installing it with default setup.py then
# # pip install --upgrade pip
# # pip install torch==2.2.1
# # pip install vllm==0.4.1
# # - Installed vllm on skampere1
# pip install --upgrade pip
# pip uninstall torchvision vllm vllm-flash-attn flash-attn xformers
# pip install torch==2.2.1 vllm==0.4.1
# # fails install
# # pip install flash-attn==2.6.3
```
## Pushing to pypi
For full details see
```bash
~/ultimate-utils/tutorials_for_myself/pushing_to_pypi/README.md
```
For quick push do:
```bash
cd ~/ultimate-utils/
rm -rf build
rm -rf dist
cd ~/ultimate-utils/
python setup.py sdist bdist_wheel
twine check dist/*
twine upload dist/*
```
then:
```bash
cd ~/ultimate-utils/
rm -rf build
rm -rf dist
```