{"id":17986877,"url":"https://github.com/brando90/ultimate-utils","last_synced_at":"2025-03-25T22:31:07.367Z","repository":{"id":39591831,"uuid":"259384488","full_name":"brando90/ultimate-utils","owner":"brando90","description":"Brando's utils","archived":false,"fork":false,"pushed_at":"2024-10-17T04:17:57.000Z","size":3699,"stargazers_count":11,"open_issues_count":0,"forks_count":11,"subscribers_count":6,"default_branch":"master","last_synced_at":"2024-10-20T07:39:43.821Z","etag":null,"topics":["artificial-intelligence","deep-learning","machine-learning","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/brando90.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-04-27T16:10:41.000Z","updated_at":"2024-10-17T04:18:00.000Z","dependencies_parsed_at":"2023-09-27T22:44:14.872Z","dependency_job_id":"2c362f95-78f1-43bf-8580-98b77aae1ab9","html_url":"https://github.com/brando90/ultimate-utils","commit_stats":{"total_commits":928,"total_committers":16,"mean_commits":58.0,"dds":"0.22844827586206895","last_synced_commit":"1c163185a73cd2951e3024a9f1823fcfbf30b33d"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brando90%2Fultimate-utils","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brando90%2Fultimate-utils/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brando90%2Fultimate-utils/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/brando90%2Fultimate-utils/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/brando90","download_url":"https://codeload.github.com/brando90/ultimate-utils/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":222093828,"owners_count":16930192,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","deep-learning","machine-learning","python"],"created_at":"2024-10-29T18:43:08.994Z","updated_at":"2024-10-29T18:43:09.545Z","avatar_url":"https://github.com/brando90.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Ultimate-utils\n\nUlitmate-utils (or uutils) is collection of useful code that Brando has collected through the years that has been useful accross his projects.\nMainly for machine learning and programming languages tasks.\n\n## Installing Ultimate-utils\n\n\u003e WARNING: YOU HAVE TO INSTALL PYTORCH ON YOUR OWN (WITH CUDA IF YOU NEED A GPU)\n\n# Installation [Dev]\n\nTo install with code do: \n```bash\nconda create -n uutils python=3.11 -y\nconda activate uutils\n# conda remove --all --name uutils\n\npip install -e ~/ultimate-utils\n```\n\nTo install with venv do:\n```bash\ndeactivate\nmkdir ~/.virtualenvs\nls ~/.virtualenvs\npython3.11 -m venv ~/.virtualenvs/uutils\n# python3 -m venv ~/.virtualenvs/uutils\nsource ~/.virtualenvs/uutils/bin/activate\npip install --upgrade pip\nwhich python\n\npip install -e ~/ultimate-utils\n```\n\nTo test (any) pytorch do:\n```bash\npython -c \"import uutils; uutils.torch_uu.gpu_test_torch_any_device()\"\n```\n\n## Install vLLM\n\nTo install vllm:\n```bash\n# - Recommended vllm (it works with lora adapters)\n# install all deps first\npip install -e ~/ultimate-utils\n# right version for vllm lora \npip install torch==2.4.0\npip install vllm==0.5.5 \n# make sure the local lib is installed\npip install -e ~/ultimate-utils --no-deps\n# [Optional] make sure you really have the right torch and vllm version\npip list | grep vllm\npip list | grep torch\npip install torch==2.4.0\npip install vllm==0.5.5 \n# test vllm lora (for unsloth to work since merge save doesn't seem to work)\npython ~/ultimate-utils/experiments/experiments/2024/september/vllm_lora_test.py\n# save env now (given how fragile it can be if it works)\npip freeze \u003e ~/ultimate-utils/requirements.txt\n\n# # - Install vllm\n# # FAILED: bellow failed to install vllm with uutils first installing it with default setup.py then \n# # pip install --upgrade pip\n# # pip install torch==2.2.1\n# # pip install vllm==0.4.1\n# # - Installed vllm on skampere1\n# pip install --upgrade pip\n# pip uninstall torchvision vllm vllm-flash-attn flash-attn xformers\n# pip install torch==2.2.1 vllm==0.4.1 \n# # fails install\n# # pip install flash-attn==2.6.3\n```\n\n## Pushing to pypi\nFor full details see\n```bash\n~/ultimate-utils/tutorials_for_myself/pushing_to_pypi/README.md\n```\nFor quick push do:\n```bash\ncd ~/ultimate-utils/\nrm -rf build\nrm -rf dist\ncd ~/ultimate-utils/\npython setup.py sdist bdist_wheel\ntwine check dist/*\ntwine upload dist/*\n```\nthen:\n```bash\ncd ~/ultimate-utils/\nrm -rf build\nrm -rf dist\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrando90%2Fultimate-utils","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbrando90%2Fultimate-utils","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbrando90%2Fultimate-utils/lists"}