https://github.com/answerdotai/bitlora
Experimental q[X]ora kernel development code
https://github.com/answerdotai/bitlora
Last synced: 4 months ago
JSON representation
Experimental q[X]ora kernel development code
- Host: GitHub
- URL: https://github.com/answerdotai/bitlora
- Owner: AnswerDotAI
- Created: 2024-04-18T16:49:56.000Z (almost 2 years ago)
- Default Branch: master
- Last Pushed: 2024-06-13T13:22:01.000Z (over 1 year ago)
- Last Synced: 2025-10-02T07:29:54.742Z (4 months ago)
- Language: Jupyter Notebook
- Homepage:
- Size: 5.35 MB
- Stars: 3
- Watchers: 5
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# bitlora (work-in-progress)
Experimental implementations exploring feasibility, usefulness, and performance of dedicated q[X]ora kernels.
Being exploratory, this repository is not recommended for external use except by collaboratoring researchers.
| Directory | Description |
| --------- | ------------|
| evals/ | Evaluation harnesses to measure quality effects of quantization |
| exploratory/ | Scripts and notebooks for reproductions, experimentation |
| kernels/ | Triton and CUDA kernel implementations |
| models/ | Training and inference code for reference quantized models |
# Contact
Collaborators welcome. Please reach out to us - @umerHA @austinvhuang if interested!