Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/basalt-org/basalt
A Machine Learning framework from scratch in Pure Mojo 🔥
https://github.com/basalt-org/basalt
ai autograd deep-learning deep-neural-networks machine-learning ml mojo neural-network tensor
Last synced: 22 days ago
JSON representation
A Machine Learning framework from scratch in Pure Mojo 🔥
- Host: GitHub
- URL: https://github.com/basalt-org/basalt
- Owner: basalt-org
- License: other
- Created: 2023-10-21T14:29:25.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-04-13T21:44:12.000Z (8 months ago)
- Last Synced: 2024-04-13T21:55:26.639Z (8 months ago)
- Topics: ai, autograd, deep-learning, deep-neural-networks, machine-learning, ml, mojo, neural-network, tensor
- Language: Mojo
- Homepage:
- Size: 12.2 MB
- Stars: 156
- Watchers: 9
- Forks: 12
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: CODEOWNERS
Awesome Lists containing this project
- awesome-mojo - Basalt - A Machine Learning framework from scratch in Pure Mojo. (🗂️ Libraries / AI)
- awesome-max-mojo - Basalt - org/basalt?style=social"/> : A Machine Learning framework from scratch in Pure Mojo 🔥. Basalt is a stand-alone machine learning framework that leverages the power of Mojo. (Machine Learning)
- awesome-max-mojo - Basalt - org/basalt?style=social"/> : A Machine Learning framework from scratch in Pure Mojo 🔥. Basalt is a stand-alone machine learning framework that leverages the power of Mojo. (Machine Learning)
README
Basalt
A Machine Learning framework from scratch in pure Mojo 🔥
## About The Project
Basalt is a stand-alone machine learning framework that leverages the power of Mojo.
As [discussed](https://docs.modular.com/mojo/why-mojo) by Modular, Mojo is a language for the future of AI development. Built on top of MLIR technology, rather than existing GCC and LLVM approaches, Mojo looks and feels like Python code, yet performs much closer to languages like Rust or C++. Parametric functions and compile time parameters allow for the graph to statically compiled. Having the static graph allows for much harder performance optimizations.
Basalt, while still in its infancy, is able to achieve speeds comparable to well established frameworks like Pytorch. Below a snapshot of the current benchmarks. But keep posted, there is much more room for improvement and we are upgrading the project on a daily basis.
## Quick Start
Try out the benchmarks yourself:
```
mojo -I . examples/housing.mojo
```
```
mojo -I . examples/sin_estimate.mojo
```
```
mojo -I . examples/mnist.mojo
```
Compare to the alternative PyTorch implementation:
Make sure to install the requirements in `python-requirements.txt` in your python environment.
```
python examples/housing.py
python examples/sin_estimate.py
python examples/mnist.py
```
## Roadmap
### v0.1.0 ✅
- [x] Improve matrix multiplication and convolution kernels
- [x] Switch to custom Tensor and TensorShape implementations
- [x] Improve benchmarks and overall model execution performance
- [x] Add profiling and additional performance tests
### v0.2.0 (WIP)
- [ ] Add additional operators: Slice, (Un)Squeeze, Concat, Clip, Gather, Split, FMA ...
- [ ] Better layer support and more activation functions
- [ ] Graph submodules & graph concatenation
- [ ] Computer vision benchmark.
### Long-Term
- [ ] Better parallelization
- [ ] GPU support
- [ ] Reworked Dataloader
- [ ] Autotuning and related features
- [ ] Graph compilation optimizations
- [ ] Operator fusion
- [ ] ONNX / Max compatibility
## Contributing
Basalt is built by community efforts and relies on your expertise and enthousiasm!
Small fixes and improvements are much appreciated. If you are considering larger contributions, feel free to contact us for a smoother communication channel on Discord. If you find a bug or have an idea for a feature, please use our issue tracker. Before creating a new issue, please:
* Check if the issue already exists. If an issue is already reported, you can contribute by commenting on the existing issue.
* If not, create a new issue and include all the necessary details to understand/recreate the problem or feature request.
### Creating A Pull Request
1. Fork the Project
2. Create your Feature Branch
3. Commit your Changes
4. Push to the Branch
5. Open a Pull Request
> Once your changes are pushed, navigate to your fork on GitHub. And create a pull request against the original basalt-org/basalt repository.
> - Before creating a PR make sure it doesn't break any of the unit-tests. (e.g. `mojo run -I . test/test_ops.mojo`)
> - Introducing new big features requires a new test!
> - In the pull request, provide a detailed description of the changes and why they're needed. Link any relevant issues.
> - If there are any specific instructions for testing or validating your changes, include those as well.
## License
Distributed under the Apache 2.0 License with LLVM Exceptions. See [LICENSE](https://github.com/Basalt-Org/Basalt/blob/main/LICENSE) and the LLVM [License](https://llvm.org/LICENSE.txt) for more information.
## Acknowledgements
* Built with [Mojo](https://github.com/modularml/mojo) created by [Modular](https://github.com/modularml)