https://github.com/gotzmann/fast

FastTensors - 100% Go framework for Neural Nets
https://github.com/gotzmann/fast

Last synced: 9 months ago
JSON representation

FastTensors - 100% Go framework for Neural Nets

• Host: GitHub
• URL: https://github.com/gotzmann/fast
• Owner: gotzmann
• Created: 2024-09-20T19:26:51.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2024-09-20T19:58:51.000Z (over 1 year ago)
• Last Synced: 2024-12-06T16:11:47.743Z (over 1 year ago)
• Language: Go
• Size: 88.9 KB
• Stars: 25
• Watchers: 2
• Forks: 1
• Open Issues: 2
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
![](./logo.png?raw=true)

Pragmatic framework for those who want something like GGML or ONNX in pure Go.

Aimed to be 100% compatible with GGML and GGUF, as well support ONNX and safetensors models.

## V0 Roadmap - Fall'24

- [ ] Update the older code for better GGML compatibility

- [ ] Implement new operations needed for LLaMA v3 inference

- [ ] Allow GGUF format models to be read

- [ ] LLaMA v3.1 will work as FP32 / FP16 model on modern platrofrms

## V1 Roadmap - Winter'25

- [ ] Support some popular quantizations like Q6K or Q80

## Want to work with LLMs in Go?

Please check out my related project **[Booster](https://github.com/gotzmann/booster)**