https://github.com/michaelgiba/ggml-rs

Work in progress rust bindings to ggml
https://github.com/michaelgiba/ggml-rs

Last synced: about 1 month ago
JSON representation

Work in progress rust bindings to ggml

• Host: GitHub
• URL: https://github.com/michaelgiba/ggml-rs
• Owner: michaelgiba
• Created: 2023-03-17T13:59:14.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2023-05-01T02:07:25.000Z (almost 2 years ago)
• Last Synced: 2024-09-24T16:09:29.774Z (5 months ago)
• Language: Rust
• Size: 33.2 KB
• Stars: 12
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• awesome-rust-list - michaelgiba/ggml-rs - rs?style=social"/> : Work in progress rust bindings to ggml. (Machine Learning)
• awesome-rust-list - michaelgiba/ggml-rs - rs?style=social"/> : Work in progress rust bindings to ggml. (Machine Learning)

README

        
## ggml-rs

A work in progress implementation of rust bindings to ggml (https://github.com/ggerganov/ggml) a c/c++ tensor library that has been 

used recently for portable inference of LLM on small devices. These bindings are adapated from a LLAMA implementation which used

ggml under the hood (https://github.com/setzer22/llama-rs/tree/main/llama-rs)