{"id":93765,"url":"https://github.com/CodeSentryAI/Awesome-Rust-Neural-Network","name":"Awesome-Rust-Neural-Network","description":"A curated collection of Rust projects related to neural networks, designed to complement \"Are We Learning Yet.\"","projects_count":36,"last_synced_at":"2026-06-13T17:00:19.154Z","repository":{"id":273046521,"uuid":"918554548","full_name":"CodeSentryAI/Awesome-Rust-Neural-Network","owner":"CodeSentryAI","description":"A curated collection of Rust projects related to neural networks, designed to complement \"Are We Learning Yet.\"","archived":false,"fork":false,"pushed_at":"2025-12-23T06:32:22.000Z","size":32,"stargazers_count":72,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2026-05-28T02:02:59.619Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CodeSentryAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-01-18T08:27:19.000Z","updated_at":"2026-05-26T11:55:23.000Z","dependencies_parsed_at":"2025-02-23T14:26:06.119Z","dependency_job_id":"3a949280-c41f-4ee5-bb93-4c3d128a94e4","html_url":"https://github.com/CodeSentryAI/Awesome-Rust-Neural-Network","commit_stats":null,"previous_names":["burtonqin/awesome-rust-neural-network","codesentryai/awesome-rust-neural-network"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/CodeSentryAI/Awesome-Rust-Neural-Network","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeSentryAI%2FAwesome-Rust-Neural-Network","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeSentryAI%2FAwesome-Rust-Neural-Network/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeSentryAI%2FAwesome-Rust-Neural-Network/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeSentryAI%2FAwesome-Rust-Neural-Network/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CodeSentryAI","download_url":"https://codeload.github.com/CodeSentryAI/Awesome-Rust-Neural-Network/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CodeSentryAI%2FAwesome-Rust-Neural-Network/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34292326,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-13T02:00:06.617Z","response_time":62,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"created_at":"2025-08-30T13:10:23.079Z","updated_at":"2026-06-13T17:00:19.155Z","primary_language":"Rust","list_of_lists":false,"displayable":true,"categories":["Neural Networks","Machine Learning","GPU Computing","Miscellaneous"],"sub_categories":[],"readme":"# Awesome-Rust-Neural-Network\nA curated collection of Rust projects related to neural networks, designed to complement \"[Are We Learning Yet](https://www.arewelearningyet.com)\". I plan to submit libraries to \"Are We Learning Yet\" that are included in this project but currently missing from it. \n\nThis repository aims to provide a comprehensive overview of the Rust neural network ecosystem to identify the currently missing foundational infrastructure. Thus, it focuses more on the features, backends, and main dependencies of the Rust-based neural network projects. Note that the features, backends, and main dependencies are based on my own search and understanding, and may be incomplete or even incorrect.\n\n## Table of contents\n\n- [Awesome-Rust-Neural-Network](#awesome-rust-neural-network)\n  - [Table of contents](#table-of-contents)\n  - [Neural Networks](#neural-networks)\n  - [Machine Learning](#machine-learning)\n  - [GPU Computing](#gpu-computing)\n  - [Miscellaneous](#miscellaneous)\n\n## Neural Networks\n\n\n| Name | Description | Features | Backends | Main Deps | Last Commit Time |\n| -----| ----------- | ---------- | ---------- | ---------- | ---------- |\n| [candle](https://github.com/huggingface/candle) | Minimalist ML framework for Rust | Like PyTorch, Training, Various Models | CPU, CUDA, CUDA NCCL, WASM | gemm, intel-mkl-src, cudarc, metal, accelerate-src | 2025-06-07 |\n| [burn](https://github.com/tracel-ai/burn) | Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. | Various backends, Kernel Fusion, Training, Various Models, ONNX | WGPU, Candle, Torch, Ndarray, Remote | matrixmultiply, blas-src, libm, openblas-src, ndarray, candle-core, cubecl, cudarc, tch  | 2025-06-06 |\n| [dfdx](https://github.com/coreylowman/dfdx) | Deep learning in Rust, with shape checked tensors and neural networks | Compile-time Checking | CPU, CUDA, WGPU | gemm, cudarc, wgpu | 2024-01-25 |\n| [luminal](https://github.com/jafioti/luminal) | Deep learning at the speed of light | Static Computation Graph, RISC-style arch, Kernel Fusion, Training | CPU, CUDA, Metal | matrixmultiply, cudarc, metal-rs | 2025-06-04 |\n| [autograph](https://github.com/charles-r-earp/autograph) | A machine learning library for Rust | GPGPU kernels implemented with krnl | CPU, Vulkan | krnl, ndarray | 2024-08-19 |\n| [unda](https://github.com/unda-ml/unda) | General purpose machine learning crate | Compile to XLA | XLA | xla-rs | 2024-06-19 |\n| [custos](https://github.com/elftausend/custos) | A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework | Array Manipulation, AutoDiff, Lazy Execution | CPU, OpenCL, CUDA, Vulkan, NNAPI | min-cl, libm, ash, naga, nnapi | 2025-06-08 |\n| [zyx](https://github.com/zk4x/zyx) | Tensor library for machine learning | Lazy Execution, AutoDiff | CUDA, OpenCL, WGPU | wgpu, vulkano, manual bindings to CUDA, OpenCL, and HSA | 2025-05-13 |\n| [zenu](https://github.com/bokutotu/zenu) | A Deep Learning Framework Written in Rust | Training, AutoDiff | CPU, CUDA | cblas, openblas-src, manual binding to CUDA | 2024-12-30 |\n| [maidenx](https://github.com/miniex/maidenx) | A lightweight and fast AI framework in Rust focused on simplicity and performance | Educational focus, Mirror PyTorch's arch| CPU, CUDA | - | 2025-04-23 |\n| [ort](https://github.com/pykeio/ort) | Fast ML inference \u0026 training for ONNX models in Rust | ONNX, Various Backends | CUDA, TensorRT, OpenVINO, oneDNN, DirectML, QNN, CoreML, ACL, TVM, CANN, etc. | ort-sys: Unsafe Rust bindings for ONNX Runtime 1.20  | 2025-06-04 |\n| [tract](https://github.com/sonos/tract) | Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference | ONNX, Tensorflow | CPU, Metal | accelerate-src, blis-src, cblas, metal, ndarray, openblas-src, tensorflow, tflitec | 2025-06-06 |\n| [Kyanite](https://github.com/KarelPeeters/Kyanite) | A neural network inference library, written in Rust | ONNX, Graph IR | CPU, CUDA | manual binding to CUDA | 2024-07-13 |\n| [mistral.rs](https://github.com/EricLBuehler/mistral.rs) | Blazingly fast LLM inference | LLM inference, safetensors, Quantization | CPU, CUDA, Metal | mkl, candle, metal, accelerate | 2025-06-06 |\n| [InfiniLM](https://github.com/InfiniTensor/InfiniLM) | A handwriting transformer model project developed from YdrMaster/llama2.rs | LLM Inference, Multiple backends supported | CPU, CUDA, OpenCL, Ascend, etc. | operators | 2025-02-07 |\n| [operators](https://github.com/YdrMaster/operators-rs) | Multi-hardware support operator library | Multi-hardware | CPU, CUDA, OpenCL, Ascend, Cambricon | clrt, infinirt, cuda-driver | 2025-02-19 |\n| [crabml](https://github.com/crabml/crabml) | a fast cross platform AI inference engine using Rust and WebGPU | LLM Inference, mmap, Quantization | CPU, WGPU | vulkano, wgpu | 2025-01-04 |\n| [diffusion-rs](https://github.com/EricLBuehler/diffusion-rs) | Blazingly fast inference of diffusion models | Diffusion, Quantization, DDUF, Offloading | CPU, CUDA, Metal, etc. | cudarc, intel-mkl-src, accelerate-sr, metal, gemm | 2025-04-01 |\n| [mmnn](https://github.com/GrgoMariani/mmnnrust) | rust-based bash-cli for Neural Network propagation/backpropagation | bash-cli, json-config | - | - | 2025-04-13 |\n\n## Machine Learning\n\n| Name | Description | Features | Backends | Main Deps | Last Commit Time |\n| -----| ----------- | ---------- | ---------- | ---------- | ---------- |\n| [adk-rust](https://github.com/zavora-ai/adk-rust) | Production-ready AI agent development kit for Rust | Model-agnostic (Gemini, OpenAI, Anthropic), Multi-agent, MCP, Telemetry | CPU | tokio, serde | 2024-12 |\n| [linfa](https://github.com/rust-ml/linfa) | A Rust machine learning framework | like scikit-learn | CPU | ndarray, sprs | 2025-05-26 |\n| [jams-rs](https://github.com/gagansingh894/jams-rs) | Rust based model serving solution for popular machine learning frameworks | Model Store, PyTorch \u0026 Tenosrflow Models, Tree Models | PyTorch, TensorFlow, Catboost, LightGBM | tensorflow, tch, catboost-rs, lgbm, ndarray | 2025-05-30 |\n| [bullet](https://github.com/jw1912/bullet) | Specialised ML Library | Domain-specific, NNUE-style networks, chess engines | cudarc | - |\n| [redstone-ml](https://github.com/BhavyeMathur/redstone-ml) | High-performance Machine Learning, Dynamic Auto-Differentiation and Tensor Algebra crate for Rust | AutoDiff, NdArrray | CPU, GPU | - | 2025-06-07 |\n\n## GPU Computing\n\n| Name | Description | Features | Backends | Main Deps | Last Commit Time |\n| -----| ----------- | ---------- | ---------- | ---------- | ---------- |\n| [cubecl](https://github.com/tracel-ai/cubecl) | Multi-platform high-performance compute language extension for Rust | Kernels in Rust, CubeIR | WGPU, CUDA, HIP |  cudarc, cubecl-hip-sys, ash, cubecl-spirv, wgpu | 2025-06-05 |\n| [krnl](https://github.com/charles-r-earp/krnl) | Safe, portable, high performance compute (GPGPU) kernels | Kernels in Rust | Vulkan | rsprv, vulkano, ash | 2024-05-28 |\n| [EnzymeAD](https://github.com/EnzymeAD/rust) | A rust fork to work towards Enzyme integration | AutoDiff on LLVM |  LLVM | Enzyme | 2024-11-25 |\n| [Rust-CUDA](https://github.com/Rust-GPU/Rust-CUDA)| Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust | Compiling Rust to PTX | CUDA | Binding | 2025-05-26 | \n| [Rust-GPU](https://github.com/Rust-GPU/rust-gpu)| Making Rust a first-class language and ecosystem for GPU shaders | Compiling Rust to SPIR-V | SPIR-V | Binding | 2025-06-05 | \n| [cudarc](https://github.com/coreylowman/cudarc)| Safe rust wrapper around CUDA toolkit | Mixture of safe and sys APIs | CUDA | Binding | 2025-05-07 | \n| [async-cuda](https://github.com/oddity-ai/async-cuda) | Asynchronous CUDA for Rust | Async, NPP | CUDA | Binding | 2024-11-04 |\n| [async-tensorrt](https://github.com/oddity-ai/async-tensorrt) | Asynchronous TensorRT for Rust | Async, TensorRT | CUDA | async-cuda, Binding | 2025-04-30 |\n| [cuda-rs](https://github.com/vivym/cuda-rs) | Rust wrapper for CUDA Driver (libcuda.so) and Runtime (libcudart.so) APIs | - | CUDA | Binding | 2024-01-01 |\n| [tensorrt-rs](https://github.com/vivym/tensorrt-rs)| Rust wrapper to NVIDIA TensorRT | TensorRT | CUDA | cuda-rs, Binding | 2024-01-03 | \n\n\n## Miscellaneous\n\n- [gpu-allocator](https://github.com/Traverse-Research/gpu-allocator), GPU memory allocator for Vulkan, DirectX 12 and Metal. Written in pure Rust.\n- [ZLUDA](https://github.com/vosen/ZLUDA), CUDA on non-NVIDIA GPUs.\n","projects_url":"https://awesome.ecosyste.ms/api/v1/lists/codesentryai%2Fawesome-rust-neural-network/projects"}