https://github.com/acctress/znn

A neural network written from scratch in Zig
https://github.com/acctress/znn

ai neural-network zig

Last synced: about 15 hours ago
JSON representation

A neural network written from scratch in Zig

• Host: GitHub
• URL: https://github.com/acctress/znn
• Owner: acctress
• Created: 2026-06-01T23:44:57.000Z (23 days ago)
• Default Branch: main
• Last Pushed: 2026-06-02T00:10:35.000Z (23 days ago)
• Last Synced: 2026-06-02T02:12:20.843Z (23 days ago)
• Topics: ai, neural-network, zig
• Language: Zig
• Homepage:
• Size: 39.6 MB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# znn

A simple neural network written from scratch in Zig

# Under the Hood

In znn, the network is built with multiple `Layer`s. They store weights and biases as flat float arrays, they have two methods - forward and backward.

Forward computes a weighted sum of inputs with bias added with ReLU activation for the hidden layers and linear activation for output layers.

The `Network` struct chains the layers. Buffers are preallocated for efficiency and they pass data between layers, `forward` feeds output of each layer into the next.

Cool thing is, this network can actually learn (🤯). The way it works is that given an expected output, it computes how wrong each weight was and nudges them into the right direction using gradient descent.

The learning was proved by running `forward` and `backward` repeatedly until the network converges towards the target, it starts at a random guess and reaches the target within 1000 iterations.

![img.png](img.png)

I ran a 5 million iteration training stage on the network to learn multiplication, here is what it done:

![img_3.png](img_3.png)

It's okay, but very impressive for the size of the architecture.

I tested XOR to ensure training was actually happening. I ran i through three inputs and expected results:

![img_1.png](img_1.png)

So that's: `0 xor 1 = 1`, `1 xor 0 = 1`, `1 xor 1 = 0`. And the results are successful:

![img_2.png](img_2.png)

It learnt to XOR without me telling it to do so after 100,000 iterations.