https://github.com/grctest/electron-bitnet

Running Microsoft's BitNet via Electron, React & Astro
https://github.com/grctest/electron-bitnet

1-bit 1-bit-quantization ai astrojs benchmarking bitnet electron inference-framework large-language-models llm perplexity reactjs

Last synced: 10 months ago
JSON representation

Running Microsoft's BitNet via Electron, React & Astro

• Host: GitHub
• URL: https://github.com/grctest/electron-bitnet
• Owner: grctest
• License: mit
• Created: 2024-10-24T15:42:23.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2025-04-24T19:31:16.000Z (about 1 year ago)
• Last Synced: 2025-06-01T16:19:41.311Z (12 months ago)
• Topics: 1-bit, 1-bit-quantization, ai, astrojs, benchmarking, bitnet, electron, inference-framework, large-language-models, llm, perplexity, reactjs
• Language: JavaScript
• Homepage:
• Size: 7.99 MB
• Stars: 39
• Watchers: 4
• Forks: 3
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Electron-BitNet

Running [Microsoft's BitNet](https://github.com/microsoft/BitNet) via [Astro](https://astro.build/), [React](https://react.dev/) & [Electron](https://www.electronjs.org/)!

![image](https://github.com/user-attachments/assets/d8af4105-7ca6-49b6-9b6c-5ead7f332b11)

## Functionality

* Run Microsoft's official BitNet model in chat mode

* Benchmark BitNet models

* Calculate BitNet model perplexity

* Switch between multiple languages

## How to setup this application

- Use python to prepare 1-bit models

  - Follow [Microsoft's instructions](https://github.com/microsoft/BitNet?tab=readme-ov-file#installation), installing visual studio 2022 (including c++ desktop build tools & clang build tools) and preparing Microsoft's [Official BitNet model](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) for use.

  - OR: Download Microsoft's official BitNet model directly: https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf

- Supports generated gguf models.

- Run the commands below to build and run the app

| Command                                | Action                                           |

| :------------------------------------- | :----------------------------------------------- |

| `npm install`                          | Installs dependencies                            |

| `npm run restart`                      | Starts local dev server at `localhost:4321`      |

| `npm run build:astro`                  | Builds the production site at `./dist/`          |

| `npm run build:astro \| npm run start` | Builds then runs the electorn app in dev mode.   |

| `npm run dist:windows-latest`          | Builds the windows application.                  |

Reference project: https://github.com/microsoft/BitNet

---

Note: At the moment only Windows is supported, Linux support may come in the future.

---

Prefer to use an installer? Check out the [latest windows releases](https://github.com/grctest/Electron-BitNet/releases)!