https://github.com/rahuldshetty/starcoder.js

Web browser version of StarCoder.cpp
https://github.com/rahuldshetty/starcoder.js

Last synced: 5 days ago
JSON representation

Web browser version of StarCoder.cpp

• Host: GitHub
• URL: https://github.com/rahuldshetty/starcoder.js
• Owner: rahuldshetty
• Created: 2023-07-18T21:33:46.000Z (over 1 year ago)
• Default Branch: main
• Last Pushed: 2023-07-30T07:58:47.000Z (over 1 year ago)
• Last Synced: 2024-09-16T06:50:52.070Z (about 2 months ago)
• Language: C
• Homepage: https://rahuldshetty.github.io/starcoder.js/
• Size: 7.48 MB
• Stars: 43
• Watchers: 1
• Forks: 1
• Open Issues: 6
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# 💫StarCoder.js *\*Experimental*\*

[![npm version](https://badge.fury.io/js/starcoder.js.svg)](https://badge.fury.io/js/starcoder.js)

`THIS IS UNDER DEVELOPMENT AND IS NOT PRODUCTION READY. BROWSER REQUIRES MEM64 SUPPORT TO RUN THIS PROJECT`

This project brings [starcoder.cpp](https://github.com/bigcode-project/starcoder.cpp) to browser with power of WebAssembly.

## Demo

Web Application : [starcoder.js](https://rahuldshetty.github.io/starcoder.js/)

![App](assets/app.PNG)

![Fibonacci Example](assets/fibonacci.PNG)

### Performance

![Prime Example](assets/prime.PNG)

Following performance speed is captured on Firefox Nightly with following system configuration:

* CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz

* Memory: 24GB

![Generation Performance](assets/performance.PNG)

# Build Instructions

```

git clone https://github.com/bigcode-project/starcoder.cpp

cd starcoder.cpp

Run the notebook in examples/ to convert starcoder model to GGML format.

# Builds JS/WASM dependency in build/ location

build.sh

# Generate Distributable JS

npm run build

# To publish to NPM

npm publish

```