https://github.com/uasi/rwkv-in-150-lines-ex

https://github.com/uasi/rwkv-in-150-lines-ex

Last synced: 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/uasi/rwkv-in-150-lines-ex
• Owner: uasi
• Created: 2023-04-02T19:58:54.000Z (almost 2 years ago)
• Default Branch: master
• Last Pushed: 2023-05-07T00:48:45.000Z (over 1 year ago)
• Last Synced: 2023-05-07T02:20:09.594Z (over 1 year ago)
• Language: Elixir
• Size: 6.84 KB
• Stars: 4
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# RWKV in 150 lines in Elixir

This is a port of [the minimal RWKV implementation](https://johanwind.github.io/2023/03/23/rwkv_details.html) by Johan Sokrates Wind, which is based on [RWKV in 150 lines](https://github.com/BlinkDL/ChatRWKV/blob/main/RWKV_in_150_lines.py) by PENG Bo.

## Usage

```bash

% make data # download model and vocab data (~820MB total)

% ./rwkv.ex

In a shocking finding, scientist discovered a herd of dragons living in a remote, previously unexplored valley, in Tibet. Even more surprising to the researchers was the fact that the dragons spoke perfect Chinese.

22:44:36.559 [info] TfrtCpuClient created.

 They had, in fact, spoken another language, but only spoken it to scientists in their field.

The team studied the dragons in a way that was unprecedented in the scientific world. The dragon scientists developed computer algorithms to describe the language of the dragons, and this new language is actually completely different than that spoken by the ancient dragons.

Researchers then created an image of the dragons, looking for similar language in Tibetan language. The results of their analysis revealed that dragons live in the Himalay

```