{"id":16766129,"url":"https://github.com/cryscan/web-rwkv-py","last_synced_at":"2025-08-07T07:08:28.917Z","repository":{"id":212423115,"uuid":"731274043","full_name":"cryscan/web-rwkv-py","owner":"cryscan","description":null,"archived":false,"fork":false,"pushed_at":"2024-06-15T13:05:48.000Z","size":506,"stargazers_count":9,"open_issues_count":0,"forks_count":5,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-10-20T11:43:16.863Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cryscan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-13T18:00:00.000Z","updated_at":"2024-06-16T17:56:56.000Z","dependencies_parsed_at":"2023-12-14T07:26:29.146Z","dependency_job_id":"b17edffb-19db-42b5-a647-0af54992412a","html_url":"https://github.com/cryscan/web-rwkv-py","commit_stats":null,"previous_names":["cryscan/web-rwkv-py"],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cryscan%2Fweb-rwkv-py","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cryscan%2Fweb-rwkv-py/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cryscan%2Fweb-rwkv-py/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cryscan%2Fweb-rwkv-py/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cryscan","download_url":"https://codeload.github.com/cryscan/web-rwkv-py/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":221820605,"owners_count":16886222,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-13T06:05:29.361Z","updated_at":"2025-03-21T23:33:17.238Z","avatar_url":"https://github.com/cryscan.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Web-RWKV-Py\nPython binding for [`web-rwkv`](https://github.com/cryscan/web-rwkv).\n\n# Todos\n- [x] Basic V5 inference support\n- [x] Support V4, V5, V6 and V7\n- [ ] Batched inference\n\n# Usage\n1. Install python and rust.\n2. Install maturin by\n\n   ```bash\n   $ pip install maturin\n   ```\n4. Build and install:\n\n   ```bash\n   $ maturin develop --release\n   ```\n\n5. Try using `web-rwkv` in python:\n\n   ```python\n   import web_rwkv_py as wrp\n\n   model = wrp.Model(\n      \"/path/to/model.st\", # model path\n      quant=0,             # int8 quantization layers\n      quant_nf4=0,         # nf4 quantization layers\n      quant_sf4=0,         # sf4 quantization layers\n   )\n   model.clear_state()\n   logits = model.run([114, 514])\n   ```\n   \n# Advanced Usage\n1. Get, clone and load current state:\n\n   ```python\n   logits = model.run([114, 514])\n   state = model.back_state(wrp.StateDevice.Gpu)\n   # state = model.back_state(wrp.StateDevice.Cpu)\n   state_cloned = state.deep_clone()\n\n   model.load_state(state_cloned)\n   logits = model.run([1919, 810])\n   ```\n   \n2. Return predictions of all tokens (not only the last's):\n\n   ```python\n   logits, state = model.run_full([114, 514, 1919, 810], state=None)\n   assert(len(logits) == 4)\n   ```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcryscan%2Fweb-rwkv-py","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcryscan%2Fweb-rwkv-py","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcryscan%2Fweb-rwkv-py/lists"}