{"id":50301962,"url":"https://github.com/jossweb/jossnet-bitnet","last_synced_at":"2026-05-28T13:09:00.812Z","repository":{"id":350560182,"uuid":"1146788173","full_name":"jossweb/jossnet-bitnet","owner":"jossweb","description":"This project is an implementation of the bitnet-b1.58-2B-4T model from Microsoft for Apple Silicon using Metal.","archived":false,"fork":false,"pushed_at":"2026-04-10T22:12:26.000Z","size":48,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-04-11T00:14:52.551Z","etag":null,"topics":["bitnet-llm","metal","swift"],"latest_commit_sha":null,"homepage":"","language":"Swift","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jossweb.png","metadata":{"files":{"readme":"README.MD","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-01-31T17:21:28.000Z","updated_at":"2026-04-10T22:12:30.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/jossweb/jossnet-bitnet","commit_stats":null,"previous_names":["jossweb/jossnet-bitnet"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/jossweb/jossnet-bitnet","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jossweb%2Fjossnet-bitnet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jossweb%2Fjossnet-bitnet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jossweb%2Fjossnet-bitnet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jossweb%2Fjossnet-bitnet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jossweb","download_url":"https://codeload.github.com/jossweb/jossnet-bitnet/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jossweb%2Fjossnet-bitnet/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33609471,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-05-28T02:00:06.440Z","response_time":99,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bitnet-llm","metal","swift"],"created_at":"2026-05-28T13:09:00.716Z","updated_at":"2026-05-28T13:09:00.807Z","avatar_url":"https://github.com/jossweb.png","language":"Swift","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Jossnet-bitnet\n\n## Introduction \n\nThis project is an implementation of the [bitnet-b1.58-2B-4T](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) model from Microsoft for Apple Silicon using Metal. \n\nFirst of all, this project is an opportunity for me to learn more about how an LLM works, as well as to deepen my understanding of GPU programming with Metal.\n\n## Work in progress\n\nThis project is still in progress. The model is able to return logical results, but it is currently very slow and not accurate.\n\n### Current performance\n* M3 chip (8 CPU - 10 GPU | 16 GB) ~ 0.73s per token \n\n### Next steps\n* Work on optimization\n    * Add cache for k and v buffers\n* Add a real tokenizer\n* Write a report on this project\n\n## Model\n\nThis project uses the [bitnet-b1.58-2B-4T](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) model. By default, Microsoft provides the model in `.safetensors` format, so I used Python to convert it into `.bin` files. \n\nThe converted model is available on my [Hugging Face repository](https://huggingface.co/Dr-joss/bitnet-b1.58-2B-metal-weight).\n\n## License \u0026 References\n\n* Hugging Face model: [Dr-joss/bitnet-b1.58-2B-metal-weight](https://huggingface.co/Dr-joss/bitnet-b1.58-2B-metal-weight)\n* License: MIT License (Copyright © FIGUEIRAS Jossua)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjossweb%2Fjossnet-bitnet","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjossweb%2Fjossnet-bitnet","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjossweb%2Fjossnet-bitnet/lists"}