{"id":26658797,"url":"https://github.com/endlessreform/csm_mlx","last_synced_at":"2025-10-07T00:11:21.266Z","repository":{"id":282515953,"uuid":"948298990","full_name":"EndlessReform/csm_mlx","owner":"EndlessReform","description":null,"archived":false,"fork":false,"pushed_at":"2025-04-06T21:41:13.000Z","size":5201,"stargazers_count":21,"open_issues_count":1,"forks_count":3,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-06T22:26:47.854Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/EndlessReform.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-14T04:41:59.000Z","updated_at":"2025-03-29T20:50:24.000Z","dependencies_parsed_at":"2025-03-15T06:19:13.669Z","dependency_job_id":"bd650ea1-6817-4bad-96f4-149c2687abf3","html_url":"https://github.com/EndlessReform/csm_mlx","commit_stats":null,"previous_names":["endlessreform/csm_mlx"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/EndlessReform/csm_mlx","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/EndlessReform%2Fcsm_mlx","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/EndlessReform%2Fcsm_mlx/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/EndlessReform%2Fcsm_mlx/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/EndlessReform%2Fcsm_mlx/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/EndlessReform","download_url":"https://codeload.github.com/EndlessReform/csm_mlx/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/EndlessReform%2Fcsm_mlx/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259768509,"owners_count":22908228,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-25T10:16:56.028Z","updated_at":"2025-10-07T00:11:16.246Z","avatar_url":"https://github.com/EndlessReform.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Sesame CSM 1B MLX port\n\nPort of Sesame's [CSM](https://github.com/SesameAILabs/csm) model to [MLX](https://github.com/ml-explore/mlx) for use on Apple Silicon.\n\nThe project goal is realtime streaming inference on a MacBook.\n\n## Installation\n\nClone this repo.\n\nGet [uv](https://docs.astral.sh/uv/getting-started/installation/) if you haven't already. Then:\n\n```bash\nuv sync\n```\n\nRun the WebUI with:\n\n```bash\nuv run webui/app.py\n```\n\nQ8 quantization is available for a ~60% speedup at some loss of quality:\n\n```bash\nuv run webui/app.py --quantize q8\n```\n\nFor procedural examples, check out `example.ipynb`\n\n## FAQ\n\nIf `uv sync` fails due to sentencepiece error, run:\n\n```bash\nbrew install cmake\n```\n\n## Roadmap\n\n- [x] Safetensors conversion\n- [x] Core modeling and entry point\n- [x] Gradio UI (blocking, streaming will be supported below)\n- [x] Streaming output (for model)\n- [ ] FastRTC speech-to-speech webui\n- [ ] Perf improvements\n- [ ] PyPI library\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fendlessreform%2Fcsm_mlx","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fendlessreform%2Fcsm_mlx","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fendlessreform%2Fcsm_mlx/lists"}