{"id":17044407,"url":"https://github.com/srush/annotated-mamba","last_synced_at":"2025-04-05T08:07:08.842Z","repository":{"id":214212987,"uuid":"735976646","full_name":"srush/annotated-mamba","owner":"srush","description":"Annotated version of the Mamba paper","archived":false,"fork":false,"pushed_at":"2024-02-27T22:21:02.000Z","size":64830,"stargazers_count":478,"open_issues_count":2,"forks_count":18,"subscribers_count":22,"default_branch":"main","last_synced_at":"2025-03-29T07:05:51.895Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/srush.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-12-26T16:17:10.000Z","updated_at":"2025-03-27T00:59:21.000Z","dependencies_parsed_at":"2023-12-30T03:29:56.166Z","dependency_job_id":"a8a0c150-d6e5-4262-a994-cbc142d9bdac","html_url":"https://github.com/srush/annotated-mamba","commit_stats":null,"previous_names":["srush/annotated-mamba"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srush%2Fannotated-mamba","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srush%2Fannotated-mamba/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srush%2Fannotated-mamba/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/srush%2Fannotated-mamba/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/srush","download_url":"https://codeload.github.com/srush/annotated-mamba/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247305934,"owners_count":20917208,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-14T09:34:19.435Z","updated_at":"2025-04-05T08:07:08.814Z","avatar_url":"https://github.com/srush.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"[Go to Blog](https://srush.github.io/annotated-mamba/hard.html) [Notebook](https://github.com/srush/annotated-mamba/blob/main/Scan.ipynb) [Colab](https://colab.research.google.com/github/srush/annotated-mamba/blob/main/Scan.ipynb)\n\n![image](https://github.com/srush/annotated-mamba/assets/35882/d21e62eb-cc3b-4fa2-9e7e-88bbf8d08325)\n\n\n\nMamba: Linear-Time Sequence Modeling with Selective State Spaces\nhttps://arxiv.org/abs/2312.00752\n\n\n## Challenge\n\nThe triton version is still a lot slower than the mamba custom kernel. If anyone has ideas for speeding it up, I would love to hear them. The file `final.py` has a minimal version with benchmarking. \n\n```python\npip install mamba-ssm\npip install -U http://kermit.bounceme.net:8900/triton-3.0.0-cp310-cp310-linux_x86_64.whl\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsrush%2Fannotated-mamba","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsrush%2Fannotated-mamba","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsrush%2Fannotated-mamba/lists"}