{"id":23592817,"url":"https://github.com/tushar2704/colabmixtral","last_synced_at":"2025-05-07T19:22:56.750Z","repository":{"id":214755311,"uuid":"737284167","full_name":"tushar2704/ColabMixtral","owner":"tushar2704","description":"Welcome to the Mixtral 8x7B offloading demo repository! This project aims to demonstrate the seamless execution of Mixtral-8x7B models on Colab or consumer desktops.","archived":false,"fork":false,"pushed_at":"2023-12-30T13:52:41.000Z","size":24,"stargazers_count":4,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-03-31T13:18:21.730Z","etag":null,"topics":["data-science","demo","llm","mistral","mixtral-8x7b-instruct","nlp","python","rag","tushar2704"],"latest_commit_sha":null,"homepage":"https://tushar-aggarwal.com","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tushar2704.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-12-30T13:25:43.000Z","updated_at":"2025-03-21T16:11:55.000Z","dependencies_parsed_at":"2023-12-30T14:42:09.083Z","dependency_job_id":null,"html_url":"https://github.com/tushar2704/ColabMixtral","commit_stats":null,"previous_names":["tushar2704/colabmixtral"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tushar2704%2FColabMixtral","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tushar2704%2FColabMixtral/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tushar2704%2FColabMixtral/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tushar2704%2FColabMixtral/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tushar2704","download_url":"https://codeload.github.com/tushar2704/ColabMixtral/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252941669,"owners_count":21828913,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","demo","llm","mistral","mixtral-8x7b-instruct","nlp","python","rag","tushar2704"],"created_at":"2024-12-27T08:15:53.467Z","updated_at":"2025-05-07T19:22:56.712Z","avatar_url":"https://github.com/tushar2704.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Colab Mixtral 8x7B Offloading Demo\n\nWelcome to the Mixtral 8x7B offloading demo repository! This project aims to demonstrate the seamless execution of Mixtral-8x7B models on Colab or consumer desktops.\n\n![Screenshot 2023-12-30 191022](https://github.com/tushar2704/ColabMixtral/assets/66141195/9f3a9683-9083-4818-b15f-fbb8b4ecbb69)\n## Getting Started\n\n\nTo explore and experience the demo, follow these steps:\n\n1. Open the demo notebook located at `./notebooks/demo.ipynb`.\n\n2. Follow the instructions within the notebook to run the Mixtral-8x7B offloading demo.\n\n## Overview\n\nThis repository provides a hands-on experience for users interested in leveraging Mixtral-8x7B models for various applications. The demo notebook serves as a comprehensive guide, offering insights into the capabilities of Mixtral-8x7B and providing a platform for experimentation.\n\n## Requirements\n\nMake sure you have the necessary dependencies installed before running the demo. Refer to the notebook for specific requirements.\n\n## Issues and Contributions\n\nIf you encounter any issues or have suggestions for improvement, feel free to open an issue or contribute to the project. We welcome collaboration from the community to enhance this demo.\n\nThank you for exploring the Mixtral 8x7B offloading demo! Enjoy experimenting with the capabilities of Mixtral-8x7B in your projects.\n\n## Refrence:\n1)https://arxiv.org/abs/2312.17238\n\n\n## Upcoming application to demonstrate!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftushar2704%2Fcolabmixtral","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftushar2704%2Fcolabmixtral","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftushar2704%2Fcolabmixtral/lists"}