{"id":23034737,"url":"https://github.com/ibnaleem/mikael","last_synced_at":"2025-04-23T17:41:53.064Z","repository":{"id":220386894,"uuid":"751511553","full_name":"ibnaleem/mikael","owner":"ibnaleem","description":"a Discord chatbot trained on Mistral and LLaVA language models","archived":false,"fork":false,"pushed_at":"2024-02-29T09:53:07.000Z","size":3700,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-12-15T16:46:42.546Z","etag":null,"topics":["artificial-intelligence","chatbot","discord-bot","discord-py","gpt-4","large-language-models","llava","mistral","mistral-7b","mistral-ai","multimodal","multimodal-deep-learning"],"latest_commit_sha":null,"homepage":"https://discord.com/api/oauth2/authorize?client_id=1202687794213036112\u0026permissions=0\u0026scope=bot","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ibnaleem.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-02-01T18:51:28.000Z","updated_at":"2024-07-25T06:53:57.000Z","dependencies_parsed_at":"2024-02-01T20:11:33.590Z","dependency_job_id":"6ddd6de0-777d-4a24-8d5a-147995097b85","html_url":"https://github.com/ibnaleem/mikael","commit_stats":null,"previous_names":["ibnaleem/mikael"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ibnaleem%2Fmikael","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ibnaleem%2Fmikael/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ibnaleem%2Fmikael/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ibnaleem%2Fmikael/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ibnaleem","download_url":"https://codeload.github.com/ibnaleem/mikael/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":237808184,"owners_count":19369602,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","chatbot","discord-bot","discord-py","gpt-4","large-language-models","llava","mistral","mistral-7b","mistral-ai","multimodal","multimodal-deep-learning"],"created_at":"2024-12-15T16:35:28.673Z","updated_at":"2025-02-08T12:42:37.056Z","avatar_url":"https://github.com/ibnaleem.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Mikael\nAn advanced multimodal model hosted as a Discord bot that synergizes [Mistral](https://mistral.ai) as the language model and [LLaVA (Large Language and Vision Assistant)](https://llava-vl.github.io) as the vision model. Together, they comprise a potent combination, incorporating a vision encoder and Vicuna for comprehensive visual and language understanding. This configuration empowers Mikael with remarkable chat capabilities, mirroring the versatility of the multimodal GPT-4. \n\n\u003cdiv align=\"center\"\u003e\n   \u003cimg src=\"https://github.com/ibnaleem/mikael/blob/main/assets/showcase.gif?raw=true\", alt=\"Showcase of Mikael Discord Bot\"\u003e\n\u003c/div\u003e\n\n## Invite Mikael\nMikael does not require any permissions, it is a **chat-only** Discord bot:\n```\nhttps://discord.com/api/oauth2/authorize?client_id=1202687794213036112\u0026permissions=0\u0026scope=bot\n```\n## Purpose\nTo combine [Mistral's LLM](https://mistral.ai) and [LLaVA multimodal model](https://llava-vl.github.io) into a Discord bot for users to chat with similar to ChatGPT.\n## Benchmarks\nCurrently, Mistral's 7.3B parameter LLM can:\n- Outperform Llama 2 13B on all benchmarks\n- Outperform Llama 1 34B on many benchmarks\n- Approach CodeLlama 7B performance on code, while remaining good at English tasks\n- Use Grouped-query attention (GQA) for faster inference\n- Use Sliding Window Attention (SWA) to handle longer sequences at smaller cost\n\n([Mistral AI, 2024](https://mistral.ai/news/announcing-mistral-7b/))\n## Running locally\nMikael can be self-hosted by following these steps:\n### Install Ollama\nFor Linux:\n```\n$ curl https://ollama.ai/install.sh | sh\n```\nFor MacOS:\n```\nhttps://ollama.ai/download/Ollama-darwin.zip\n```\n### Run the following terminal commands:\n1. ```\n   $ ollama pull mistral\n   ```\n2. ```\n   $ ollama pull llava\n   ```\nMistral needs 4.7 GB, while llava requires 4.1 GB of space.\n### Install Requirements\n```\n$ pip install discord.py ollama\n```\n### Set Mikael's Token\n```\n$ nvim /path/to/bash-or-zsh\n```\n```\n$ export MIKAEL_TOKEN=\"TOKEN HERE\"\n```\n```\n$ source /path/to/bash-or-zsh\n```\nMikael should run correctly; [open an issue](https://github.com/ibnaleem/mikael/issues) if it does not.\n## Future Plans\n- Incorporate [Dolphin-Mixtral-8x7b](https://huggingface.co/cognitivecomputations/dolphin-2.5-mixtral-8x7b) as Mikael's main LLM.\n\n## Privacy\n- Mikael ***temporarily*** downloads all images it's sent to be fed into LLaVA's multimodal model; after successfully finishing its task, your images are immediately deleted from the server. ([L39-L59](https://github.com/ibnaleem/mikael/blob/main/main.py#L39C13-L59C1))\n- Mikael only stores your chats in random access memory (RAM) ([L63-L66](https://github.com/ibnaleem/mikael/blob/main/main.py#L63-L66)).\n\n## Acknowledgements\n- [LLaVA](https://llava-vl.github.io)\n- [Mistral AI](https://mistral.ai)\n- [ollama/ollama-python](https://github.com/ollama/ollama-python)\n\n## Support Server\n```\nhttps://discord.gg/JX4XgrQSeV\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fibnaleem%2Fmikael","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fibnaleem%2Fmikael","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fibnaleem%2Fmikael/lists"}