{"id":19156335,"url":"https://github.com/kyegomez/celestial-1","last_synced_at":"2026-03-10T11:04:00.099Z","repository":{"id":167441926,"uuid":"643069973","full_name":"kyegomez/CELESTIAL-1","owner":"kyegomez","description":"Omni-Modality Processing, Understanding, and Generation","archived":false,"fork":false,"pushed_at":"2024-05-03T21:27:46.000Z","size":2609,"stargazers_count":7,"open_issues_count":4,"forks_count":1,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-05-07T07:47:05.202Z","etag":null,"topics":["attention","attention-is-all-you-need","attention-mechanisms","gpt-4","gpt4","multi-modal","multimodal","multimodal-deep-learning","multimodality","omnimodal","openai"],"latest_commit_sha":null,"homepage":"https://discord.gg/qUtxnK2NMf","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/kyegomez.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-05-20T02:47:33.000Z","updated_at":"2024-07-01T21:41:00.000Z","dependencies_parsed_at":"2024-05-03T22:32:58.264Z","dependency_job_id":"ec0c0a3d-70c1-4c09-b291-0a51b4262fd2","html_url":"https://github.com/kyegomez/CELESTIAL-1","commit_stats":null,"previous_names":["kyegomez/celestial-1"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/kyegomez/CELESTIAL-1","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCELESTIAL-1","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCELESTIAL-1/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCELESTIAL-1/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCELESTIAL-1/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/kyegomez","download_url":"https://codeload.github.com/kyegomez/CELESTIAL-1/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kyegomez%2FCELESTIAL-1/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30331644,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-10T05:25:20.737Z","status":"ssl_error","status_checked_at":"2026-03-10T05:25:17.430Z","response_time":106,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["attention","attention-is-all-you-need","attention-mechanisms","gpt-4","gpt4","multi-modal","multimodal","multimodal-deep-learning","multimodality","omnimodal","openai"],"created_at":"2024-11-09T08:34:07.936Z","updated_at":"2026-03-10T11:04:00.079Z","avatar_url":"https://github.com/kyegomez.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Multi-Modality](agorabanner.png)](https://discord.gg/qUtxnK2NMf)\n\n\n# CELESTIAL-1: A Model for Processing, Understanding, and Reasoning in Unlimited Modalities\n[![GitHub issues](https://img.shields.io/github/issues/kyegomez/CELESTIAL-1)](https://github.com/kyegomez/CELESTIAL-1/issues) \n[![GitHub forks](https://img.shields.io/github/forks/kyegomez/CELESTIAL-1)](https://github.com/kyegomez/CELESTIAL-1/network) \n[![GitHub stars](https://img.shields.io/github/stars/kyegomez/CELESTIAL-1)](https://github.com/kyegomez/CELESTIAL-1/stargazers) [![GitHub license](https://img.shields.io/github/license/kyegomez/CELESTIAL-1)](https://github.com/kyegomez/CELESTIAL-1/blob/master/LICENSE)\n[![Share on Twitter](https://img.shields.io/twitter/url/https/twitter.com/cloudposse.svg?style=social\u0026label=Share%20%40kyegomez/CELESTIAL-1)](https://twitter.com/intent/tweet?text=Excited%20to%20introduce%20CELESTIAL-1,%20the%20all-new%20Multi-Modal%20model%20with%20the%20potential%20to%20revolutionize%20automation.%20Join%20us%20on%20this%20journey%20towards%20a%20smarter%20future.%20%23CELESTIAL-1%20%23Multi-Modal\u0026url=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1)\n[![Share on Facebook](https://img.shields.io/badge/Share-%20facebook-blue)](https://www.facebook.com/sharer/sharer.php?u=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1)\n[![Share on LinkedIn](https://img.shields.io/badge/Share-%20linkedin-blue)](https://www.linkedin.com/shareArticle?mini=true\u0026url=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1\u0026title=Introducing%20CELESTIAL-1%2C%20the%20All-New%20Multi-Modal%20Model\u0026summary=CELESTIAL-1%20is%20the%20next-generation%20Multi-Modal%20model%20that%20promises%20to%20transform%20industries%20with%20its%20intelligence%20and%20efficiency.%20Join%20us%20to%20be%20a%20part%20of%20this%20revolutionary%20journey%20%23CELESTIAL-1%20%23Multi-Modal\u0026source=)\n![Discord](https://img.shields.io/discord/999382051935506503)\n[![Share on Reddit](https://img.shields.io/badge/-Share%20on%20Reddit-orange)](https://www.reddit.com/submit?url=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1\u0026title=Exciting%20Times%20Ahead%20with%20CELESTIAL-1%2C%20the%20All-New%20Multi-Modal%20Model%20%23CELESTIAL-1%20%23Multi-Modal) [![Share on Hacker News](https://img.shields.io/badge/-Share%20on%20Hacker%20News-orange)](https://news.ycombinator.com/submitlink?u=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1\u0026t=Exciting%20Times%20Ahead%20with%20CELESTIAL-1%2C%20the%20All-New%20Multi-Modal%20Model%20%23CELESTIAL-1%20%23Multi-Modal)\n[![Share on Pinterest](https://img.shields.io/badge/-Share%20on%20Pinterest-red)](https://pinterest.com/pin/create/button/?url=https%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1\u0026media=https%3A%2F%2Fexample.com%2Fimage.jpg\u0026description=CELESTIAL-1%2C%20the%20Revolutionary%20Multi-Modal%20Model%20that%20will%20Change%20the%20Way%20We%20Work%20%23CELESTIAL-1%20%23Multi-Modal)\n[![Share on WhatsApp](https://img.shields.io/badge/-Share%20on%20WhatsApp-green)](https://api.whatsapp.com/send?text=I%20just%20discovered%20CELESTIAL-1,%20the%20all-new%20Multi-Modal%20model%20that%20promises%20to%20revolutionize%20automation.%20Join%20me%20on%20this%20exciting%20journey%20towards%20a%20smarter%20future.%20%23CELESTIAL-1%20%23Multi-Modal%0A%0Ahttps%3A%2F%2Fgithub.com%2Fkyegomez%2FCELESTIAL-1)\n\n\n\nCELESTIAL-1 is an open source model designed to provide a general representation for processing, understanding, and reasoning across an unlimited range of modalities.\n\nCELESTIAL-1 can operate in vision, audio, audio-language, and vision-language tasks without any prior initialization.\n\nThis model will change everything for our species, we'll able to automate any digital task. And, we need your help. [Contribute to the project board here:](https://github.com/users/kyegomez/projects/6/views/2)\n\n\n# Install\n\n`pip install cstx`\n\n# Usage\n\n\n\n## Features\n\nCELESTIAL-1 boasts a wide range of features designed to enhance its versatility and usefulness. Some of these features include:\n\n* **Unlimited Modalities**: The model can process and understand an unlimited number of modalities, increasing its applicability in a wide range of tasks.\n* **Reasoning in Context**: CELESTIAL-1 is capable of reasoning in context across multiple modalities, thus improving its understanding and representation of complex scenarios.\n* **Generates Any Modality**: With the ability to generate any modality, CELESTIAL-1 can cater to a wider variety of applications.\n* **Scaling-Friendly Architecture**: The architecture of CELESTIAL-1 is designed to be friendly to scaling, which allows it to efficiently handle larger and more complex tasks.\n* **Modality-Agnostic Tasks**: The model can perform tasks that are agnostic to the modality, further widening its range of uses.\n* **Strong Emergent Zero-Shot Retrieval Capability**: CELESTIAL-1 has an impressive ability to retrieve information in a zero-shot manner, an essential feature for any advanced AI model.\n\n---\n\n## Contribution\n\nContributing to CELESTIAL-1 is a rewarding experience, whether you're a novice developer or an AI expert. Here's a simple guide to get you started:\n\n1. **Understand the Project**: \n   Familiarize yourself with CELESTIAL-1's mission and features. Check out the project board: [Contribute to the project board](https://github.com/users/kyegomez/projects/6/views/2).\n\n2. **Choose a Task**:\n   Select a task that resonates with your skill set and passion. It could range from documentation, coding, testing, or even discussions.\n\n3. **Fork the Repository**:\n   Create a personal fork of the CELESTIAL-1 repository on GitHub.\n\n4. **Clone Your Fork**:\n   ```bash\n   git clone https://github.com/\u003cyour-username\u003e/Celestial-1.git\n   ```\n\n5. **Branching**:\n   Always create a new branch for each task. This keeps things organized.\n   ```bash\n   git checkout -b feature/your-branch-name\n   ```\n\n6. **Code, Document, Discuss**:\n   Dive in! Make your changes, write/document, or participate in discussions. \n\n7. **Commit and Push**:\n   After making your changes, commit them and push them to your fork.\n   ```bash\n   git commit -m \"Your concise commit message\"\n   git push origin feature/your-branch-name\n   ```\n\n8. **Create a Pull Request**:\n   Go to the original CELESTIAL-1 repository on GitHub and create a pull request. Fill out the provided template with as much detail as possible.\n\n9. **Wait for Review**:\n   Maintainers or other contributors will review your changes. They might ask for edits or further information. Collaboration is key!\n\n10. **Celebrate**:\n   Once your contribution is merged, celebrate! You've just made an impactful contribution to an incredible project.\n\n## Tips:\n- Always sync your fork with the main repository before starting on a new feature.\n- Clearly document any changes or additions you make.\n- Participate actively in discussions and respect all contributors.\n\nRemember, every contribution, no matter how small, is valuable. Your insights, skills, and time are greatly appreciated. Let's make CELESTIAL-1 remarkable together!\n\n---\n\n## References\n\nFor more information about the ONE-PEACE architecture that CELESTIAL-1 is based on, you can refer to the following resources:\n\n* ONE-PEACE Paper: [Link](#)\n* ONE-PEACE Demo: [Link](#)\n* ONE-PEACE Checkpoints: [Link](#)\n\n[Vicuna](https://github.com/lm-sys/FastChat), \n\n[ImageBind](https://github.com/facebookresearch/ImageBind), \n\n[Stable Diffusion](https://huggingface.co/docs/diffusers/api/pipelines/stable_diffusion/text2img), \n\n[AudioLDM](https://github.com/haoheliu/AudioLDM)\n[Zeroscope](https://huggingface.co/cerspense/zeroscope_v2_576w).\n\n\n[PandaGPT](https://github.com/yxuansu/PandaGPT), \n\n[VPGTrans](https://vpgtrans.github.io/), \n\n[GILL](https://github.com/kohjingyu/gill/), \n\n[CoDi](https://codi-gen.github.io/),\n\n[Video-LLaMA](https://github.com/DAMO-NLP-SG/Video-LLaMA),\n\nand [MiniGPT-4](https://github.com/Vision-CAIR/MiniGPT-4)\n\n\n\n\n\n-------\n\n## License\n\nCELESTIAL-1 is released under the Apache 2.0 license. For more information about what this license entails, please refer to the LICENSE file.\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkyegomez%2Fcelestial-1","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkyegomez%2Fcelestial-1","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkyegomez%2Fcelestial-1/lists"}