{"id":13493583,"url":"https://github.com/nebuly-ai/optimate","last_synced_at":"2025-05-14T01:03:10.415Z","repository":{"id":37068469,"uuid":"458588993","full_name":"nebuly-ai/optimate","owner":"nebuly-ai","description":"A collection of libraries to optimise AI model performances","archived":false,"fork":false,"pushed_at":"2024-07-22T02:07:03.000Z","size":4528,"stargazers_count":8370,"open_issues_count":111,"forks_count":636,"subscribers_count":91,"default_branch":"main","last_synced_at":"2025-04-13T09:55:41.924Z","etag":null,"topics":["ai","analytics","artificial-intelligence","deeplearning","large-language-models","llm"],"latest_commit_sha":null,"homepage":"https://www.nebuly.com/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/nebuly-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2022-02-12T17:17:14.000Z","updated_at":"2025-04-12T09:38:57.000Z","dependencies_parsed_at":"2022-07-14T08:49:39.376Z","dependency_job_id":"c684f24d-8e65-4e04-aa92-13cec324270b","html_url":"https://github.com/nebuly-ai/optimate","commit_stats":{"total_commits":666,"total_committers":45,"mean_commits":14.8,"dds":0.7342342342342343,"last_synced_commit":"1d2aa61ff5d267596d38486f9118558b152662b2"},"previous_names":["nebuly-ai/nebullvm","nebuly-ai/optimate","nebuly-ai/nebuly"],"tags_count":24,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nebuly-ai%2Foptimate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nebuly-ai%2Foptimate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nebuly-ai%2Foptimate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/nebuly-ai%2Foptimate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/nebuly-ai","download_url":"https://codeload.github.com/nebuly-ai/optimate/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248747427,"owners_count":21155448,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","analytics","artificial-intelligence","deeplearning","large-language-models","llm"],"created_at":"2024-07-31T19:01:16.803Z","updated_at":"2025-04-13T16:43:28.424Z","avatar_url":"https://github.com/nebuly-ai.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# OptiMate\n\n**[Legacy]**\n\nThis repository is now in a legacy phase and is no longer actively maintained. Although the source code is still available in the Git history, there will be no additional updates or official support.\n\n**[About Nebuly]**\n\nOur team is fully committed on creating the best user-experience platform for LLMs so that companies can understand user behavior at scale when interacting with their LLM-based products. \n- To learn more on how to get started, visit our [official documentation](https://docs.nebuly.com/welcome/overview)\n- If you need enterprise support, please contact us [here](https://www.nebuly.com/nebuly-book-a-demo)\n\n**[About optimate]**\n\nWe have open-sourced a couple of internal projects to the community, but we are not currently maintaining them. Optimate is a collection of libraries designed to help you optimize your AI models. It is an open-source project developed by Nebuly AI but is **not actively maintained**.\n\nThe tools available to assist you in your optimization are:\n\n✅ [Speedster](https://github.com/nebuly-ai/optimate/tree/main/optimization/speedster): reduce inference costs by leveraging SOTA optimization techniques that best couple your AI models with the underlying hardware (GPUs and CPUs)\n\n✅ [Nos](https://github.com/nebuly-ai/nos): reduce infrastructure costs by leveraging real-time dynamic partitioning and elastic quotas to maximize the utilization of your Kubernetes GPU cluster\n\n✅ [ChatLLaMA](https://github.com/nebuly-ai/optimate/tree/main/optimization/chatllama): reduce hardware and data costs by leveraging fine-tuning optimization techniques and RLHF alignment\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnebuly-ai%2Foptimate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnebuly-ai%2Foptimate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnebuly-ai%2Foptimate/lists"}