{"id":13410460,"url":"https://github.com/cortexlabs/cortex","last_synced_at":"2025-05-13T18:13:19.338Z","repository":{"id":37271316,"uuid":"167304464","full_name":"cortexlabs/cortex","owner":"cortexlabs","description":"Production infrastructure for machine learning at scale","archived":false,"fork":false,"pushed_at":"2024-06-12T19:34:23.000Z","size":11550,"stargazers_count":8032,"open_issues_count":131,"forks_count":607,"subscribers_count":142,"default_branch":"master","last_synced_at":"2025-04-25T15:48:46.331Z","etag":null,"topics":["infrastructure","machine-learning"],"latest_commit_sha":null,"homepage":"https://cortexlabs.com/","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cortexlabs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-01-24T04:43:14.000Z","updated_at":"2025-04-25T11:55:50.000Z","dependencies_parsed_at":"2022-07-13T16:48:27.535Z","dependency_job_id":"1e9d8c1d-cce9-4e7c-9969-06aef7dfdc1f","html_url":"https://github.com/cortexlabs/cortex","commit_stats":{"total_commits":2326,"total_committers":27,"mean_commits":86.14814814814815,"dds":"0.45012897678417885","last_synced_commit":"dc48c02ed50a523a87166709f6fe361b5c836e3e"},"previous_names":[],"tags_count":63,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cortexlabs%2Fcortex","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cortexlabs%2Fcortex/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cortexlabs%2Fcortex/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cortexlabs%2Fcortex/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cortexlabs","download_url":"https://codeload.github.com/cortexlabs/cortex/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254000883,"owners_count":21997443,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["infrastructure","machine-learning"],"created_at":"2024-07-30T20:01:07.087Z","updated_at":"2025-05-13T18:13:19.308Z","avatar_url":"https://github.com/cortexlabs.png","language":"Go","readme":"**[Docs](https://docs.cortexlabs.com)** • **[Slack](https://community.cortexlabs.com)**\n\n\u003cbr\u003e\n\n\u003cimg src='https://cortex-public.s3.us-west-2.amazonaws.com/logo.png' height='32'\u003e\n\n\u003cbr\u003e\n\nNote: This project is no longer actively maintained by its original authors.\n\n# Production infrastructure for machine learning at scale\n\nDeploy, manage, and scale machine learning models in production.\n\n\u003cbr\u003e\n\n## Serverless workloads\n\n**Realtime** - respond to requests in real-time and autoscale based on in-flight request volumes.\n\n**Async** - process requests asynchronously and autoscale based on request queue length.\n\n**Batch** - run distributed and fault-tolerant batch processing jobs on-demand.\n\n\u003cbr\u003e\n\n## Automated cluster management\n\n**Autoscaling** - elastically scale clusters with CPU and GPU instances.\n\n**Spot instances** - run workloads on spot instances with automated on-demand backups.\n\n**Environments** - create multiple clusters with different configurations.\n\n\u003cbr\u003e\n\n## CI/CD and observability integrations\n\n**Provisioning** - provision clusters with declarative configuration or a Terraform provider.\n\n**Metrics** - send metrics to any monitoring tool or use pre-built Grafana dashboards.\n\n**Logs** - stream logs to any log management tool or use the pre-built CloudWatch integration.\n\n\u003cbr\u003e\n\n## Built for AWS\n\n**EKS** - Cortex runs on top of EKS to scale workloads reliably and cost-effectively.\n\n**VPC** - deploy clusters into a VPC on your AWS account to keep your data private.\n\n**IAM** - integrate with IAM for authentication and authorization workflows.\n","funding_links":[],"categories":["Go","Model Serving and Monitoring","Deep Learning Framework","Deployment and Serving","Full Stack Deep Learning tools in data processing pipeline:","模型序列化和转换","语言资源库","📦 Modules/Packages","Model Deployment and Orchestration Frameworks","分布式机器学习","Python"],"sub_categories":["Deployment \u0026 Distribution","Map generation","go",":curly_loop: Typography","General-Purpose Machine Learning"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcortexlabs%2Fcortex","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcortexlabs%2Fcortex","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcortexlabs%2Fcortex/lists"}