{"id":26197166,"url":"https://github.com/didier-durand/llms-in-clouds","last_synced_at":"2025-04-15T03:55:32.824Z","repository":{"id":280253776,"uuid":"940696471","full_name":"didier-durand/llms-in-clouds","owner":"didier-durand","description":"Experiments with  LLMs in clouds (powered by SGLang)","archived":false,"fork":false,"pushed_at":"2025-04-07T08:55:24.000Z","size":885,"stargazers_count":6,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-15T03:55:27.487Z","etag":null,"topics":["aiml","aws","docker","granite","huggingface","llama","llm","mistral","qwen","sglang","wan-ai"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/didier-durand.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-02-28T16:21:57.000Z","updated_at":"2025-04-07T08:55:28.000Z","dependencies_parsed_at":"2025-03-02T10:22:28.019Z","dependency_job_id":"c7ab9f1c-583a-4c51-909a-3cc1580db615","html_url":"https://github.com/didier-durand/llms-in-clouds","commit_stats":null,"previous_names":["didier-durand/llms-in-clouds"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/didier-durand%2Fllms-in-clouds","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/didier-durand%2Fllms-in-clouds/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/didier-durand%2Fllms-in-clouds/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/didier-durand%2Fllms-in-clouds/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/didier-durand","download_url":"https://codeload.github.com/didier-durand/llms-in-clouds/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":249003952,"owners_count":21196794,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aiml","aws","docker","granite","huggingface","llama","llm","mistral","qwen","sglang","wan-ai"],"created_at":"2025-03-12T02:24:30.882Z","updated_at":"2025-04-15T03:55:32.815Z","avatar_url":"https://github.com/didier-durand.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n    \u003cimg src=\"assets/lic-header.png\" width=\"800\"/\u003e\n\u003cp\u003e\n\n# LLMs in Clouds: experiments and tools for Large Language Models in clouds\n\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![build Python code](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_python.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_python.yaml)\n[![docker build ubuntu2404 sglang](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_ubuntu2404_sglang.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_ubuntu2404_sglang.yaml)\n[![docker build redhat9 sgLang](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_redhat9_sglang.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_redhat9_sglang.yaml)\n[![docker build al2023 sglang](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_al2023_sglang.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_al2023_sglang.yaml)\n[![docker build Wan AI v2.1](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_wan_ai.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/build_docker_wan_ai.yaml)\n[![cfn-lint template](https://github.com/didier-durand/llms-in-clouds/actions/workflows/lint_cfn.yaml/badge.svg)](https://github.com/didier-durand/llms-in-clouds/actions/workflows/lint_cfn.yaml)\n\n### Preamble\n\nThis repository aggregates several experiments that I run to better use OSS LLMs: Mistral, Meta's Llama, IBM's Granite, Alibaba's Qwen \n\u0026 WAN AI, etc. I also share some tools and utilities that I developed to raise my efficiency and productivity in those experiments. So, feel free \nto come back on a regular basis to discover my latest productions.\n\nAll this content is shared under MIT License (see [its benefits](https://itexus.com/understanding-the-mit-license-a-simple-guide-for-developers-and-businesses/)) \nto make code and content reusable in your own context with no hassle. So, don't hesitate to integrate what you need from \nthis repository in your own context. My humble demand: please, mention this repository as origin whenever you use some of \nits content. Thank you!\n\n### Experiments and tools\n\n\n1. **[OpenManus \u0026 SmolLM as autonomous AI agent](docs/openmanus-smollm.md)** (March 2025): experiment and Docker image (get it with `docker pull didierdurand/openmanus-smollm:latest`) \nto create an autonomous AI agent by integrating OpenManus and HuggingFace's SmolLM (served by Ollama) in a single Docker image for exploration of agentic workflows. \n2. **[SGLang on ECS: efficiently serving leading OSS LLMs](docs/sglang.md)** (March 2025): experiment and Docker image (get it with `docker pull didierdurand/lic-sglang:al2023-latest`) \nto load and execute various leading LLMs on an AWS cluster with Elastic Container Service (ECS). Specific preliminary tests \nwith Qwen QwQ-32B to explore its reasoning capabilities.\n3. **[Wan AI v2.1 video generation](docs/wan2-1.md)** (March 2025): experiment and Docker image (get it with `ddocker pull didierdurand/lic-wan-ai:latest`) \nto generate videos with Alibaba's Wan AI v2.1 models on an AWS cluster with Elastic Container Service (ECS).\n4. **[HuggingFace to S3 Download](/docs/hf-download.md)** (February 2025): a simple AWS CloudFormation template to instantiate in your AWS account in order to efficiently \ndownload families of LLMs from HuggingFace to AWS S3 bucket storage without ever transiting via your laptop or server.\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdidier-durand%2Fllms-in-clouds","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdidier-durand%2Fllms-in-clouds","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdidier-durand%2Fllms-in-clouds/lists"}