{"id":29736090,"url":"https://github.com/juliensimon/arcee-demos","last_synced_at":"2026-04-20T19:31:07.793Z","repository":{"id":305002197,"uuid":"1021585487","full_name":"juliensimon/arcee-demos","owner":"juliensimon","description":"A collection of demos, examples, and tools for using Arcee AI models and services across various platforms and use cases.","archived":false,"fork":false,"pushed_at":"2026-03-29T15:43:13.000Z","size":15407,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2026-03-29T18:17:00.389Z","etag":null,"topics":["aws","deep-learning","generative-ai","huggingface","intel","open-source","togetherai"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/juliensimon.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-07-17T16:11:37.000Z","updated_at":"2026-03-29T15:43:17.000Z","dependencies_parsed_at":"2025-07-17T22:18:27.717Z","dependency_job_id":"e99bcd1c-af2c-4deb-bf31-ffbd5f50dd77","html_url":"https://github.com/juliensimon/arcee-demos","commit_stats":null,"previous_names":["juliensimon/arcee-demos"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/juliensimon/arcee-demos","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/juliensimon%2Farcee-demos","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/juliensimon%2Farcee-demos/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/juliensimon%2Farcee-demos/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/juliensimon%2Farcee-demos/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/juliensimon","download_url":"https://codeload.github.com/juliensimon/arcee-demos/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/juliensimon%2Farcee-demos/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32062210,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-20T11:35:06.609Z","status":"ssl_error","status_checked_at":"2026-04-20T11:34:48.899Z","response_time":94,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","deep-learning","generative-ai","huggingface","intel","open-source","togetherai"],"created_at":"2025-07-25T14:01:36.420Z","updated_at":"2026-04-20T19:31:07.788Z","avatar_url":"https://github.com/juliensimon.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Arcee AI Demos: Deploy, Fine-Tune, and Evaluate Small Language Models\n\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![Python 3.8+](https://img.shields.io/badge/python-3.8+-blue.svg)](https://www.python.org/downloads/)\n[![Arcee AI](https://img.shields.io/badge/Arcee-AI-purple)](https://arcee.ai)\n[![Conductor](https://img.shields.io/badge/Conductor-API-green)](https://conductor.arcee.ai)\n\nHands-on examples for deploying, evaluating, and optimizing [Arcee AI](https://arcee.ai) language models — including the Trinity model family, AFM, Virtuoso, and more — across AWS, Intel, Apple Silicon, and cloud API platforms.\n\nWhether you're looking to run LLMs locally on a MacBook, deploy on AWS SageMaker, benchmark model quantizations, or build RAG applications, this repository has a working demo for you.\n\n## Repository Structure\n\n| Demo | Description |\n|------|-------------|\n| [**trinity-mini**](./trinity-mini/) | Build a transparent reasoning chatbot with Arcee Trinity Mini on OpenRouter |\n| [**trinity-mini-mlx**](./trinity-mini-mlx/) | Run Trinity Mini locally on Apple Silicon with MLX — no cloud, no API keys |\n| [**conductor-rag**](./conductor-rag/) | Retrieval-Augmented Generation (RAG) document Q\u0026A app with Arcee Conductor |\n| [**conductor-ab-testing**](./conductor-ab-testing/) | A/B testing tool for comparing LLM responses with semantic similarity metrics |\n| [**data-enrichment**](./data-enrichment/) | AI-powered medical equipment metadata enrichment with Arcee AFM-4.5B |\n| [**together-ai**](./together-ai/) | Domain-specific LLM benchmarking with radar charts via Together.ai |\n| [**sagemaker**](./sagemaker/) | Deploy Arcee models on AWS SageMaker (CPU, GPU, vLLM) |\n| [**inferentia2**](./inferentia2/) | Run Arcee models on AWS Inferentia2 custom AI accelerators |\n| [**openvino-lunar-lake**](./openvino-lunar-lake/) | Optimize and run models on Intel Lunar Lake with OpenVINO |\n| [**openvino-granite-rapids**](./openvino-granite-rapids/) | Deploy AFM-4.5B on Intel Xeon 6 (Granite Rapids) with OpenVINO Model Server |\n| [**spectrum**](./spectrum/) | Model quantization and fine-tuning configs (LoRA, QLoRA, Spectrum, SVD) |\n| [**model-engine**](./model-engine/) | Test notebooks for Arcee Model Engine variants (Auto, Coder, Virtuoso, Caller) |\n| [**arcee-agent**](./arcee-agent/) | AI agent demos with tool use (Yahoo Finance assistant) |\n| [**anymcp**](./anymcp/) | Arcee AnyMCP integration examples |\n\n## Getting Started\n\nEach subdirectory contains its own README with setup instructions. Generally, you'll need:\n\n1. Python 3.8+\n2. Required API keys (Arcee Conductor, Together.ai, OpenRouter, etc.)\n3. Dependencies installed via `pip install -r requirements.txt` in the respective directory\n\n## Author\n\nBuilt by [Julien Simon](https://julien.org). Read more about practical AI and small language models on the [AI Realist](https://www.airealist.ai) Substack.\n\n## License\n\nThis project is licensed under the MIT License — see the LICENSE file for details.\n\n## Resources\n\n- [Arcee AI](https://arcee.ai) — Small language models for enterprise\n- [Conductor API](https://conductor.arcee.ai) — Arcee's model serving platform\n- [Together.ai](https://docs.together.ai/) — Cloud inference API\n- [AI Realist](https://www.airealist.ai) — Julien's Substack on practical AI\n- [julien.org](https://julien.org) — Author's website\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjuliensimon%2Farcee-demos","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjuliensimon%2Farcee-demos","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjuliensimon%2Farcee-demos/lists"}