https://github.com/redhillsmediafl/caix

caix — native Apple Core AI inference server for Apple silicon (beta): OpenAI/Anthropic API, dashboard, streaming chat with tools/skills/MCP, MTP speculative decoding.

anthropic-api apple-silicon coreml inference-server llm llm-inference local-llm macos mlx neural-engine ollama-alternative on-device-ai openai-api speculative-decoding swift

Last synced: 04 Jul 2026