An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with llm-optimization

A curated list of projects in awesome lists tagged with llm-optimization .

https://github.com/ronantakizawa/sleeptimecompute

A Demo of Running Sleep-time Compute to Reduce LLM Latency

ai llm llm-optimization

Last synced: 04 Mar 2026

https://github.com/pjsheals/businessmate-prompt-library

LLM-optimised prompt library for BusinessMate — the AI strategy coach for small business owners (SMB's) and solopreneurs.

ai-tools businessmate llm-optimization openai prompts shopify-apps small-business small-business-tools solopreneur

Last synced: 18 May 2026

https://github.com/bjornmelin/llm-gpu-optimization

🚄 Advanced LLM optimization techniques using CUDA. Features efficient attention mechanisms, custom CUDA kernels for transformers, and memory-efficient training strategies. ⚡

cuda deep-learning gpu-acceleration llm-optimization machine-learning memory-optimization parallel-computing transformers

Last synced: 18 Mar 2025

https://github.com/57ave/coptai

Coptai an optimization tools for open-source models in Rust

ai llm-optimization low-latency low-level rust slm-optimization

Last synced: 04 Apr 2026

https://github.com/aryaminus/dspy-proxy

A REST API server for DSPy that enables language model programming from any language. This proxy exposes DSPy's core functionality - signature registration, module execution, optimization, and evaluation - through HTTP endpoints, making it accessible from non-Python environments.

ai chain-of-thought dspy fastapi llm-optimization machine-learning microservice nlp prompt-engineering proxy-server rest-api

Last synced: 12 May 2026