https://github.com/testli-ai/outlines-llama-cpp-python-streaming-output
This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.
https://github.com/testli-ai/outlines-llama-cpp-python-streaming-output
gguf gguf-models llama-cpp llama-cpp-python llamacpp llamacpp-python outlines
Last synced: 3 months ago
JSON representation
This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.
- Host: GitHub
- URL: https://github.com/testli-ai/outlines-llama-cpp-python-streaming-output
- Owner: testli-ai
- Created: 2025-03-04T08:33:02.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2025-03-04T08:38:42.000Z (3 months ago)
- Last Synced: 2025-03-04T09:33:27.549Z (3 months ago)
- Topics: gguf, gguf-models, llama-cpp, llama-cpp-python, llamacpp, llamacpp-python, outlines
- Language: Python
- Homepage:
- Size: 98.6 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0