https://github.com/tangle-network/vllm-inference-blueprint
Anonymous LLM inference blueprint for Tangle — vLLM + ShieldedCredits pay-per-use
https://github.com/tangle-network/vllm-inference-blueprint
Last synced: 23 days ago
JSON representation
Anonymous LLM inference blueprint for Tangle — vLLM + ShieldedCredits pay-per-use
- Host: GitHub
- URL: https://github.com/tangle-network/vllm-inference-blueprint
- Owner: tangle-network
- Created: 2026-03-18T01:18:53.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2026-04-03T19:31:03.000Z (24 days ago)
- Last Synced: 2026-04-04T07:44:27.290Z (23 days ago)
- Language: Rust
- Size: 457 KB
- Stars: 0
- Watchers: 0
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
vLLM Inference Blueprint
Anonymous LLM inference on Tangle — operators serve vLLM, users pay anonymously via shielded credits.
## Overview
A Tangle Blueprint enabling operators to serve LLM inference via [vLLM](https://github.com/vllm-project/vllm) with anonymous payments through the [Shielded Payment Gateway](https://github.com/tangle-network/shielded-payment-gateway).
**Dual payment paths:**
- **On-chain jobs** via TangleProducer — verifiable results on Tangle
- **x402 HTTP** — fast private inference at `/v1/chat/completions`
Single model per instance. Built with [Blueprint SDK](https://github.com/tangle-network/blueprint) `0.1.0-alpha.22`.
## Components
| Component | Language | Description |
|-----------|----------|-------------|
| `operator/` | Rust | Operator binary — vLLM subprocess, HTTP server, SpendAuth billing |
| `contracts/` | Solidity | InferenceBSM — GPU validation, model pricing (24 tests) |
| `sdk/` | TypeScript | Client SDK — OpenAI-compatible interface with spend auth signing |
## Related Repos
- [shielded-payment-gateway](https://github.com/tangle-network/shielded-payment-gateway) — the payment layer
- [blueprint](https://github.com/tangle-network/blueprint) — Blueprint SDK
- [tnt-core](https://github.com/tangle-network/tnt-core) — Tangle core protocol
## License
MIT