{"id":44989515,"url":"https://github.com/peeramid-labs/nsed","last_synced_at":"2026-04-02T18:29:06.717Z","repository":{"id":339235462,"uuid":"1158382238","full_name":"peeramid-labs/nsed","owner":"peeramid-labs","description":"N-Way Self-Deliberating Evaluation Engine core for AI agent orchestration","archived":false,"fork":false,"pushed_at":"2026-03-30T17:17:05.000Z","size":4332,"stargazers_count":11,"open_issues_count":41,"forks_count":0,"subscribers_count":0,"default_branch":"dev","last_synced_at":"2026-03-30T17:21:35.764Z","etag":null,"topics":["agentic-framework","ai","ai-agents","ai-orchestration"],"latest_commit_sha":null,"homepage":"https://peeramid.xyz","language":"Rust","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/peeramid-labs.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":"NOTICE","maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-02-15T09:19:57.000Z","updated_at":"2026-03-29T21:52:29.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/peeramid-labs/nsed","commit_stats":null,"previous_names":["peeramid-labs/nsed"],"tags_count":12,"template":false,"template_full_name":null,"purl":"pkg:github/peeramid-labs/nsed","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peeramid-labs%2Fnsed","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peeramid-labs%2Fnsed/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peeramid-labs%2Fnsed/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peeramid-labs%2Fnsed/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/peeramid-labs","download_url":"https://codeload.github.com/peeramid-labs/nsed/tar.gz/refs/heads/dev","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/peeramid-labs%2Fnsed/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31312900,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-02T12:59:32.332Z","status":"ssl_error","status_checked_at":"2026-04-02T12:54:48.875Z","response_time":89,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agentic-framework","ai","ai-agents","ai-orchestration"],"created_at":"2026-02-18T21:03:27.234Z","updated_at":"2026-04-02T18:29:06.708Z","avatar_url":"https://github.com/peeramid-labs.png","language":"Rust","funding_links":[],"categories":[],"sub_categories":[],"readme":"# NSED\n\n[![CI](https://github.com/peeramid-labs/nsed/actions/workflows/ci.yml/badge.svg)](https://github.com/peeramid-labs/nsed/actions/workflows/ci.yml)\n![Coverage](https://img.shields.io/badge/coverage-66.9%25-yellow?logo=rust)\n[![License: BSL 1.1](https://img.shields.io/badge/License-BSL_1.1-blue.svg)](LICENSE)\n\nEnterprise-ready agentic orchestration layer implementing the **[N-Way Self-Evaluating Deliberation (NSED)](https://arxiv.org/abs/2601.16863)** protocol. Multiple AI agents work on your task in parallel, having intermediate checkpoints and converging on a final answer. NSED delivers frontier reasoning ability through a Mixture-of-Models architecture that amplifies the strengths of individual models. It shows less sycophancy, cost tracking, optimisation, and a full compliance audit trail managed through NATS as a high-performance communication bus.\n\n## Why NSED\n\nThree small open-weight models (20B, 8B, 12B) on consumer hardware score **84% on AIME 2025** through NSED deliberation — matching DeepSeek-R1 and coming within 1 point of GPT-5. The same models score 54% with naive majority voting. ([paper](https://arxiv.org/abs/2601.16863))\n\n| Problem | How NSED Solves It |\n|---|---|\n| **Single-model quality ceiling** | Mixture of Models: agents from different providers cross-evaluate each other every round — errors get caught, reasoning improves iteratively |\n| **Black-box AI decisions** | Full audit trail: every proposal, evaluation, score, and reasoning trace is persisted and streamable via SSE |\n| **Data leaves your network** | Run entirely on your infrastructure with local models (Ollama, vLLM) — documents never touch a third-party API |\n| **No human oversight at runtime** | Inject guidance mid-deliberation, expose custom tools agents can call back to your systems, set time/token/cost budgets |\n| **Vendor lock-in** | Provider-agnostic: mix Ollama, vLLM, Together AI, or any compatible endpoint in the same session |\n| **Frontier model hardware costs** | A swarm of 8B–20B models in 64 GB total VRAM matches reasoning quality that normally requires 80–140 GB for a single monolithic model |\n\n## Quick Start\n\n### Docker (recommended)\n\nFirst, install the CLI from source (requires [Rust](https://rustup.rs/) ≥ 1.85):\n\n```bash\ngit clone https://github.com/peeramid-labs/nsed.git \u0026\u0026 cd nsed\ncargo install --path crates/nsed-orchestrator\n```\n\nThen run the interactive setup wizard:\n\n```bash\nnsed-orchestrator init        # discover providers, assign agents\ndocker compose up -d          # start orchestrator + NATS + agents\n# open http://localhost:8080/dashboard in your browser\n```\n\nThe `init` wizard auto-detects local Ollama, walks through LLM provider setup, and writes `docker-compose.yml` + `.env` ready to run.\n\n### From source\n\n```bash\ngit clone https://github.com/peeramid-labs/nsed.git \u0026\u0026 cd nsed\ncp .env.example .env          # add your API keys (Together AI, etc.)\nmake setup                    # install tools, configure git hooks\nmake docker-up                # start NATS + Ollama infrastructure\nmake run                      # build and run the orchestrator\n```\n\n```text\nINFO  Dashboard  → http://127.0.0.1:8080/dashboard\nINFO  Swagger UI → http://127.0.0.1:8080/swagger-ui/\n```\n\nOr try simulation mode (no API keys needed): `make dev-sim`\n\nFor binary installation, Docker, Homebrew, and APT options see the [orchestrator README](crates/nsed-orchestrator/README.md#installation).\n\n## Workspace\n\n```text\nnsed-agent-sdk  \u003c--  nsed-agent  \u003c--  nsed-orchestrator\n    traits           implementations        server\n```\n\n| Crate | Description |\n|---|---|\n| [`nsed-agent-sdk`](crates/nsed-agent-sdk/) | Trait definitions and data types for building custom agents |\n| [`nsed-agent`](crates/nsed-agent/) | Reference agent implementation with NATS worker runtime |\n| [`nsed-orchestrator`](crates/nsed-orchestrator/) | API gateway, job broker, deliberation engine, dashboard |\n| [`nsed-crypto-core`](crates/nsed-crypto-core/) | Cryptographic traits and classical signers (MIT) |\n| [`nsed-crypto`](crates/nsed-crypto/) | Protocol crypto — PQ signing, Poseidon, commitment chains (BSL) |\n| [`nsed-benchmarks`](crates/nsed-benchmarks/) | Benchmark suite (GSM8K, AIME, LiveCodeBench) |\n\nEach crate has its own `Makefile` with crate-specific targets (e.g. `make run-agent`, `make test-sdk`). The root `Makefile` includes all four, so every target works from the workspace root. See [docs/development.md](docs/development.md#make-commands) for the full list.\n\n## Documentation\n\n| Topic | Link |\n|---|---|\n| **Operator: Connect Agent to Remote Orchestrator** | [docs/operator-agent-setup.md](docs/operator-agent-setup.md) |\n| Architecture | [docs/architecture.md](docs/architecture.md) |\n| Agent Development | [docs/agent-development.md](docs/agent-development.md) |\n| Agent Internals (Library API) | [docs/agent-internals.md](docs/agent-internals.md) |\n| Authentication | [docs/auth.md](docs/auth.md) |\n| Compute Ledger \u0026 Budget | [docs/ledger.md](docs/ledger.md) |\n| Agent Ranking \u0026 Capabilities | [docs/agent-ranking.md](docs/agent-ranking.md) |\n| Agent Middleware | [docs/middleware.md](docs/middleware.md) |\n| Cryptographic Infrastructure | [docs/crypto.md](docs/crypto.md) |\n| NATS Integration | [docs/NATS.md](docs/NATS.md) |\n| Development \u0026 Configuration | [docs/development.md](docs/development.md) |\n| Contributing | [CONTRIBUTING.md](CONTRIBUTING.md) |\n| API (Swagger UI) | `http://localhost:8080/swagger-ui/` (while running) |\n\n## Reproduce paper results\n\nTo reproduce results we've obtained during paper research please switch on to `paper-reproduce` [branch of this repository](https://github.com/peeramid-labs/nsed/tree/paper-reproduce) which is frozen on the old commit \"as is\". Further guidelines are in the readme of that branch.\n\n## License\n\n| Component | License |\n|---|---|\n| `crates/nsed-agent-sdk/` | [MIT](crates/nsed-agent-sdk/LICENSE-MIT) |\n| `crates/nsed-agent/` | [BSL 1.1](LICENSE) |\n| `crates/nsed-orchestrator/` | [BSL 1.1](LICENSE) |\n| `crates/nsed-benchmarks/` | [Apache 2.0](crates/nsed-benchmarks/LICENSE) |\n\nSource-available under the [Business Source License 1.1](LICENSE). Free for entities under $1M USD annual revenue, research, education, and development. [Commercial license](https://peeramid.xyz/licensing) required above the threshold. Converts to AGPL-3.0 after 4 years.\n\nSee [NOTICE](NOTICE) for patent, AI training, and ethical use terms.\n\n---\n\nCopyright (c) 2025 Tri Ratna Technologies Limited, trading as Peeramid Labs.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpeeramid-labs%2Fnsed","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpeeramid-labs%2Fnsed","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpeeramid-labs%2Fnsed/lists"}