https://github.com/penguintechinc/nest

Kubernetes-native multi-tenant data infrastructure platform — provisions block, file, object, databases, search, and streaming backends as DataResource CRs, backed by Rook-Ceph.
https://github.com/penguintechinc/nest

Last synced: 2 months ago
JSON representation

Kubernetes-native multi-tenant data infrastructure platform — provisions block, file, object, databases, search, and streaming backends as DataResource CRs, backed by Rook-Ceph.

• Host: GitHub
• URL: https://github.com/penguintechinc/nest
• Owner: penguintechinc
• Created: 2025-10-07T19:12:41.000Z (10 months ago)
• Default Branch: main
• Last Pushed: 2026-05-11T15:28:28.000Z (2 months ago)
• Last Synced: 2026-05-11T15:36:57.076Z (2 months ago)
• Language: TypeScript
• Homepage: https://www.nestdata.app
• Size: 52.4 MB
• Stars: 0
• Watchers: 0
• Forks: 0
• Open Issues: 18
• Metadata Files:
  • Readme: README.md
  • Contributing: docs/CONTRIBUTING.md
  • Funding: .github/FUNDING.yml

Awesome Lists containing this project

README

          


  



[![CI](https://github.com/penguintechinc/nest/actions/workflows/ci.yml/badge.svg)](https://github.com/penguintechinc/nest/actions/workflows/ci.yml)

[![Docker Build](https://github.com/penguintechinc/nest/actions/workflows/docker-build.yml/badge.svg)](https://github.com/penguintechinc/nest/actions/workflows/docker-build.yml)

[![Go Report Card](https://goreportcard.com/badge/github.com/penguintechinc/nest)](https://goreportcard.com/report/github.com/penguintechinc/nest)

[![License](https://img.shields.io/badge/License-Limited%20AGPL3-blue.svg)](LICENSE.md)

# Nest — Kubernetes-Native Data Infrastructure Platform

Nest is a multi-tenant data infrastructure platform for Kubernetes. It provisions and lifecycle-manages storage, databases, search, streaming, and analytics backends as first-class Kubernetes resources (`DataResource` CRs), on behalf of isolated tenants.

**Module:** `github.com/penguintechinc/nest`  

**API base:** `/api/v1`

## What Nest Manages

Block volumes, shared filesystems, S3-compatible object buckets, PostgreSQL clusters, Valkey/Redis, Kafka, OpenSearch (dedicated and shared multi-tenant), ClickHouse, Trino, Iceberg, vector databases, NFS, iSCSI — and cloud-native equivalents (EBS, GCS, Azure Blob, etc.).

All resources are provisioned through a single `DataResource` CR and managed by the Nest k8s-controller. Rook-Ceph provides the on-cluster storage backend. Cloud-native block and object storage (AWS EBS/S3, Azure Disk/Blob, GCP PD/GCS) is available via 3rd-party management mode.

## Management Modes

Nest operates in two modes, selectable per `DataResource` via `spec.origination`:

**1st Party — Managed** (`origination: managed`, default)  

Nest provisions and fully lifecycle-manages the resource on-cluster using Rook-Ceph (block, file, object), CNPG (PostgreSQL), OpenSearch, Valkey, and other operators. Full feature support: data protection, PITR, DarkDrive-aware scheduling, CSI, Eggs, anomaly detection.

**3rd Party — Cloud-Native** (`origination: external`)  

Nest provisions and manages cloud-provider resources via their native APIs — AWS EBS/S3, Azure Managed Disk/Blob, GCP Persistent Disk/GCS. DataResource lifecycle (create/delete/status), tenant isolation, quota, and audit are fully supported. Some features are unavailable or provider-dependent. See [docs/spec/provider-support.md](docs/spec/provider-support.md) for the feature matrix.

**Imported** (`origination: imported`)  

Nest registers and monitors an existing external resource (e.g. an existing RDS instance) without provisioning it. Supports introspection and health probing only.

## Quick Start

```bash

# Deploy Nest

kubectl kustomize k8s/kustomize/overlays/alpha | kubectl apply -f -

# Provision a block volume

kubectl apply -f - <