Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/superluminar-io/super-eks

super-eks is a CDK construct that provides a preconfigured EKS installation with batteries included.
https://github.com/superluminar-io/super-eks

aws cdk k8s kubernetes

Last synced: about 1 month ago
JSON representation

super-eks is a CDK construct that provides a preconfigured EKS installation with batteries included.

Awesome Lists containing this project

README

        

# :no_entry_sign: This project is now archived and exists only for reference :no_entry_sign:

Try https://github.com/aws-quickstart/cdk-eks-blueprints instead!

## :superhero_woman: super-eks

> :warning: **This branch is using cdk v2**: If you are looking for the old cdk v1 version go [here](https://github.com/superluminar-io/super-eks/tree/cdk-v1)

**super-eks** is a [CDK](<(github.com/aws-cdk/cdk)>) construct that provides a preconfigured [EKS](https://aws.amazon.com/eks/) installation with batteries included.
Even when using best practices for your EKS cluster, picking the right setup can be overwhelming.
**super-eks** solves this problem by making a few choices for you as outlined below.

## :sparkles: Features

- :white_check_mark: DNS management with [external-dns](https://github.com/kubernetes-sigs/external-dns)
- :white_check_mark: Forwarding logs to CloudWatch Logs with [fluent-bit](https://github.com/aws/aws-for-fluent-bit)
- :white_check_mark: Ingress management with the [AWS Load Balancer Controller](https://github.com/kubernetes-sigs/aws-load-balancer-controller)
- :white_check_mark: Isolated node groups, one for the shipped components, the other one for your workloads
- :white_check_mark: Hardened node setup, deny nodes altering the VPC setup.
- :white_check_mark: Default to [managed cluster add-ons](https://docs.aws.amazon.com/eks/latest/userguide/update-cluster.html#update-cluster-add-ons) where possible.
- :white_check_mark: Setup [kubernetes-external-secrets](https://github.com/external-secrets/kubernetes-external-secrets) to integrate AWS Secrets Manager

## :world_map: Roadmap

- :hammer_and_wrench: Monitoring with Prometheus and CloudWatch [#21](/../../issues/21)
- :hammer_and_wrench: Backup solution for cluster recovery [#386](/../../issues/386)
- :hammer_and_wrench: Authentication/authorization for workloads with Amazon Cognito [#383](/../../issues/383)
- :hammer_and_wrench: Autoscaling for pods [#385](/../../issues/385)
- :hammer_and_wrench: Autoscaling for cluster [#382](/../../issues/385)
- :hammer_and_wrench: CDK v2 support [#387](/../../issues/387)

## :clapper: Quick Start

The quick start shows you how to setup a **super-eks** cluster.

### Prerequisites

- A working [`aws`](https://aws.amazon.com/cli/) CLI installation with access to an account and administrator privileges
- You'll need a recent [NodeJS](https://nodejs.org) installation
- [kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/) to interact with your fresh cluster
- An editor of your choice
- Roughly 30 minutes of your time and a :coffee:, :tea: or :beverage_box:

To get going you'll need a CDK project. For details please refer to the [detailed guide for CDK](https://docs.aws.amazon.com/cdk/latest/guide/hello_world.html).

Create an empty directory on your system.

```bash
mkdir super-eks-setup && cd super-eks-setup
```

Bootstrap your CDK project, we will use TypeScript, but you can switch to any other supported language.

```bash
npx cdk init sample-app --language typescript
npx cdk bootstrap # Has to be done once for your AWS account
```

Now install the **super-eks** library.

```bash
npm i @superluminar-io/super-eks
```

You need to provide a Route53 [Hosted zone](https://docs.aws.amazon.com/cdk/api/latest/docs/@aws-cdk_aws-route53.HostedZone.html) and **super-eks** will take care of the rest.

```bash
npm i @aws-cdk/aws-route53
```

Paste the snippet into `lib/super-eks-setup-stack.ts`.

```typescript
import * as cdk from "@aws-cdk/core";
import { HostedZone } from "@aws-cdk/aws-route53";
import { SuperEks } from "@superluminar-io/super-eks";

export class SuperEksSetupStack extends cdk.Stack {
constructor(scope: cdk.App, id: string, props?: cdk.StackProps) {
super(scope, id, props);

// Assumes you already have a Route53 zone in your account
const hostedZone = HostedZone.fromLookup(this, "MyZone", {
domainName: "example.com", // Your domain goes here
});

// Setup super-eks
const superEks = new SuperEks(this, "hello-eks", {
hostedZone: hostedZone,
});

// Add nginx installation for testing
superEks.cluster.addHelmChart("nginx", {
createNamespace: true,
namespace: "nginx",
repository: "https://charts.bitnami.com/bitnami",
chart: "nginx",
release: "nginx",
version: "8.5.2",
values: {
ingress: {
enabled: true,
hostname: `nginx.${hostedZone.zoneName}`,
annotations: {
"kubernetes.io/ingress.class": "alb",
"alb.ingress.kubernetes.io/scheme": "internet-facing",
"alb.ingress.kubernetes.io/target-type": "ip",
},
},
},
});
}
}
```

Now deploy the stack.

```bash
npx cdk deploy
```

If everything works, you should see some output.

```bash
✅ IntegrationTestsStack

Outputs:
IntegrationTestsStack.EksClusterConfigCommandAEB22784 = aws eks update-kubeconfig --name EksCluster3394B24C-86f946f02a67416c80413e123d58b628 --region eu-central-1 --role-arn arn:aws:iam::123456789012:role/IntegrationTestsStack-EksClusterMastersRoleA746276-GNW143CGOXG7
IntegrationTestsStack.EksClusterGetTokenCommand53BD6035 = aws eks get-token --cluster-name EksCluster3394B24C-86f946f02a67416c80413e123d58b628 --region eu-central-1 --role-arn arn:aws:iam::123456789012:role/IntegrationTestsStack-EksClusterMastersRoleA746276-GNW143CGOXG7

Stack ARN:
arn:aws:cloudformation:eu-central-1:123456789012:stack/IntegrationTestsStack/06273460-660e-11eb-b4d9-06da4ef2f41a
✨ Done in 1757.52s.
✨ Done in 1757.79s.
```

Paste the `aws eks update-kubeconfig` command into your shell. This will update your `kubeconfig`.

```bash
aws eks update-kubeconfig --name EksCluster3394B24C-86f946f02a67416c80413e123d58b628 --region eu-central-1 --role-arn arn:aws:iam::123456789012:role/IntegrationTestsStack-EksClusterMastersRoleA746276-GNW143CGOXG7
Added new context arn:aws:eks:eu-central-1:123456789012:cluster/EksCluster3394B24C-86f946f02a67416c80413e123d58b628 to /home/super-eks/.kube/config
```

Now let's see if it works.

```bash
NAMESPACE NAME READY STATUS RESTARTS AGE
dns external-dns-7d4d69545d-r5w68 1/1 Running 0 14m
logging aws-for-fluent-bit-qwhwb 1/1 Running 0 14m
logging aws-for-fluent-bit-s7wnj 1/1 Running 0 14m
ingress aws-load-balancer-controller-5b9cbc5497-smfrt 1/1 Running 0 14m
kube-system aws-node-lscgc 1/1 Running 0 18m
kube-system aws-node-zfcdl 1/1 Running 0 18m
kube-system coredns-59b69b4849-9gstn 1/1 Running 0 25m
kube-system coredns-59b69b4849-bssnr 1/1 Running 0 25m
kube-system kube-proxy-9sgtt 1/1 Running 0 18m
kube-system kube-proxy-r4gzg 1/1 Running 0 18m
nginx nginx-67cb444d48-lqzkg 1/1 Running 0 14m
```

Voila! :tada: You now have a super EKS cluster with batteries included!

## :lock_with_ink_pen: Configuring external secrets

External secrets in EKS is automatically deployed and configured. We configure it in such a way that if you tag your secrets with `SuperEKS: secrets`, external secrets will have access. You can follow
the [documentation](https://github.com/external-secrets/kubernetes-external-secrets) to setup secrets but need to tag your secrets in secrets manager, e.g., when creating:

```bash
aws secretsmanager create-secret --name hello-service/password --secret-string "1234" --tags Key=SuperEKS,Value=secrets
```

The service account that will be used by external secrets uses a condition in the IAM policy so that access will be automatically granted.
To keep the setup secure and sound **you have to set namespace annotations** for secrets as described in the
[original documentation](https://github.com/external-secrets/kubernetes-external-secrets#using-namespace-annotation).

## :open_book: API documentation

See the [API documentation](./API.md) for details.

## :gear: Development

- We use [architecture decision records](https://github.com/joelparkerhenderson/architecture_decision_record/blob/master/adr_template_by_michael_nygard.md). See [here](docs/decisions) for the decisions made so far.
- We use the [AWS Cloud Development Kit (CDK)](github.com/aws-cdk/cdk).
- We use [projen](https://github.com/projen/projen/blob/main/API.md#projen-awscdkconstructlibrary) :heart:. Don't edit package.json etc. Always make changes in [.projenrc.js](./.projenrc.js).

## :question: FAQ

Frequently asked questions are answered here.

### What do you mean by "batteries included"?

[Batteries included](https://www.python.org/dev/peps/pep-0206/#batteries-included-philosophy) is a term that comes from the philosophy behind the Python programming language.
It means, that **super-eks** ships with all necessary parts. You don't need additional things, like in this case Helm charts, manifests etc. apart from the workload you want to run on Kubernetes.

### Why did you choose to include component X?

We try to include components, that are seen as community standards. On the other hand we choose components,
that work best in combination with AWS.

### Where are the advanced settings? I want to do things differently

**super-eks** makes some decisions for you. If you want an expert setup maybe **super-eks** isn't for you.
If you believe core functionality is missing please open a GitHub issue.

Our approach is to offer opinionated solutions, but we aim to offer the possibility to opt out, as well.

### I don't want to use CDK? Do you offer alternatives?

No, not for now.

## :balance_scale: License

**super-eks** is distributed under the [Apache License, Version 2.0](https://www.apache.org/licenses/LICENSE-2.0).

See [LICENSE](./LICENSE) for more information.