Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/lreimer/mastering-gitops

Demo repository for Crossplane talk at Mastering GitOps conference
https://github.com/lreimer/mastering-gitops

aws conference crossplane crossplane-provider demos fluxcd gcp gitops kubernetes

Last synced: 3 months ago
JSON representation

Demo repository for Crossplane talk at Mastering GitOps conference

Awesome Lists containing this project

README 

        
# kubectl apply -f cloud-infrastructure.yaml with Crossplane



Demo repository for my Crossplane conference talk.



## Prerequisites



You need to have the following tools installed locally to be able to complete all steps:

- [AWS CLI v2](https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2.html)

- [eksctl](https://eksctl.io/)

- [gcloud CLI](https://cloud.google.com/sdk/gcloud)

- [kubectl](https://docs.aws.amazon.com/eks/latest/userguide/install-kubectl.html)

- [flux](https://fluxcd.io/docs/get-started/)

- [Helm](https://helm.sh/docs/intro/install/)



## Local Installation



For local installation simply follow the instructions found on the official [Crossplane documentation](https://crossplane.io/docs/v1.7/getting-started/install-configure.html).



```bash

# install latest Crossplane release using Helm in a dedicated namespace

kubectl create namespace crossplane-system



helm repo add crossplane-stable https://charts.crossplane.io/stable

helm repo update



helm install crossplane --namespace crossplane-system crossplane-stable/crossplane --set provider.packages={crossplane/provider-aws:v0.24.1}



## check everything came up OK

helm list -n crossplane-system

kubectl get all -n crossplane-system

```



## Bootstrapping



```bash

# define required ENV variables for the next steps to work

$ export AWS_ACCOUNT_ID=`aws sts get-caller-identity --query Account --output text`

$ export GITHUB_USER=lreimer

$ export GITHUB_TOKEN=



# setup an EKS cluster with Flux2

$ make create-eks-cluster

$ make bootstrap-eks-flux2



# setup a GKE cluster with Flux2

$ make create-gke-cluster

$ make bootstrap-gke-flux2



# modify Flux kustomization and add

# - cluster-sync.yaml

# - notification-receiver.yaml

# - receiver-service.yaml

# - webhook-token.yaml

# - image-update-automation.yaml



# you also need to create the webhook for the Git Repository

# Payload URL: http:///

# Secret: the webhook-token value

$ kubectl -n flux-system get svc/receiver

$ kubectl -n flux-system get receiver/webapp



$ make destroy-clusters

```



## AWS Provider



For AWS the configuration needs to reference the required credentials in the form of a secret.

These are basically the `aws_access_key_id` and `aws_secret_access_key` from the default profile found in the `${HOME}/.aws/credentials` file. With this information we can create a secret and reference it from a provider config resource.



```bash

kubectl create secret generic aws-credentials -n crossplane-system --from-file=credentials=${HOME}/.aws/credentials



# we could manually installe the AWS provider

# kubectl crossplane install provider crossplane/provider-aws:v0.24.1



cd crossplane/aws/

kubectl apply -n crossplane-system -f provider.yaml

kubectl apply -n crossplane-system -f providerconfig.yaml



kubectl get events

kubectl get crds



# create an S3 bucket in eu-central-1

kubectl apply -f s3/bucket.yaml

aws s3 ls



# create an ECR in eu-central-1

kubectl apply -f ecr/repository.yaml

aws ecr describe-repositories



# create SNS topic and subscription

kubectl apply -f sns/topic.yaml

aws sns list-topics

kubectl apply -f sns/subscription.yaml

aws sns list-subscriptions

aws sns publish --subject Test --message Crossplane --topic-arn arn:aws:sns:eu-central-1::email-topic



# create a SQS queue

kubectl apply -f sqs/queue.yaml

aws sqs list-queues



# create Aurora Serverless

kubectl apply -f db/aurora-serverless.yaml

aws rds describe-db-clusters

kubectl apply -f db/aurora-client.yaml



# use XRD to create an ECR

kubectl apply -f xrd/repository/definition.yaml

kubectl apply -f xrd/repository/composition.yaml

kubectl apply -f xrd/repository/examples/example-repository.yaml



cd xrd/repository/

kubectl crossplane build configuration --ignore=examples/example-repository.yaml



# use XRD to create an S3 bucket

kubectl apply -f xrd/bucket/definition.yaml

kubectl apply -f xrd/bucket/composition.yaml

kubectl apply -f xrd/bucket/examples/example-bucket.yaml



cd xrd/bucket/

kubectl crossplane build configuration --ignore=examples/example-bucket.yaml



# use XRD to create PostgreSQL instance

kubectl apply -f xrd/postgresql/definition.yaml

kubectl apply -f xrd/postgresql/composition.yaml

kubectl apply -f xrd/postgresql/examples/example-db.yaml



kubectl get postgresqlinstances.db.aws.qaware.de example-db

kubectl get claim



kubectl get secrets

kubectl describe secret example-db-conn



kubectl apply -f xrd/postgresql/examples/example-db-client.yaml

kubectl get pods

kubectl logs example-db-client-sjdh7



cd xrd/postgresql/

kubectl crossplane build configuration --ignore=examples/example-db.yaml,examples/example-db-client.yaml

```



## GCP Provider



For examples of the GCP provider have a look the [Github repository](https://github.com/crossplane/provider-gcp/tree/master/examples)



```bash

# we need to create a GCP service account and secret

gcloud iam service-accounts create crossplane-system --display-name=Crossplane

gcloud projects add-iam-policy-binding cloud-native-experience-lab --role=roles/iam.serviceAccountUser --member serviceAccount:crossplane-system@cloud-native-experience-lab.iam.gserviceaccount.com

gcloud projects add-iam-policy-binding cloud-native-experience-lab --role=roles/storage.admin --member serviceAccount:crossplane-system@cloud-native-experience-lab.iam.gserviceaccount.com



gcloud iam service-accounts keys create gcp-credentials.json --iam-account crossplane-system@cloud-native-experience-lab.iam.gserviceaccount.com



kubectl create secret generic gcp-credentials -n crossplane-system --from-file=credentials=./gcp-credentials.json



# we could manually installe the AWS provider

# kubectl crossplane install provider crossplane/provider-gcp:v0.21.0



cd crossplane/gcp/

kubectl apply -n crossplane-system -f provider.yaml

kubectl apply -n crossplane-system -f providerconfig.yaml



# create an storage bucket in eu-central-1

kubectl apply -f storage/bucket.yaml

gsutil ls

```



## Maintainer



M.-Leander Reimer (@lreimer), 



## License



This software is provided under the MIT open source license, read the `LICENSE`

file for details.