https://github.com/swisstxt/cloudstack-cloud-controller-manager
This project is no longer maintained. Please migrate to https://github.com/apache/cloudstack-kubernetes-provider
https://github.com/swisstxt/cloudstack-cloud-controller-manager
cargo ccm cloudstack golang kubernetes
Last synced: 9 days ago
JSON representation
This project is no longer maintained. Please migrate to https://github.com/apache/cloudstack-kubernetes-provider
- Host: GitHub
- URL: https://github.com/swisstxt/cloudstack-cloud-controller-manager
- Owner: swisstxt
- License: apache-2.0
- Archived: true
- Created: 2018-11-20T13:42:05.000Z (about 7 years ago)
- Default Branch: master
- Last Pushed: 2019-09-20T09:43:53.000Z (over 6 years ago)
- Last Synced: 2024-06-20T05:16:18.400Z (over 1 year ago)
- Topics: cargo, ccm, cloudstack, golang, kubernetes
- Language: Go
- Homepage:
- Size: 51 MB
- Stars: 9
- Watchers: 6
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE-2.0
Awesome Lists containing this project
README
# CloudStack Kubernetes Provider
| :warning: :construction: :gift: Ownership of this project was transferred to the Apache foundation.
| --- |
| It will no longer be maintained. Please migrate to [apache/cloudstack-kubernetes-provider](https://github.com/apache/cloudstack-kubernetes-provider) |
[](https://github.com/swisstxt/cloudstack-cloud-controller-manager/releases)
[](/LICENSE-2.0)
[](https://golang.org)
[](https://hub.docker.com/r/swisstxt/cloudstack-cloud-controller-manager/)
A Cloud Controller Manager to facilitate Kubernetes deployments on Cloudstack.
Based on the old Cloudstack provider in Kubernetes that will be removed soon.
## Deployment
### Kubernetes
Prebuilt containers are posted on [Docker Hub](https://hub.docker.com/r/swisstxt/cloudstack-cloud-controller-manager).
The cloud controller is intended to be deployed as a daemon set, with on instance running on each node.
To configure API access to your CloudStack management server, you need to create a secret containing a `cloudstack.ini`
that is suitable for your environment.
`cloudstack.ini` should look like this:
```ini
[Global]
api-url =
api-key =
secret-key =
project-id =
zone =
ssl-no-verify =
```
The access token needs to be able to fetch VM information and deploy load balancers in the project or domain where the nodes reside.
To create the secret, use the following command:
```bash
kubectl create secret generic cloudstack-secret --from-file=cloudstack.ini
```
You can then use the provided example [deployment.yaml](/deployment.yaml) to deploy the controller:
```bash
kubectl apply -f deployment.yaml
```
### Protocols
This CCM supports TCP, UDP and [TCP-Proxy](https://www.haproxy.org/download/1.8/doc/proxy-protocol.txt) LoadBalancer deployments.
For UDP and Proxy Protocol support, CloudStack 4.6 or later is required.
Since kube-proxy does not support the Proxy Protocol or UDP, you should connect this directly to pods, for example by deploying a DaemonSet and setting `hostNetwork: true`.
The service running in the pod must support the protocol.
See [service.yaml](/service.yaml) for an example Service deployment and part of a suitable configuration for an ingress controller.
### Node Labels
:warning: **The node name must match the host name, so the controller can fetch and assign metadata from CloudStack.**
It is recommended to launch `kubelet` with the following parameter:
```
--register-with-taints=node.cloudprovider.kubernetes.io/uninitialized=true:NoSchedule
```
This will treat the node as 'uninitialized' and cause the CCM to apply metadata labels from CloudStack automatically.
Supported labels are:
* kubernetes.io/hostname (= the instance name)
* beta.kubernetes.io/instance-type (= the compute offering)
* failure-domain.beta.kubernetes.io/zone (= the zone)
* failure-domain.beta.kubernetes.io/region (also = the zone)
It is also possible to trigger this process manually by issuing the following command:
```
kubectl taint nodes node.cloudprovider.kubernetes.io/uninitialized=true:NoSchedule
```
## Migration Guide
There are several notable differences to the old Kubernetes CloudStack cloud provider that need to be taken into
account when migrating from the old cloud provider to the standalone controller.
### Load Balancer
Load balancer rule names now include the protocol in addition to the LB name and service port.
This was added to distinguish tcp, udp and tcp-proxy services operating on the same port.
Without this change, it would not be possible to map a service that runs on both TCP and UDP port 8000, for example.
:warning: **If you have existing rules, remove them before the migration, and add them back afterwards.**
If you don't do this, you will end up with duplicate rules for the same service, which won't work.
### Metadata
Since the controller is now intended to be run inside a pod and not on the node, it will not be able to fetch metadata from the Virtual Router's DHCP server.
Instead, it first obtains the name of the node from Kubernetes, then fetches information from the CloudStack API.
## Development
### Building
Go 1.12 is required to build cloudstack-ccm.
It is recommended to build with Go module support, but dependencies are also vendored.
To build the controller with correct versioning, some build flags need to be passed.
A Makefile is provided that sets these build flags to values obtained from git.
```bash
go get github.com/apache/cloudstack-kubernetes-provider
cd ${GOPATH}/src/github.com/apache/cloudstack-kubernetes-provider
make
```
To build the cloudstack-cloud-controller-manager container, please use the provided Dockerfile.
The Makefile will also with that and properly tag the resulting container.
```bash
make docker
```
### Testing
You need a local instance of the CloudStack Management Server or a 'real' one to connect to.
The CCM supports the same cloudstack.ini configuration file format used by [the cs tool](https://github.com/exoscale/cs),
so you can simply point it to that.
```bash
./cloudstack-ccm --cloud-provider external-cloudstack --cloud-config ~/.cloudstack.ini --master k8s-apiserver
```
Replace k8s-apiserver with the host name of your Kubernetes development clusters's API server.
If you don't have a 'real' CloudStack installation, you can also launch a local [simulator instance](https://hub.docker.com/r/cloudstack/simulator) instead. This is very useful for dry-run testing.
## Copyright
© 2018 SWISS TXT AG and the Kubernetes authors.
See LICENSE-2.0 for permitted usage.