https://github.com/bretagne-peiqi/lvs-nginx-controller

IPVS based kubernetes controller for large scale cluster autoscaling
https://github.com/bretagne-peiqi/lvs-nginx-controller

autoscale ipvs kubernetes-cluster loadbalancer lvs-controller nginx

Last synced: 2 months ago
JSON representation

IPVS based kubernetes controller for large scale cluster autoscaling

• Host: GitHub
• URL: https://github.com/bretagne-peiqi/lvs-nginx-controller
• Owner: bretagne-peiqi
• Created: 2018-09-03T06:08:33.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2019-11-29T02:34:18.000Z (about 5 years ago)
• Last Synced: 2024-08-04T18:01:12.351Z (6 months ago)
• Topics: autoscale, ipvs, kubernetes-cluster, loadbalancer, lvs-controller, nginx
• Language: Go
• Homepage:
• Size: 6.44 MB
• Stars: 14
• Watchers: 4
• Forks: 8
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# IPVS based kubernetes controller

### Why lvs-nginx-controller

This project is aimed to provide external traffic loadbalancing to kubernetes based container application.

Especially for heavy traffic loads situation.

It currently works only in DR mode, we shall setup ingress-nginx-controllers in HostNetwork mode as 'realserver' of a pair of LVS.

ingress-nginx-controller and its tcp/udp configmaps should be created in a specific namespace

and we can scale out nginx-controller using HPA in heavy workload situation.

external traffics will direct from lvs to ingress-nginx-controller then to endpoint services.

### High level Architecture

![Architecture](./docs/lvs.jpeg "Architecture")

### Adavantages of the architecture

This architecture first offers a Front entrypoint of ip address for L7 ingress traffic, ingress-nginx-controller itself will expose node ip in public which is not good for security,

besides, It implements the scalability (HA) of ingress-nginx-controllers, as LVS is the only entrypoint of the cluster.

Second, we can simply config tcp/udp configmaps of ingress-nginx-controller, then the lvs-nginx-controller will update and reload lvs

configs in hot mode. Thus offering L4 TCP/UDP loadbalancing functionnalities.

In a very heavy traffic situation, we can also deploy several lvs pairs in Front for different application services.

This architecture avoids the vulnerability of traditinnal NodePort mode, as it exposes ports in every nodes, which may be

good in cloud environ, but could definitly be security threat in bare-metal environment.

Lvs loadbalancer can offer some high-level loadlalancing feature such as persistent port connections, persistent netfilter marked connections, timeout configs set etc ...

### Running

In order to make it works, we need to config nodes running ingress-nginx-controller according scripts in dir install.

to debug and print gc logs, 

* build:	go build cmd/lvs-controller/main.go

* run:  	GODEBUG='gctrace=1' ./lvs-controller --debug --kubeconfig kubeconfig -vip 10.135.22.77 --schedname rr 2>&1>gc.log &

### Typical use cases

We could config vip in a pair of lvs and register it in a public dns, This virtual ipv4 should be the same as cluster ipv4 in ingress when using DR mode.

When workloads pass nginx-controller, it will direct to backend endpoints

## State

	in developping, any contribution will be welcomed.