https://github.com/nulltea/kicksware-infra

Composite DevOps technology stack solution contains configured for providing databases, CI\CD system, search and analytics engines
https://github.com/nulltea/kicksware-infra

cloud-native elasticsearch helm kibana kubernetes mongodb sneakers

Last synced: 8 months ago
JSON representation

Composite DevOps technology stack solution contains configured for providing databases, CI\CD system, search and analytics engines

Host: GitHub
URL: https://github.com/nulltea/kicksware-infra
Owner: nulltea
License: agpl-3.0
Created: 2020-09-02T02:59:14.000Z (almost 6 years ago)
Default Branch: master
Last Pushed: 2021-03-29T11:40:30.000Z (about 5 years ago)
Last Synced: 2024-01-23T02:47:06.713Z (over 2 years ago)
Topics: cloud-native, elasticsearch, helm, kibana, kubernetes, mongodb, sneakers
Language: Smarty
Homepage: https://ci.kicksware.com/kicksware
Size: 1.99 MB
Stars: 5
Watchers: 2
Forks: 1
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

          # [![repo logo][]][Kicksware url]



	

		

	



[![commit activity badge]][repo commit activity] 

[![db mongo badge]][repo commit activity] 

[![db postgres badge]][repo commit activity] 

[![fs gluster badge]][repo commit activity] 

[![elastic stack badge]][repo commit activity] 

[![kubernetes badge]](https://kubernetes.io) 

[![gitlab badge]](https://ci.kicksware.com/kicksware/kicksware-tool-stack) 

[![tool-stack pipeline]](https://ci.kicksware.com/kicksware/tool-stack/-/commits/master) 

[![license badge]](https://www.gnu.org/licenses/agpl-3.0)

## Overview

_**Kicksware Tool Stack**_ is a composite [DevOps][devops] technology stack solution dedicated to provisioning data, storage, continuous deployment, analytics, monitoring, and more tools needed for Kicksware infrastructure to function as a complete autonomous mechanism.

## Table of contents

* [Overview](#overview)

* [Table of contents](#table-of-contents)

* [DevOps](#devops)

* [Applications](#applications)

* [Requirements](#requirements)

* [Deployment](#deployment)

* [Wrap Up](#wrap-up)

* [License](#license)

## DevOps

To constantly deliver its particular set of services, every component of Kicksware infrastructure goes through its own development lifecycle, every new iteration of which is triggered by every new commit to the codebase.

From there it goes through the individual set of stages, each dedicated to ensure the best possible software quality. Generally, these stages represent base steps needed to build, test and deploy every new piece of code committed to repositories. However, sometimes additional steps are required, such as resolving dependencies, preparing the environment and finale checks whether the pipeline has succeeded and services are ready to serve.

This whole process is accordingly called [Continuous delivery (deployment) and continuous integration (CI/CD)][continuous delivery]. In fact, this practice is so crucial and adopted that currently there are [more than 50 CI/CD][50 ci\cd] tools out there waiting to be used.

Kicksware's CI\CD deployment pipeline is based on [Gitlab CI Community Edition][gitlab ce]. As a matter of fact, [continuous delivery][gitlab ci] is only one side of its [diverse, comprehensive feature set][gitlab features]. Besides, things like Git repositories storage, container and package registries, issue tracking, and really a lot more great features make GitLab a complete DevOps platform for any types of system.

[![kicksware ci browser][]][kicksware ci url]

## Applications

Aside from development and deployment enhancement tools, Kicksware application services themselves require some additional tools to be able to perform tasks they are programmed for.

The most obvious application is, of course, database. Without storing any data it is nearly impossible to achieve the fulfillment of all the business requirements. Therefore, to store user, product, orders, and reference data, Kicksware tool stack contains both [document-based MongoDB][mongodb] and [relational PostgreSQL][postgresql]. And for caching, [blazing-fast Redis][redis] is used, since it is a key-value based, distributed, in-memory database.

In addition, some services depend on a more specific type of software. For instance, a search microservice is requiring some kind of search engine to deliver the result faster and more efficiently. So, for this particular use case, [Elasticsearch][elasticsearch] is used, which in combination with the [Kibana][kibana] analytics dashboard web application produces [Elastic Stack solution][elastic stack]. Some of the [Elastic's][elastic co] [observability tools][elastic observability], such as [LogStash][elastic logstash] and [Beats][elastic beats] used for gathering logs and metrics, are also worth noticing. And overall experience using [this company's software][elastic co] is pretty much awesome, so it's definitely worth trying.

[![kibana browser][]][analytics url]

## Requirements

Kicksware tool stack is meant to be deployed after Traefik gateway ingress and before everything else which depends on its applications.

In addition, every further deployment must be performed using CI\CD pipelines according to its configuration.

## Deployment

To perform deployment of Kicksware tool stack solution following methods can be used:

1. **Docker Compose file**

   This method require single dedicated server with installed both [`docker`][docker-compose] and [`docker-compose`][docker-compose] utilities.

   Compose [configuration file][compose config] can be found in the root of the project. This file already contains setting for reverse proxy routing and load balancing.

   Gitlab CI deployment pipeline [configuration file][ci compose config] for compose method can be found in `.gitlab` directory.

2. **Kubernetes Helm charts**

   Deployment to Kubernetes cluster is the default and desired way.

   For more flexible and easier deployment [Helm package manager][helm] is used. It provides a simple, yet elegant way to write pre-configured, reusable Kubernetes resource configuration using YAML and Go Templates (or Lua scripts). Helm packages are called `charts`.

   This whole project is basically a set of [Helm deployment charts][helm charts] which can be found in the root of the project.

   Gitlab CI deployment pipeline [configuration file][ci k8s config] for K8s method can also be found in the root of the project.

## Wrap Up

Kicksware's infrastructure technology stack is a set of high-end, diverse, cloud-native, and production-ready tools, solutions, and applications, each one is accurately picked to operate in its specific area with maximum efficiency.

To ensure continuous delivery, high efficiency, security, and overall reliability of its service, Kicksware pays great attention to the DevOps area that covers the complete development lifecycle from each code commitment to its finale publication for users to enjoy.

After all, Kicksware has been primarily a research project dedicated to the exploration of recent cloud technologies and architectural design paradigms, so its level of success estimates according to the aggregated quality and relevance of both its technology stack and architectural design pattern, as well as their overall impact on Kicksware infrastructure performance.

## More

See [other Kicksware project repositories][kicksware-main-repo].

## License

Licensed under the [GNU AGPL-3.0][license file].

[repo logo]: https://raw.githubusercontent.com/timoth-y/kicksware-tool-stack/master/assets/repo-logo.png

[kicksware url]: https://www.kicksware.com

[Website badge]: https://img.shields.io/website?label=Visit%20website&down_message=unavailable&up_color=teal&up_message=kicksware.com%20%7C%20online&url=https%3A%2F%2Fkicksware.com

[commit activity badge]: https://img.shields.io/github/commit-activity/m/timoth-y/kicksware-tool-stack?label=Commit%20activity&color=teal

[repo commit activity]: https://github.com/timoth-y/kicksware-tool-stack/graphs/commit-activity

[lines counter]: https://img.shields.io/tokei/lines/github/timoth-y/kicksware-tool-stack?color=teal&label=Lines

[db mongo badge]: https://img.shields.io/badge/DB-MongoDB-informational?style=flat&logo=mongoDB&logoColor=white&color=60A053&logoColor=60A053

[db postgres badge]: https://img.shields.io/badge/DB-PostgreSQL-informational?style=flat&logo=postgresql&logoColor=3C87B7&color=4e7cac

[fs gluster badge]: https://img.shields.io/badge/FS-Gluster-informational?style=flat&logo=buffer&logoColor=white&color=CE9F3B

[elastic stack badge]: https://img.shields.io/badge/Tools-Elastic%20Stack-informational?style=flat&logo=elastic%20stack&logoColor=56BCB2&color=teal

[license badge]: https://img.shields.io/badge/License-AGPL%20v3-blue.svg?color=teal

[kubernetes badge]: https://img.shields.io/badge/DevOps-Kubernetes-informational?style=flat&logo=kubernetes&logoColor=white&color=316DE6

[gitlab badge]: https://img.shields.io/badge/CI-Gitlab_CE-informational?style=flat&logo=gitlab&logoColor=white&color=FCA326

[tool-stack pipeline]: https://ci.kicksware.com/kicksware/tool-stack/badges/master/pipeline.svg?key_text=Tool%20Stack%20|%20pipeline&key_width=125

[devops]: https://aws.amazon.com/devops/what-is-devops/

[continuous delivery]: https://aws.amazon.com/devops/continuous-delivery/

[50 ci\cd]: https://stackify.com/top-continuous-integration-tools/

[gitlab ce]: https://about.gitlab.com/stages-devops-lifecycle/

[gitlab ci]: https://about.gitlab.com/stages-devops-lifecycle/continuous-integration/

[gitlab features]: https://about.gitlab.com/features/

[kicksware ci browser]: https://raw.githubusercontent.com/timoth-y/kicksware-tool-stack/master/assets/gitlab-browser.png

[kicksware ci url]: https://ci.kicksware.com/kicksware

[postgresql]: https://www.postgresql.org/

[mongodb]: https://www.mongodb.com/

[redis]: https://redis.io/

[elasticsearch]: https://www.elastic.co/elasticsearch/

[kibana]: https://www.elastic.co/kibana

[elastic stack]: https://www.elastic.co/elastic-stack

[elastic observability]: https://www.elastic.co/observability

[elastic logstash]: https://www.elastic.co/logstash

[elastic beats]: https://www.elastic.co/beats/

[elastic co]: https://www.elastic.co/about/

[kibana browser]: https://raw.githubusercontent.com/timoth-y/kicksware-tool-stack/master/assets/kibana-browser.png

[analytics url]: https://analytics.kicksware.com/app/dashboards#/view/24b8ed50-fee0-11ea-83ea-35465356722d

[docker-desktop]: https://docs.docker.com/desktop/

[docker-compose]: https://docs.docker.com/compose/

[compose config]: https://github.com/timoth-y/kicksware-tool-stack/blob/master/docker-compose.yml

[ci compose config]: https://github.com/timoth-y/kicksware-tool-stack/blob/master/.gitlab/.gitlab-ci.compose.yml

[ci k8s config]: https://github.com/timoth-y/kicksware-tool-stack/blob/master/.gitlab-ci.yml

[helm]: https://helm.sh/

[helm charts]: https://github.com/timoth-y/kicksware-tool-stack/tree/master

[kicksware-main-repo]: https://github.com/timoth-y/kicksware-platform#components

[license file]: https://github.com/timoth-y/kicksware-tool-stack/blob/master/LICENSE

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

https://github.com/nulltea/kicksware-infra

Awesome Lists containing this project

README