An open API service indexing awesome lists of open source software.

https://github.com/1995parham/koochooloo

Make your URLs shorter (smaller) and more memorable in Go
https://github.com/1995parham/koochooloo

golang golang-application golang-examples learn-go-by-simple-demo learn-to-code learning-by-doing url-shortener

Last synced: about 1 month ago
JSON representation

Make your URLs shorter (smaller) and more memorable in Go

Awesome Lists containing this project

README

        

🐼 koochooloo 🌰


I want to dedicate this project to my love ❤️




GitHub Workflow Status
Codecov
GitHub repo size

> a Persian word which means "small" or "li'l". It is often used to refer to a girl when flirting, (with the meaning, li'l girl)
>
> Urban Dictionary

## Introduction

Welcome to **Koochooloo**: an elegant, practical project crafted to streamline
the development of Golang applications. Boasting a well-organized architecture,
**Koochooloo** integrates vital features such as database handling and configuration
management, exemplifying the best practices in building robust ReST applications with Go.

### Features

- **Strong Typing**: Unyielding commitment to strong typing, enhancing readability and maintainability.
- **No Globals or `init` Functions**: Eschews globals and the complexities of `init` functions to keep things simple.
- **Standardized Naming**: Adherence to the de-facto standard of singular package names, inspired by 'project-layout' principles.
- **Independent Packages**: Each package is crafted to function independently, making the addition of new features seamless.
- **Intuitive Structure**: Navigate with ease through a codebase that's designed for clarity.

### Technology

Leveraging `fx` as our dependency injection framework, **Koochooloo** delivers:

- **No Code Generation**: Utilize powerful dependency injection without any code bloat from code generation.
- **Test-Friendly**: An environment that supports and simplifies the use of `fx` in testing with the same ease as in production.

### Your Development Companion

Embark on a journey with **koochooloo** and redefine your approach to creating ReSTful applications in Go.
Whether you're expanding your skillset or building a solid foundation for complex applications,
**Koochooloo** is your partner in efficient, clean, and scalable software design.

## Structure

### Binaries

First of all, `cmd` package contains the binaries of this project with use of [cobra](https://github.com/spf13/cobra).
It is good to have a simple binaries for tasks like database migrations that can be run on initiation phase of project.
Each binary has its `main.go` in its package and registers itself with a `Register` function.
In the `root.go` of `cmd` these `Register` functions from sub-commands are called.
Here is an example for register function:

```go
// Register server command.
func Register(root *cobra.Command) {
root.AddCommand(
&cobra.Command{
Use: "server",
Short: "Run server to serve the requests",
Run: func(_ *cobra.Command, _ []string) {
fx.New(
fx.Provide(config.Provide),
fx.Invoke(main),
).Run()
},
},
)
}
```

Again each command registers its flag by itself, so we have separation from other commands.
Sometimes we need to have shared flags between commands, then it is better to have them in config.
For the later case, `koanf` can help us with the structure as below:

```go
func Register(fs *pflag.FlagSet) {
fs.StringP(
"url", "u",
nats.DefaultURL,
fmt.Sprintf("nats server url(s) e.g. %s", nats.DefaultURL),
)
}
```

This function register shared flags, and then we load configuration based on them with the following function:

```go
k := koanf.New(".")

if err := k.Load(posflag.Provider(fs, ".", k), nil); err != nil {
log.Errorf("error loading config.yml: %s", err)
}

if err := k.Unmarshal("", &instance); err != nil {
log.Fatalf("error unmarshalling config: %s", err)
}

```

### Configuration

The main part of each application is its configuration. There are many ways for having configuration in the project from configuration file to environment variables.
[Koanf](https://github.com/knadh/koanf) has all of them in a one beautiful package. The main points here are:

- Having a defined and typed structure for configuration
- Don't use global configuration. each module has its configuration defined in `config` module and it will pass to it in its initiation.
- Print loaded configuration at startup, so everyone can validate the applied configuration.

P.S. [koanf](https://github.com/knadh/koanf) is way better than [viper](https://github.com/spf13/viper) for having typed configuration.
By typed configuration I mean you have a defined structure for configuration and then load configuration from many sources into it.

For installing [koanf](https://github.com/knadh/koanf) you can use the following commands:

```bash
go get -u github.com/knadh/koanf/v2

go get -u github.com/knadh/koanf/providers/file
go get -u github.com/knadh/koanf/providers/env
go get -u github.com/knadh/koanf/providers/structs

go get -u github.com/knadh/koanf/parsers/toml
```

### Infra vs Domain

Packages and services that are defined in `domain` package only uses other packages from `domain` without using any
3rd party packages. These packages and services specifies the core domain concepts.

### Database

There is a `db` package that is responsible for connecting to the database. This package uses the database configuration that is defined in `config` module and create a database instance.
It is a good idea to ping your database here to have fully confident to your database instance before going forward.
Also for having an insight at database health you can call this ping function periodically and report its result with metrics (which I didn't do here).

### Model

Project models are defined in `model` package. These models are used internally but the can be used in `response` or `request` package.
There is no structure for communicating with database in this package.

### Repository

Repositories are responsible for commnunicating with database to store or retrieve models. Repositories are `interface` and there is an concrete and mocked implementation for them.
concrete implementation is used in main code and mocked one is used for tests. Please note that the tests for repositories are touchy and are done with actual database.

### Handler

HTTP handler are defined in `handler` package. [Echo](https://github.com/labstack/echo)
is an awesome HTTP framework that has eveything you need.
Each handler has its structure with a `Register` method that registers its route into a given route group.
Route group is a concept from [Echo](https://github.com/labstack/echo) framework for grouping routes under a specific parent path.
Each handler has what it needs into its structure. Handler structure are created in `main.go` then register on their group.

```go
type Healthz struct {}

// Handle shows server is up and running.
func (h Healthz) Handle(c echo.Context) error {
return c.NoContent(http.StatusNoContent)
}

// Register registers the routes of healthz handler on given echo group.
func (h Healthz) Register(g *echo.Group) {
g.GET("/healthz", h.Handle)
}
```

### Metrics

All metrics are gathered using [Prometheus](https://prometheus.io/)
based on [open-telemetry](https://github.com/open-telemetry/opentelemetry-go).
Each package has its `metric.go` that defines a structure contains the metrics and have methods for changing them.
For migrating from Prometheus to another service you just need to change `telemetry`.
Metrics aren't global and they created for each instance seperately thanks to Open Telemetry design.
For having better controller on metrics endpoint there is another HTTP server that is defined in `telemetry`
package for monitoring.

### Request/Response

It is good to have separated packages for requests and responses. These packages also contain validation logic.
One of the good validation pakcages in Go is [ozzo-validator](https://github.com/go-ozzo/ozzo-validation).
After providing validate method, after getting request you can validate it with its method with ease.

### Logging

Logging one the most important part of application. At the beginning there is no need to have something more than simple stdout logs.
But in the future you need to strcuture you logs and ship them into an aggregation system because when your system grows detecting issues
from text logs will be inpossible.

[zap](https://github.com/uber-go/zap) is one the best logger for structure logging.
`zap` forces you to pass it into your child module and you also name loggers with `Named` method.
By using the named logger you can easily find you module logs in your log aggregator.

## Up and Running

This project only requires MongoDB, and you can run it with provided `docker-compose`.

```bash
cd deployments && docker-compose up -d
cd cmd/koochooloo/ && go build && ./koochooloo
```

```bash
curl -X POST -d '{"url": "https://elahe-dastan.github.io"}' -H 'Content-Type: application/json' 127.0.0.1:1378/api/urls
curl -L 127.0.0.1:1378/api/CKaniA
```

## Load Testing

```
checks.....................: 99.83% ✓ 2995 ✗ 5
data_received..............: 2.0 MB 64 kB/s
data_sent..................: 521 kB 17 kB/s
group_duration.............: avg=649.18ms min=153.18µs med=265.45ms max=30.95s p(90)=1.61s p(95)=2.06s
http_req_blocked...........: avg=14.12ms min=0s med=3µs max=1.65s p(90)=13µs p(95)=147.04µs
http_req_connecting........: avg=6.23ms min=0s med=0s max=1.36s p(90)=0s p(95)=0s
http_req_duration..........: avg=272.98ms min=0s med=127.99ms max=4.81s p(90)=830.93ms p(95)=1.29s
http_req_receiving.........: avg=125.23µs min=0s med=60µs max=11.21ms p(90)=228µs p(95)=363µs
http_req_sending...........: avg=50.78µs min=0s med=22µs max=7.28ms p(90)=86µs p(95)=138µs
http_req_tls_handshaking...: avg=7.86ms min=0s med=0s max=653.63ms p(90)=0s p(95)=0s
http_req_waiting...........: avg=272.8ms min=0s med=127.71ms max=4.81s p(90)=830.87ms p(95)=1.29s
http_reqs..................: 4000 129.093962/s
iteration_duration.........: avg=1.29s min=142.34ms med=1.04s max=30.97s p(90)=2.18s p(95)=2.64s
iterations.................: 1000 32.273491/s
vus........................: 100 min=100 max=100
vus_max....................: 100 min=100 max=100
```