https://github.com/alextanhongpin/go-github-scraper

Github Scraper written in Go to compare against the previous version written in Node
https://github.com/alextanhongpin/go-github-scraper

github github-scraper golang

Last synced: 12 months ago
JSON representation

Github Scraper written in Go to compare against the previous version written in Node

• Host: GitHub
• URL: https://github.com/alextanhongpin/go-github-scraper
• Owner: alextanhongpin
• Created: 2018-05-23T07:06:14.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2018-06-10T16:51:44.000Z (over 7 years ago)
• Last Synced: 2025-01-29T21:54:19.752Z (about 1 year ago)
• Topics: github, github-scraper, golang
• Language: Go
• Size: 1.89 MB
• Stars: 2
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# go-github-scraper

A Github Scraper and recommendation engine written in `Go`, to replace the previous version written in NodeJS (TypeScript).

## Development

Create a `.env` that contains minimum the following environment variables:

```.env

GITHUB_TOKEN=

DB_NAME=

DB_HOST=

DB_USER=

DB_AUTH=

DB_PASS=

```

## Start

```bash

$ make start

```

## Build Docker Image

```bash

$ make docker

```

## Tracing

Using __opencensus__ to add __jaeger__ tracing capabilities:

![tracing.png](./assets/tracing.png)

Additional metadata (key-value pairs) can be added for more information:

![additional-metadata.png](./assets/additional-metadata.png)

## Stats

```bash

-------------------------------------------------------------------------------

 Language            Files        Lines         Code     Comments       Blanks

-------------------------------------------------------------------------------

 Dockerfile              1           56           29           11           16

 Go                     66         5788         4572          241          975

 Makefile                1           40           29            1           10

 Markdown                1           41           41            0            0

 YAML                    1           35           21           12            2

-------------------------------------------------------------------------------

 Total                  70         5960         4692          265         1003

-------------------------------------------------------------------------------

```