https://github.com/alpcanaydin/githubist-fetcher

Fetcher repository for Github.ist
https://github.com/alpcanaydin/githubist-fetcher

data-visualization github statistics turkey

Last synced: 8 days ago
JSON representation

Fetcher repository for Github.ist

• Host: GitHub
• URL: https://github.com/alpcanaydin/githubist-fetcher
• Owner: alpcanaydin
• License: mit
• Created: 2018-10-12T20:55:40.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2022-08-23T06:29:49.000Z (over 2 years ago)
• Last Synced: 2023-03-03T13:17:14.385Z (almost 2 years ago)
• Topics: data-visualization, github, statistics, turkey
• Language: JavaScript
• Homepage: https://github.ist
• Size: 117 KB
• Stars: 12
• Watchers: 3
• Forks: 4
• Open Issues: 8
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Github.ist Fetcher

This is the Fetcher repo for https://github.ist. You may also want to take a look to [Web](https://github.com/alpcanaydin/githubist) and [API](https://github.com/alpcanaydin/githubist-api)

## Installation

You need to have `yarn` installed in your computer. After, simple run the command `yarn` in project directory in order to install dependencies. As last step, please copy `.env.sample` file as `.env` and update the variables with the actual values you want to use.

## Running the Commands

There are several commands in order the fetch data from Github and process it.

- Run `node bin/searchUsers.js` command to search Github users whose location is a place from Turkey.

- Run `node bin/getUsersAndRepos.js` command to get users and theirs repos which collected from the command above.

- Run `node bin/exportPipeline.sh` command to normalize all data and move it to API

There is also `node bin/pipeline.sh` command which runs all required commands in order.

If you want to use the current data in Github.ist, you can download from here;

[https://data.github.ist/githubist.json.zip](https://data.github.ist/githubist.json.zip)