https://github.com/rdch106/browser-stats

Web browser usage statistics
https://github.com/rdch106/browser-stats

data-adquisition data-visualization spider

Last synced: 3 days ago
JSON representation

Web browser usage statistics

• Host: GitHub
• URL: https://github.com/rdch106/browser-stats
• Owner: RDCH106
• License: mpl-2.0
• Created: 2017-07-13T17:05:32.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2018-03-20T08:42:18.000Z (almost 7 years ago)
• Last Synced: 2024-11-18T04:23:31.836Z (about 2 months ago)
• Topics: data-adquisition, data-visualization, spider
• Language: Python
• Size: 140 KB
• Stars: 3
• Watchers: 4
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Browser Statistics

### Web Browser usage statistics 

### What is this?

The project is a proof of concept for collecting data using a spider and generation of JSON files that are easily consumable using common visualization libraries. The repository has two part:

1. The spider in [crawler folder](https://github.com/RDCH106/browser-stats/tree/master/crawler)

2. The visualization in [root project](https://github.com/RDCH106/browser-stats)

Primary data source is [W3Schools browser statistics](https://www.w3schools.com/browsers/default.asp).

## Spider

### Installation

Install dependencies for Linux with:

```

$ cd crawler

$ pip install -r requirements_lin.txt

```

Install dependencies for Windows with:

```

$ cd crawler

$ pip install -r requirements_win.txt

```

### Execution

From the root of the project go to [crawler folder](https://github.com/RDCH106/browser-stats/tree/master/crawler):

`$ cd crawler`

If you are using Linux OS excute [Launch_crawler_lin.sh](https://github.com/RDCH106/browser-stats/blob/master/crawler/Launch_crawler_lin.sh).

If you are using Windows OS execute [Launch_crawler_win.bat](https://github.com/RDCH106/browser-stats/blob/master/crawler/Launch_crawler_win.bat)

Crawled data will be saved in [browser-stats.json](https://github.com/RDCH106/browser-stats/blob/master/crawler/browser-stats.json)

## Visualization

[C3.js](https://github.com/c3js/c3) based on [D3.js](https://github.com/d3/d3) is used for data visualization.

All the displayed data comes from [browser-stats.json](https://github.com/RDCH106/browser-stats/blob/master/crawler/browser-stats.json) generated by the spider automatically.

### Available charts

- [Browser usage 2017 - Donut Chart](https://cdn.rawgit.com/RDCH106/browser-stats/a65086f7/browser_stats.html)