Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hugovk/top-pypi-packages
A regular dump of the most-downloaded packages from PyPI
https://github.com/hugovk/top-pypi-packages
data dump json pypi python
Last synced: 2 months ago
JSON representation
A regular dump of the most-downloaded packages from PyPI
- Host: GitHub
- URL: https://github.com/hugovk/top-pypi-packages
- Owner: hugovk
- Created: 2018-01-09T11:18:36.000Z (over 6 years ago)
- Default Branch: main
- Last Pushed: 2024-04-11T19:21:22.000Z (3 months ago)
- Last Synced: 2024-04-12T00:20:04.959Z (3 months ago)
- Topics: data, dump, json, pypi, python
- Language: HTML
- Homepage: https://hugovk.github.io/top-pypi-packages
- Size: 18.8 MB
- Stars: 201
- Watchers: 7
- Forks: 11
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Lists
- awesome-stars - top-pypi-packages - downloaded packages from PyPI | hugovk | 211 | (HTML)
README
# Top PyPI Packages
[](https://zenodo.org/badge/latestdoi/116806538)
A monthly dump of the 8,000 most-downloaded packages from PyPI:
* https://hugovk.github.io/top-pypi-packages/top-pypi-packages-30-days.min.json
Unminified:
* https://hugovk.github.io/top-pypi-packages/top-pypi-packages-30-days.json
**Note:** It now takes too much quota to collect data for 365 days.
Those files were last updated on 2021-04-01 and have been removed.
Old versions can be found in [releases](https://github.com/hugovk/top-pypi-packages/releases).
## Server setup notes
From cron, it runs pypinfo to dump JSON and commit back to this repo.
### Install jq
For example on Ubuntu 22.04:
```bash
sudo apt-get install jq
```
### Install and set up pypinfo
Follow https://github.com/ofek/pypinfo to sign up for BigQuery, install and authenticate.
```bash
pip3 install "pypinfo>=13.0.0"
pypinfo --help
pypinfo --auth path/to/your_credentials.json
```
### Set up this repo
```bash
git clone [email protected]:hugovk/top-pypi-packages.git
cd top-pypi-packages
git config user.name "Deploy Bot"
git config user.email "[email protected]"
git config user.name
git config user.email
```
* Create SSH key on server: https://www.digitalocean.com/community/tutorials/how-to-use-ssh-keys-with-digitalocean-droplets
* Add your SSH key to the ssh-agent:
https://help.github.com/articles/generating-a-new-ssh-key-and-adding-it-to-the-ssh-agent/#adding-your-ssh-key-to-the-ssh-agent
* Add deploy key with write access at https://github.com/hugovk/top-pypi-packages/settings/keys/new
### Run from cron
```bash
crontab -e
# First of the month
30 17 1 * * ( eval "$(ssh-agent -s)"; ssh-add ~/.ssh/id_rsa-top-pypi-packages; /home/botuser/github/top-pypi-packages/top-pypi-packages.sh ) > /tmp/top-pypi-packages.log 2>&1
```
# Thanks
Thanks to DigitalOcean for supporting open-source software.
