https://github.com/captn3m0/stackshare-dataset

A dataset of popular tools and services powering various stacks.
https://github.com/captn3m0/stackshare-dataset

Last synced: about 2 months ago
JSON representation

A dataset of popular tools and services powering various stacks.

• Host: GitHub
• URL: https://github.com/captn3m0/stackshare-dataset
• Owner: captn3m0
• License: odbl-1.0
• Created: 2024-01-23T07:39:02.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2024-03-05T15:35:22.000Z (9 months ago)
• Last Synced: 2024-10-12T02:45:09.500Z (2 months ago)
• Language: Python
• Homepage:
• Size: 1.58 MB
• Stars: 8
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Citation: CITATION.cff

Awesome Lists containing this project

README

        
# stackshare-dataset [![DOI](https://zenodo.org/badge/747065915.svg)](https://zenodo.org/doi/10.5281/zenodo.10554436)

**DOI**: `10.5281/zenodo.10554437`

A dataset from stackshare.io providing lists of packages and various services. While a list of packages for

various ecosystems is easily available elsewhere, a list of services is much harder.

See `tools.csv` for a complete list. I'd recommend sorting by populatity and using the top 2.5-3k results

depending on your usecase.

Browse the dataset here: .

## License

This stackshare-dataset is made available under the Open Database License: http://opendatacommons.org/licenses/odbl/1.0/. 

Some individual contents of the database are under copyright by Stackshare.

You are free:

* **To share**: To copy, distribute and use the database.

* **To create**: To produce works from the database.

* **To adapt**: To modify, transform and build upon the database.

As long as you:

* **Attribute**: You must attribute any public use of the database, or works produced from the database, in the manner specified in the ODbL. For any use or redistribution of the database, or works produced from it, you must make clear to others the license of the database and keep intact any notices on the original database.

* **Share-Alike**: If you publicly use any adapted version of this database, or works produced from an adapted database, you must also offer that adapted database under the ODbL.

* **Keep open**: If you redistribute the database, or an adapted version of it, then you may use technological measures that restrict the work (such as DRM) as long as you also redistribute a version without such measures.

## Generating

Ensure you have GNU Make, Python, and wget installed

```

make tools.csv

make packages.csv

```

The scraper uses the following as sources:

1. Sitemap (https://stackshare.io/sitemap.xml)

2. StackShare Search for enriching service results (https://stackshare.io/search)

The package results are not enriched, since much better data for those is available elsewhere.