Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/philtasticguy/scrapy-mojis
https://github.com/philtasticguy/scrapy-mojis
dataset emoji python scraper scraping scrapy unicode
Last synced: 6 days ago
JSON representation
- Host: GitHub
- URL: https://github.com/philtasticguy/scrapy-mojis
- Owner: PhiltasticGuy
- Created: 2022-06-29T12:41:31.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2022-06-29T12:42:01.000Z (over 2 years ago)
- Last Synced: 2024-12-16T01:43:18.716Z (2 months ago)
- Topics: dataset, emoji, python, scraper, scraping, scrapy, unicode
- Language: Python
- Homepage:
- Size: 3.54 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ML - Scrapy-mojis
The first run will take a few minutes as the HTTP requests are cached by `scrapy`.
The custom code is all contained in a single `spider` under `/ml_scrapy_mojis/spiders/unicode.py`.
You need to install the `scrapy` package before running it. You can use the following commands:
```bash
# Install scrapy.
pip install scrapy
# Run the spider.
scrapy crawl unicode
```