{"id":26897865,"url":"https://github.com/yo1am1/scrapy-work","last_synced_at":"2025-04-01T05:07:22.598Z","repository":{"id":187014002,"uuid":"676171594","full_name":"yo1am1/scrapy-work","owner":"yo1am1","description":"Web Scraper for Python Developer Vacancies","archived":false,"fork":false,"pushed_at":"2023-08-11T01:45:30.000Z","size":340,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2023-08-11T09:59:07.836Z","etag":null,"topics":["python","scraper","scrapy","scrapy-crawler","web","work"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/yo1am1.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-08-08T15:34:08.000Z","updated_at":"2023-08-11T09:59:07.837Z","dependencies_parsed_at":"2023-08-08T17:07:22.816Z","dependency_job_id":null,"html_url":"https://github.com/yo1am1/scrapy-work","commit_stats":null,"previous_names":["yo1am1/scrapy-work"],"tags_count":0,"template":null,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yo1am1%2Fscrapy-work","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yo1am1%2Fscrapy-work/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yo1am1%2Fscrapy-work/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/yo1am1%2Fscrapy-work/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/yo1am1","download_url":"https://codeload.github.com/yo1am1/scrapy-work/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246586033,"owners_count":20801026,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["python","scraper","scrapy","scrapy-crawler","web","work"],"created_at":"2025-04-01T05:07:21.939Z","updated_at":"2025-04-01T05:07:22.584Z","avatar_url":"https://github.com/yo1am1.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Scrapy-work: Web Scraper for Python Developer Vacancies\n[![License: MIT](https://img.shields.io/github/license/yo1am1/scrapy-work)](https://github.com/yo1am1/scrapy-work/blob/main/LICENSE)\n[![GitHub last commit](https://img.shields.io/github/last-commit/yo1am1/scrapy-work)](https://github.com/yo1am1/scrapy-work/commits/main)\n![Lint](https://github.com/yo1am1/scrapy-work/actions/workflows/black.yml/badge.svg?event=push)\n![GitHub Latest Pre-Release)](https://img.shields.io/github/v/release/yo1am1/scrapy-work?include_prereleases\u0026label=pre-release\u0026logo=github)\n\n## Installation and Usage 🧠\n🥐 **Note: At the moment, the scraper only supports Work.ua. Updates and additional website support are coming soon!**\n\n\n1. **_Clone_** the repository:\n    ```bash\n    git clone https://github.com/yo1am1/scrapy-work.git\n    ```\n\n2. **_Navigate_** to the project directory and either open it in PyCharm or use the terminal.\n\n3. **_Install_** the [requirements.txt](requirements.txt):\n    ```bash\n    pip install -r requirements.txt\n    ```\n    \u003e [!IMPORTANT]\\\n    \u003e The `requirements.txt` file contains all the dependencies needed to run the scraper locally.\n    \n4. **_Run_** web scrapper with command:\n    ```bash\n    scrapy crawl VacanciesSpider -O data.json\n    ```\n    \u003e [!NOTE]\\\n    \u003e  Where `VacanciesSpider` - is the name of the scrapper, `-O data.json` - rewrites our data to [data.json](/workua/data.json) file.\n    \n    \u003e [!IMPORTANT]\\\n    \u003e  Use this command inside the project folder\n\n5. ### _Good luck at finding job_!\n\n## License\nThis project is licensed under the [MIT License](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyo1am1%2Fscrapy-work","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fyo1am1%2Fscrapy-work","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fyo1am1%2Fscrapy-work/lists"}