{"id":25666498,"url":"https://github.com/parvvaresh/web-scraper-projects","last_synced_at":"2025-04-22T19:21:09.254Z","repository":{"id":143030475,"uuid":"606901036","full_name":"parvvaresh/web-scraper-projects","owner":"parvvaresh","description":"This repository contains projects that include web scraping","archived":false,"fork":false,"pushed_at":"2024-05-03T14:01:16.000Z","size":2714,"stargazers_count":14,"open_issues_count":1,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-29T18:03:21.577Z","etag":null,"topics":["bs4","python","requests","webscraping"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/parvvaresh.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-02-26T21:58:48.000Z","updated_at":"2025-02-20T03:01:44.000Z","dependencies_parsed_at":null,"dependency_job_id":"c334b8b4-02a1-4bbe-affa-ef42ddd1c489","html_url":"https://github.com/parvvaresh/web-scraper-projects","commit_stats":null,"previous_names":["parvvaresh/web-scraper-projects"],"tags_count":0,"template":true,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/parvvaresh%2Fweb-scraper-projects","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/parvvaresh%2Fweb-scraper-projects/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/parvvaresh%2Fweb-scraper-projects/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/parvvaresh%2Fweb-scraper-projects/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/parvvaresh","download_url":"https://codeload.github.com/parvvaresh/web-scraper-projects/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250306601,"owners_count":21408927,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bs4","python","requests","webscraping"],"created_at":"2025-02-24T08:30:33.837Z","updated_at":"2025-04-22T19:21:09.212Z","avatar_url":"https://github.com/parvvaresh.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Web Scraper Projects\n\nThis repository contains a collection of web scraping projects aimed at various purposes. Whether you're interested in monitoring news websites, analyzing data, or fetching real-time data like currency exchange rates, this repository offers a range of tools to help you achieve your goals.\n\n## Projects Overview\n\n### 1. Nan (The country's needs)\n\n#### Description\nThis project focuses on gathering and analyzing data related to the country's needs. It includes tools for scraping websites, extracting relevant information, and performing data analysis.\n\n#### Files\n- `data_analyze_v1_3.ipynb`: Jupyter Notebook containing data analysis scripts.\n- `Data_nan.csv`: CSV file containing the scraped data.\n- `links.txt`: Text file containing links used for scraping.\n\n#### Source Code\n- `src/get_page.py`: Python script for fetching web pages.\n- `src/main.py`: Main script for running the scraping process.\n- `src/save_link.py`: Script for saving scraped links.\n\n### 2. News\n\n#### Description\nThis project focuses on scraping news articles from specific sources. It provides tools to extract news articles from designated websites.\n\n#### Source Code\n- `src/fars_news.py`: Python script for scraping news articles from Fars News website.\n\n### 3. Price - Dollar\n\n#### Description\nThis project aims to fetch real-time data related to the dollar exchange rate. It provides tools to scrape currency exchange information from relevant websites.\n\n#### Source Code\n- `src/get_info.py`: Python script for fetching currency exchange information.\n- `src/main.py`: Main script for running the scraping process.\n\n## Getting Started\n\nTo get started with any of the projects, follow these steps:\n\n1. Clone the repository to your local machine.\n2. Navigate to the project directory you're interested in.\n3. Install any necessary dependencies listed in the `requirements.txt` file.\n4. Run the main script to start scraping data.\n\n## Contribution\n\nContributions to this repository are welcome! Whether it's adding new scraping scripts, improving existing ones, or fixing bugs, feel free to submit pull requests.\n\n## License\n\nThis repository is licensed under the [MIT License](LICENSE).\n\n---","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparvvaresh%2Fweb-scraper-projects","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fparvvaresh%2Fweb-scraper-projects","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fparvvaresh%2Fweb-scraper-projects/lists"}