{"id":18484850,"url":"https://github.com/uts58/dse-scraper","last_synced_at":"2025-05-13T21:30:24.198Z","repository":{"id":111032141,"uuid":"247139060","full_name":"uts58/DSE-Scraper","owner":"uts58","description":"Python scraper optimized to fetch DSE data using just 6.5 MB of RAM, outputting results as a dictionary","archived":false,"fork":false,"pushed_at":"2023-08-09T15:50:38.000Z","size":4,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-02-16T21:46:01.180Z","etag":null,"topics":["data-extraction","data-parsing","dse","python","web-crawler","web-scraping"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/uts58.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-03-13T18:38:47.000Z","updated_at":"2024-09-17T04:35:10.000Z","dependencies_parsed_at":"2024-03-16T11:20:11.474Z","dependency_job_id":null,"html_url":"https://github.com/uts58/DSE-Scraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/uts58%2FDSE-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/uts58%2FDSE-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/uts58%2FDSE-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/uts58%2FDSE-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/uts58","download_url":"https://codeload.github.com/uts58/DSE-Scraper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254030763,"owners_count":22002646,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-extraction","data-parsing","dse","python","web-crawler","web-scraping"],"created_at":"2024-11-06T12:43:24.988Z","updated_at":"2025-05-13T21:30:24.151Z","avatar_url":"https://github.com/uts58.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## Scrapping DSE Data: Python Memory-Efficient Scraper\n\nScrap and extract data from the DSE (assuming it's Dhaka Stock Exchange or another relevant entity) and obtain the results in dictionary format. Proudly optimized to use just 6.5 MB of RAM!\n\n## Overview\nThis Python scraper efficiently fetches data from DSE, ensuring minimal memory footprint. With only 6.5 MB of RAM utilization, you can seamlessly extract and work with DSE data without worrying about memory bottlenecks.\n\n## Features\n* Memory-Efficient: Specifically optimized to consume only 6.5 MB RAM.\n* Output Format: Provides data in a user-friendly dictionary format.\n* Python-Powered: Leverages the versatility and power of Python.\n\n## Prerequisites\n* Python (Python 3.8+)\n* Required Python libraries/packages (Requests)\n\n## Installation \u0026 Usage\n1. Clone the repository: `git clone [your_repository_link]`\n2. Navigate to the project directory: `cd [project_directory]`\n3. Install the required packages: `pip install -r requirements.txt`\n4. Run the scraper: `python dse_scraper.py`\n\nThe resulting data will be provided in a dictionary format for further processing or analysis.\n\n## Contribution\nFeel free to fork the project, submit PRs, or open issues if you encounter any problems.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Futs58%2Fdse-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Futs58%2Fdse-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Futs58%2Fdse-scraper/lists"}