https://github.com/uts58/dse-scraper
Python scraper optimized to fetch DSE data using just 6.5 MB of RAM, outputting results as a dictionary
https://github.com/uts58/dse-scraper
data-extraction data-parsing dse python web-crawler web-scraping
Last synced: about 1 year ago
JSON representation
Python scraper optimized to fetch DSE data using just 6.5 MB of RAM, outputting results as a dictionary
- Host: GitHub
- URL: https://github.com/uts58/dse-scraper
- Owner: uts58
- Created: 2020-03-13T18:38:47.000Z (about 6 years ago)
- Default Branch: main
- Last Pushed: 2023-08-09T15:50:38.000Z (almost 3 years ago)
- Last Synced: 2025-02-16T21:46:01.180Z (over 1 year ago)
- Topics: data-extraction, data-parsing, dse, python, web-crawler, web-scraping
- Language: Python
- Homepage:
- Size: 3.91 KB
- Stars: 1
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
Awesome Lists containing this project
README
## Scrapping DSE Data: Python Memory-Efficient Scraper
Scrap and extract data from the DSE (assuming it's Dhaka Stock Exchange or another relevant entity) and obtain the results in dictionary format. Proudly optimized to use just 6.5 MB of RAM!
## Overview
This Python scraper efficiently fetches data from DSE, ensuring minimal memory footprint. With only 6.5 MB of RAM utilization, you can seamlessly extract and work with DSE data without worrying about memory bottlenecks.
## Features
* Memory-Efficient: Specifically optimized to consume only 6.5 MB RAM.
* Output Format: Provides data in a user-friendly dictionary format.
* Python-Powered: Leverages the versatility and power of Python.
## Prerequisites
* Python (Python 3.8+)
* Required Python libraries/packages (Requests)
## Installation & Usage
1. Clone the repository: `git clone [your_repository_link]`
2. Navigate to the project directory: `cd [project_directory]`
3. Install the required packages: `pip install -r requirements.txt`
4. Run the scraper: `python dse_scraper.py`
The resulting data will be provided in a dictionary format for further processing or analysis.
## Contribution
Feel free to fork the project, submit PRs, or open issues if you encounter any problems.