https://github.com/reza-saeedi-coding/realtime_crypto_pipeline
Real-time cryptocurrency data pipeline built with Python. Ingests and processes live price data from public APIs and stores it locally using modular, production-ready code.
https://github.com/reza-saeedi-coding/realtime_crypto_pipeline
api crypto data-ingestion data-pipeline project python real-time
Last synced: about 1 year ago
JSON representation
Real-time cryptocurrency data pipeline built with Python. Ingests and processes live price data from public APIs and stores it locally using modular, production-ready code.
- Host: GitHub
- URL: https://github.com/reza-saeedi-coding/realtime_crypto_pipeline
- Owner: reza-saeedi-coding
- Created: 2025-03-26T17:21:03.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-31T15:20:08.000Z (about 1 year ago)
- Last Synced: 2025-03-31T16:50:10.164Z (about 1 year ago)
- Topics: api, crypto, data-ingestion, data-pipeline, project, python, real-time
- Language: Python
- Homepage:
- Size: 6.84 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Bitcoin Price Tracking Project
This project fetches real-time cryptocurrency prices (Bitcoin & Ethereum), saves them with timestamps, and visualizes the price trends over time using Python.
## Dataset
- **Source**: [CoinGecko API](https://www.coingecko.com/en/api)
- **Data Format**: JSON file updated every 15 seconds during the run
---
## Tools & Libraries Used
- **Python**: Core programming language
- **Requests**: For API calls
- **Datetime & Time**: For timestamps and delays
- **Matplotlib**: To create visual charts
- **JSON & OS**: File management and data handling
---
## Project Workflow
1. **Fetch Data**: Grabs real-time Bitcoin and Ethereum prices
2. **Add Timestamps**: Attaches current UTC time to each data point
3. **Save to JSON**: Appends each fetch into a single `.json` file
4. **Plot Data**: Extracts & visualizes Bitcoin price trends over time
---
## File Structure
```
crypto_price_tracker/
├── ingestion/
│ └── crypto_data_ingestor.py # API fetching logic
├── processing/
│ └── transformer.py # Adds timestamps to raw data
├── storage/
│ └── json_writer.py # Appends data to JSON file
├── test_ingestion.py # Main runner script (automated fetch loop)
├── plot_prices.py # Loads + visualizes Bitcoin price trend
├── data/
│ └── crypto_prices.json # Collected JSON data (autogenerated)
```
---
## How to Run
1. Clone the repository
2. Install the requirements (e.g., requests, matplotlib)
3. Run `test_ingestion.py` to begin fetching live data
4. After a few minutes, run `plot_prices.py` to see price trends
```bash
python test_ingestion.py # Start collecting prices
data/crypto_prices.json # JSON grows every 15s
python plot_prices.py # Shows the chart
```
---
## What You'll Learn
- Real-time API integration with Python
- Data transformation using custom functions
- JSON data storage and time-based appending
- Visualizing financial data trends using Matplotlib
---
## Project Status
**Complete** — This version is ready for portfolio use and internship applications.
---
## Author
This project was built step-by-step for practical learning and hands-on portfolio building.
---
You can now track, store, and visualize real-time Bitcoin price movements using your own custom-built data pipeline.