{"id":27153967,"url":"https://github.com/reza-saeedi-coding/realtime_crypto_pipeline","last_synced_at":"2025-04-08T16:19:20.994Z","repository":{"id":285413437,"uuid":"955465189","full_name":"reza-saeedi-coding/realtime_crypto_pipeline","owner":"reza-saeedi-coding","description":"Real-time cryptocurrency data pipeline built with Python. Ingests and processes live price data from public APIs and stores it locally using modular, production-ready code.","archived":false,"fork":false,"pushed_at":"2025-03-31T15:20:08.000Z","size":7,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-31T16:50:10.164Z","etag":null,"topics":["api","crypto","data-ingestion","data-pipeline","project","python","real-time"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/reza-saeedi-coding.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-26T17:21:03.000Z","updated_at":"2025-03-31T15:20:12.000Z","dependencies_parsed_at":"2025-03-31T16:50:18.819Z","dependency_job_id":"d9a0b11a-af86-4683-8eaa-3e13d26884f2","html_url":"https://github.com/reza-saeedi-coding/realtime_crypto_pipeline","commit_stats":null,"previous_names":["reza-saeedi-coding/realtime_crypto_pipeline"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reza-saeedi-coding%2Frealtime_crypto_pipeline","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reza-saeedi-coding%2Frealtime_crypto_pipeline/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reza-saeedi-coding%2Frealtime_crypto_pipeline/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/reza-saeedi-coding%2Frealtime_crypto_pipeline/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/reza-saeedi-coding","download_url":"https://codeload.github.com/reza-saeedi-coding/realtime_crypto_pipeline/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247877963,"owners_count":21011158,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["api","crypto","data-ingestion","data-pipeline","project","python","real-time"],"created_at":"2025-04-08T16:19:20.349Z","updated_at":"2025-04-08T16:19:20.986Z","avatar_url":"https://github.com/reza-saeedi-coding.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Bitcoin Price Tracking Project\n\nThis project fetches real-time cryptocurrency prices (Bitcoin \u0026 Ethereum), saves them with timestamps, and visualizes the price trends over time using Python.\n\n## Dataset\n- **Source**: [CoinGecko API](https://www.coingecko.com/en/api)\n- **Data Format**: JSON file updated every 15 seconds during the run\n\n---\n\n## Tools \u0026 Libraries Used\n- **Python**: Core programming language\n- **Requests**: For API calls\n- **Datetime \u0026 Time**: For timestamps and delays\n- **Matplotlib**: To create visual charts\n- **JSON \u0026 OS**: File management and data handling\n\n---\n\n## Project Workflow\n1. **Fetch Data**: Grabs real-time Bitcoin and Ethereum prices\n2. **Add Timestamps**: Attaches current UTC time to each data point\n3. **Save to JSON**: Appends each fetch into a single `.json` file\n4. **Plot Data**: Extracts \u0026 visualizes Bitcoin price trends over time\n\n---\n\n## File Structure\n```\ncrypto_price_tracker/\n├── ingestion/\n│   └── crypto_data_ingestor.py       # API fetching logic\n├── processing/\n│   └── transformer.py                # Adds timestamps to raw data\n├── storage/\n│   └── json_writer.py                # Appends data to JSON file\n├── test_ingestion.py                # Main runner script (automated fetch loop)\n├── plot_prices.py                   # Loads + visualizes Bitcoin price trend\n├── data/\n│   └── crypto_prices.json           # Collected JSON data (autogenerated)\n```\n\n---\n\n## How to Run\n1. Clone the repository\n2. Install the requirements (e.g., requests, matplotlib)\n3. Run `test_ingestion.py` to begin fetching live data\n4. After a few minutes, run `plot_prices.py` to see price trends\n\n```bash\npython test_ingestion.py  # Start collecting prices\ndata/crypto_prices.json   # JSON grows every 15s\npython plot_prices.py     # Shows the chart\n```\n\n---\n\n## What You'll Learn\n- Real-time API integration with Python\n- Data transformation using custom functions\n- JSON data storage and time-based appending\n- Visualizing financial data trends using Matplotlib\n\n---\n\n## Project Status\n**Complete** — This version is ready for portfolio use and internship applications.\n\n---\n\n## Author\nThis project was built step-by-step for practical learning and hands-on portfolio building.\n\n---\n\nYou can now track, store, and visualize real-time Bitcoin price movements using your own custom-built data pipeline.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freza-saeedi-coding%2Frealtime_crypto_pipeline","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Freza-saeedi-coding%2Frealtime_crypto_pipeline","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Freza-saeedi-coding%2Frealtime_crypto_pipeline/lists"}