{"id":19235335,"url":"https://github.com/arunnpuram/dynamicsqldataextractor","last_synced_at":"2026-05-15T17:40:29.049Z","repository":{"id":252709035,"uuid":"841209760","full_name":"Arunnpuram/DynamicSQLDataExtractor","owner":"Arunnpuram","description":"DynamicSQLDataExtractor is a Python tool that simplifies executing dynamic SQL queries on MySQL databases, leveraging AWS Secrets Manager for secure access. It allows users to select queries and date ranges via a CLI, processes the data, and saves it as CSVs for easy report generation.","archived":false,"fork":false,"pushed_at":"2026-04-24T22:10:15.000Z","size":15,"stargazers_count":0,"open_issues_count":5,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-04-25T00:27:17.640Z","etag":null,"topics":["csv","dask","mysql-database","python3","secrest"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Arunnpuram.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-08-11T23:36:54.000Z","updated_at":"2025-08-22T05:22:36.000Z","dependencies_parsed_at":"2025-08-22T07:12:46.290Z","dependency_job_id":"8f997e43-b0ed-4cb7-aba8-e41f5e0529d4","html_url":"https://github.com/Arunnpuram/DynamicSQLDataExtractor","commit_stats":null,"previous_names":["arunnpuram/dynamicsqldataextractor"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Arunnpuram/DynamicSQLDataExtractor","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Arunnpuram%2FDynamicSQLDataExtractor","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Arunnpuram%2FDynamicSQLDataExtractor/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Arunnpuram%2FDynamicSQLDataExtractor/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Arunnpuram%2FDynamicSQLDataExtractor/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Arunnpuram","download_url":"https://codeload.github.com/Arunnpuram/DynamicSQLDataExtractor/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Arunnpuram%2FDynamicSQLDataExtractor/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33073441,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-15T11:35:32.926Z","status":"ssl_error","status_checked_at":"2026-05-15T11:35:31.362Z","response_time":103,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["csv","dask","mysql-database","python3","secrest"],"created_at":"2024-11-09T16:16:36.889Z","updated_at":"2026-05-15T17:40:29.030Z","avatar_url":"https://github.com/Arunnpuram.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"\n# DynamicSQLDataExtractor\n\n**DynamicSQLDataExtractor** is a Python-based tool designed to streamline the execution of dynamic SQL queries against MySQL databases. Leveraging AWS Secrets Manager for secure credential management, this tool enables users to securely access and query databases without exposing sensitive information. Through an intuitive command-line interface, users can select predefined queries and specify date ranges for data extraction. The extracted data is then efficiently processed and saved as CSV files in a designated directory, making it easy to generate custom reports based on the latest data.\n\n## Table of Contents\n\n- [Features](#features)\n- [Getting Started](#getting-started)\n  - [Prerequisites](#prerequisites)\n  - [Installation](#installation)\n  - [Configuration](#configuration)\n- [Usage](#usage)\n- [Contact](#contact)\n\n## Features\n\n- Securely manage database credentials using AWS Secrets Manager.\n- Execute dynamic SQL queries against MySQL databases.\n- Select queries and specify date ranges via a command-line interface.\n- Process and save extracted data as CSV files for easy report generation.\n\n## Getting Started\n\nThese instructions will get you a copy of the project up and running on your local machine for development and testing purposes.\n\n### Prerequisites\n\n- Python 3.x installed\n- AWS CLI configured with appropriate permissions\n- MySQL database accessible\n\n### Installation\n\nClone the repository and install dependencies:\n - git clone https://github.com/yourusername/DynamicSQLDataExtractor.git \n - cd DynamicSQLDataExtractor pip install -r requirements.txt\n\n\n### Configuration\n\n1. Store your MySQL credentials in AWS Secrets Manager.\n2. Create a `queries.json` file with your SQL queries and descriptions.\n\n## Usage\n\nRun the tool from the command line:\n-  python main.py --aws-profile your_aws_profile --secret-name your_secret_name\n\n\nFollow the prompts to select a query and enter date ranges.\n\n## Contact\n\nMy email- arun.puram@outlook.com\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farunnpuram%2Fdynamicsqldataextractor","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farunnpuram%2Fdynamicsqldataextractor","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farunnpuram%2Fdynamicsqldataextractor/lists"}