{"id":31650553,"url":"https://github.com/basemax/mci-simcards","last_synced_at":"2025-10-08T12:13:08.216Z","repository":{"id":317927252,"uuid":"1068333197","full_name":"BaseMax/mci-simcards","owner":"BaseMax","description":"A tool to download MCI sim card product data, organize it from JSON pages, and export it into a structured Excel spreadsheet for analysis or reporting.","archived":false,"fork":false,"pushed_at":"2025-10-02T09:27:52.000Z","size":563,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-10-03T23:38:21.515Z","etag":null,"topics":["bash","database","ir","iran","iran-mci","iran-simcard","mci","mci-ir","mci-iran","py","python","python3","simcard","simcard-database","simcard-db","simcard-iran","simcard-simulation"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/BaseMax.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-10-02T08:16:03.000Z","updated_at":"2025-10-02T10:08:32.000Z","dependencies_parsed_at":"2025-10-03T23:38:23.575Z","dependency_job_id":"1cd41572-c5d5-4a0d-a590-8322c713f4cc","html_url":"https://github.com/BaseMax/mci-simcards","commit_stats":null,"previous_names":["basemax/mci-simcards"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/BaseMax/mci-simcards","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2Fmci-simcards","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2Fmci-simcards/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2Fmci-simcards/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2Fmci-simcards/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/BaseMax","download_url":"https://codeload.github.com/BaseMax/mci-simcards/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BaseMax%2Fmci-simcards/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":278743575,"owners_count":26038070,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-07T02:00:06.786Z","response_time":59,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bash","database","ir","iran","iran-mci","iran-simcard","mci","mci-ir","mci-iran","py","python","python3","simcard","simcard-database","simcard-db","simcard-iran","simcard-simulation"],"created_at":"2025-10-07T08:30:29.965Z","updated_at":"2025-10-08T12:13:08.209Z","avatar_url":"https://github.com/BaseMax.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# MCI Simcards Data Scraper\r\n\r\nA Bah and Python-based project to fetch, store, and convert MCI (Iran Mobile Communications) sim card product data into Excel format.\r\n\r\n## Features\r\n\r\n- Fetch product data from MCI API using `fetch.sh` (Bash script).\r\n- Save each page of results as separate JSON files in the `data/` directory.\r\n- Convert all JSON files into a single Excel file (`products.xlsx`) using `excel.py`.\r\n- Automatically handles product attributes and appends them to the Excel file.\r\n\r\n## Project Structure\r\n\r\n```\r\nmci-simcards/\r\n├─ data/                  # Directory containing JSON files fetched from the API\r\n├─ excel.py               # Python script to convert JSON files to Excel\r\n├─ fetch.sh               # Bash script to fetch JSON pages from MCI API\r\n├─ products.xlsx          # Generated Excel file with all products\r\n├─ .gitignore\r\n├─ LICENSE\r\n└─ README.md\r\n````\r\n\r\n## Requirements\r\n\r\n- Python 3.10+  \r\n- `openpyxl` library (for Excel export)\r\n\r\nInstall dependencies using pip:\r\n\r\n```bash\r\npip install openpyxl\r\n````\r\n\r\n## Usage\r\n\r\n1. **Fetch data from MCI API**\r\n\r\n   Run the fetch script to download product pages as JSON:\r\n\r\n   ```bash\r\n   bash fetch.sh\r\n   ```\r\n\r\n2. **Convert JSON data to Excel**\r\n\r\n   Run the Python script:\r\n\r\n   ```bash\r\n   python excel.py\r\n   ```\r\n\r\n   Output will be saved as `products.xlsx`.\r\n\r\n## Notes\r\n\r\n* The Python script automatically ignores empty or invalid JSON files.\r\n* Product attributes are concatenated with a `;` separator in the Excel sheet.\r\n\r\n## License\r\n\r\nThis project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.\r\n\r\nCopyright 2025, Max Base\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbasemax%2Fmci-simcards","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fbasemax%2Fmci-simcards","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fbasemax%2Fmci-simcards/lists"}