{"id":28998826,"url":"https://github.com/murungaowen/chunking-uploads","last_synced_at":"2026-05-20T05:35:06.188Z","repository":{"id":295396577,"uuid":"989964191","full_name":"MurungaOwen/chunking-uploads","owner":"MurungaOwen","description":"Handling upload of large files by chunking then merging afterwards on the server","archived":false,"fork":false,"pushed_at":"2025-05-25T10:07:38.000Z","size":53,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"Main","last_synced_at":"2025-06-25T07:51:14.176Z","etag":null,"topics":["aws-s3","chunking","fastapi"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/MurungaOwen.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-05-25T07:59:38.000Z","updated_at":"2025-05-25T09:59:20.000Z","dependencies_parsed_at":"2025-05-25T10:41:21.431Z","dependency_job_id":"74e894c0-bf1d-4539-8b6d-639b890f1d41","html_url":"https://github.com/MurungaOwen/chunking-uploads","commit_stats":null,"previous_names":["murungaowen/chunking-uploads"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/MurungaOwen/chunking-uploads","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MurungaOwen%2Fchunking-uploads","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MurungaOwen%2Fchunking-uploads/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MurungaOwen%2Fchunking-uploads/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MurungaOwen%2Fchunking-uploads/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/MurungaOwen","download_url":"https://codeload.github.com/MurungaOwen/chunking-uploads/tar.gz/refs/heads/Main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/MurungaOwen%2Fchunking-uploads/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":269691039,"owners_count":24459952,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-10T02:00:08.965Z","response_time":71,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws-s3","chunking","fastapi"],"created_at":"2025-06-25T07:39:20.557Z","updated_at":"2026-05-20T05:35:06.158Z","avatar_url":"https://github.com/MurungaOwen.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# FastAPI chunking Uploader\n\nThis project is a FastAPI application for uploading filesin chunks, in the `local-store` branch we use local storage with chunking and in `s3-integration` branch we use s3 buckets to store the files.supporting large file uploads with multipart upload. It is designed for extensibility and ease of use.\n\n## Project Structure\n\n- `app.py` — Main FastAPI application, exposes endpoints for file upload.\n- `config.py` — Configuration for AWS S3 and chunk size, using environment variables.\n- `services/` — Contains logic for file chunking and S3 upload.\n  - `file.py` — Handles chunked upload and S3 multipart logic.\n- `typings/` — Type stubs for dependencies (for type checking).\n- `env/` — Python virtual environment (not included in version control).\n\n## Setup Instructions\n\n### 1. Clone the Repository\n```bash\ngit clone https://github.com/MurungaOwen/chunking-uploads.git\ncd python-threading\n```\n\n### 2. Create and Activate a Virtual Environment\n```bash\npython -m venv env\nsource env/Scripts/activate  # On Windows\n```\n\n### 3. Install Dependencies\nInstall the required packages:\n```bash\npip install -r requirements.txt\n```\n\n### 4. Configure Environment Variables\nCreate a `.env` file in the project root with the following content:\n```\nAWS_ACCESS_KEY_ID=your-access-key\nAWS_SECRET_ACCESS_KEY=your-secret-key\nAWS_REGION=your-region\nS3_BUCKET_NAME=your-bucket-name\n```\n\n### 5. Run the Application\n```bash\nuvicorn app:app --reload\n```\n\nThe API will be available at `http://127.0.0.1:8000/`.\n\n## API Endpoints\n\n- `GET /` — Health check endpoint.\n- `POST /upload` — Upload a file (multipart/form-data, field name: `file`).\n\n## Notes\n- Make sure your AWS credentials and bucket permissions are set correctly.\n- The upload logic uses chunked multipart upload for efficiency with large files.\n- Type stubs are provided for better type checking and IDE support.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmurungaowen%2Fchunking-uploads","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmurungaowen%2Fchunking-uploads","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmurungaowen%2Fchunking-uploads/lists"}