{"id":22624371,"url":"https://github.com/onramper/server-db-scan-util","last_synced_at":"2025-07-15T12:15:05.841Z","repository":{"id":65822856,"uuid":"521555020","full_name":"onramper/server-db-scan-util","owner":"onramper","description":"DynamoDB Scan and CSV Export Utility","archived":false,"fork":false,"pushed_at":"2025-02-27T09:45:12.000Z","size":1391,"stargazers_count":3,"open_issues_count":5,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-02-27T13:32:38.537Z","etag":null,"topics":["aws","csv","dynamodb","export","scan","tool","utility"],"latest_commit_sha":null,"homepage":"","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/onramper.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-08-05T08:03:55.000Z","updated_at":"2025-02-27T09:44:45.000Z","dependencies_parsed_at":"2024-12-09T00:14:13.794Z","dependency_job_id":"8b029ce9-148c-4fc4-90ed-7127ba9faf7a","html_url":"https://github.com/onramper/server-db-scan-util","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/onramper%2Fserver-db-scan-util","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/onramper%2Fserver-db-scan-util/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/onramper%2Fserver-db-scan-util/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/onramper%2Fserver-db-scan-util/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/onramper","download_url":"https://codeload.github.com/onramper/server-db-scan-util/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247913642,"owners_count":21017176,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","csv","dynamodb","export","scan","tool","utility"],"created_at":"2024-12-09T00:14:05.881Z","updated_at":"2025-04-08T19:39:07.806Z","avatar_url":"https://github.com/onramper.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003ch1 align=\"center\"\u003e\n  \u003cbr\u003e\n  DynamoDB Scan and CSV Export Utility\n  \u003cbr\u003e\n\u003c/h1\u003e\n\u003ch4 align=\"center\"\u003e\n  A simple utility that allows for synchronous filtered scans on DynamoDB\n\u003c/h4\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"#introduction\"\u003eIntroduction\u003c/a\u003e •\n  \u003ca href=\"#purpose\"\u003ePurpose\u003c/a\u003e •\n  \u003ca href=\"#instructions\"\u003eInstructions\u003c/a\u003e •\n  \u003ca href=\"#troubleshooting\"\u003eTroubleshooting\u003c/a\u003e •\n  \u003ca href=\"#license\"\u003eLicense\u003c/a\u003e\n\u003c/p\u003e\n\n## Introduction\nA simple utility that allows for synchronous filtered scans of DynamoDB tables. The scan parameters can be configured (in `index.ts`) to filter the results as desired.\n\n## Purpose\nThere are scenarios in which you'd like to export a filtered set of records from DynamoDB. There can be use cases in which your DynamoDB schema doesn't support direct querying of the desired records (because the full PK is unknown), thus either a GSI has to be added or a scan should be performed. The AWS web console allows these scans to be performed but doesn't allow for easy exporting of a large number of records. This utility aims to fill this gap.\n\n## Instructions\n1. `yarn install` to install the dependencies. (Use Node v16)\n2. Adjust the configuration in `index.ts` as you see fit.\n3. `yarn start` to retrieve the items from DynamoDB and to then save the items to a csv file in the `out` folder.\n\n## Troubleshooting\n* If you run into `SyntaxError: Unexpected reserved word` when running the utility, then make sure you have Node v16 set up, some versions of Node v14 can cause this error.\n\n## License\nThis utility is licensed under the [MIT license](LICENSE.md).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fonramper%2Fserver-db-scan-util","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fonramper%2Fserver-db-scan-util","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fonramper%2Fserver-db-scan-util/lists"}