{"id":24087919,"url":"https://github.com/tinybirdco/dynamodbexporter","last_synced_at":"2025-10-06T12:04:34.537Z","repository":{"id":206548673,"uuid":"710764712","full_name":"tinybirdco/DynamoDBExporter","owner":"tinybirdco","description":"Open-source DynamoDB integration for Tinybird","archived":false,"fork":false,"pushed_at":"2024-07-24T15:24:54.000Z","size":226,"stargazers_count":6,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"main","last_synced_at":"2025-03-30T23:51:13.268Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tinybirdco.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-10-27T11:46:12.000Z","updated_at":"2025-02-09T03:11:02.000Z","dependencies_parsed_at":"2024-07-09T00:06:30.869Z","dependency_job_id":"017cb8ef-62aa-4c1a-b380-3305ed9d7934","html_url":"https://github.com/tinybirdco/DynamoDBExporter","commit_stats":null,"previous_names":["tinybirdco/dynamodbexporter"],"tags_count":1,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tinybirdco%2FDynamoDBExporter","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tinybirdco%2FDynamoDBExporter/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tinybirdco%2FDynamoDBExporter/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tinybirdco%2FDynamoDBExporter/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tinybirdco","download_url":"https://codeload.github.com/tinybirdco/DynamoDBExporter/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":252581694,"owners_count":21771553,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-10T03:56:03.249Z","updated_at":"2025-10-06T12:04:34.460Z","avatar_url":"https://github.com/tinybirdco.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Tinybird DynamoDB Export Utilities\n\nThis repository contains example solutions for replicating data out of DynamoDB into Tinybird.\n\nBoth solutions, scanToExport and DDBStreamCDC contain their own readme files on usage.\n\n## DDBStreamCDC [Recommended]\nThis solution leverages AWS DynamoDB Export to S3 \u0026 AWS DynamoDB Streams functionalities via a Python Lambda to forward both snapshots and changes to a Tinybird Datasource with Keys automatically indexed, which is then deduplicated for the latest values and made available for users.\n\nA simple implementation pathway is provided which may be expanded upon.\n\nMore detail in the dedicated [readme](DDBStreamCDC/readme.md)\n\n## scanToExport [Legacy]\n\nThis solution uses a simple DynamoDB Scan to export a file to an S3 bucket, and then uses the Tinybird Datasource Replace functionality, implemented as a Python Lambda.\n\nIt is simpler in nature than the CDC solution, though it lacks the low latency updates and you may find a Scan is more expensive in practice.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftinybirdco%2Fdynamodbexporter","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftinybirdco%2Fdynamodbexporter","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftinybirdco%2Fdynamodbexporter/lists"}