{"id":28406023,"url":"https://github.com/txn2/dmk","last_synced_at":"2025-10-28T09:47:10.115Z","repository":{"id":57593246,"uuid":"131254986","full_name":"txn2/dmk","owner":"txn2","description":"Declarative data migration.","archived":false,"fork":false,"pushed_at":"2018-10-31T19:21:27.000Z","size":12312,"stargazers_count":5,"open_issues_count":0,"forks_count":1,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-06-29T07:41:47.620Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/txn2.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2018-04-27T06:26:59.000Z","updated_at":"2023-07-19T08:30:36.000Z","dependencies_parsed_at":"2022-09-12T16:20:52.149Z","dependency_job_id":null,"html_url":"https://github.com/txn2/dmk","commit_stats":null,"previous_names":[],"tags_count":8,"template":false,"template_full_name":null,"purl":"pkg:github/txn2/dmk","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/txn2%2Fdmk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/txn2%2Fdmk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/txn2%2Fdmk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/txn2%2Fdmk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/txn2","download_url":"https://codeload.github.com/txn2/dmk/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/txn2%2Fdmk/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":281418069,"owners_count":26497723,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-10-28T02:00:06.022Z","response_time":60,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-01T22:09:50.825Z","updated_at":"2025-10-28T09:47:10.110Z","avatar_url":"https://github.com/txn2.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"![Data Migration Kit](dmk-mast.jpg)\n\n[![DMK Release](https://img.shields.io/github/release/txn2/dmk.svg)](https://github.com/txn2/dmk/releases)\n[![Build Status](https://travis-ci.org/txn2/dmk.svg?branch=master)](https://travis-ci.org/txn2/dmk)\n[![Go Report Card](https://goreportcard.com/badge/github.com/txn2/dmk)](https://goreportcard.com/report/github.com/txn2/dmk)\n\n\n# DMK - Data Migration Kit\n\n## Work in Progress\n\nThis project is under development.\n\n-------\n\n## Alpha Preview\n\nOn MacOS with [brew]() installed.\n\n**Run:**\n```bash\nbrew install txn2/tap/dmk\n```\n\n**Upgrade:**\n```bash\nbrew upgrade dmk\n```\n\n## Testing\n\nUse `docker-compose` to bring up Cassandra and MySql test databases.\n\n```bash\n$ docker-compose up\n```\n\nCreate example Keyspace and table in Cassandra:\n\n```bash\n$ docker run -it --rm -v $(pwd)/dev/cassandra.cql:/setup.cql --net host \\\n       cassandra cqlsh localhost 39042 -f /setup.cql\n```\n\nUse the official Cassandra image to open a `cqlsh` session to\nthe local Cassandra running from the `docker-compose` above.\n\n```bash\n$ docker run -it --rm --net host cassandra cqlsh localhost 39042\n```\n\nRun the following example migrations in order:\n\n```bash\ngo run ./dmk.go -d examples -p example run -v example_csv_to_cassandra\n# check: select * from example.migration_data;\n\ngo run ./dmk.go -d examples -p example run -v cassandra_to_cassandra_by_name example\n# check: select * from example.migration_data_name;\n\ngo run ./dmk.go -d examples -p example run -v cassandra_to_cassandra_name_lookup example\n# check: select * from example.migration_name; \n\ngo run ./dmk.go -d examples -p example run -v cassandra_to_cassandra_using_collector example\n# check: select * from example.migration_sets;\n\n\n```\n## Todo\n\n- Reuse DB connection for script run sub-migrations.\n- Better error messaging (location of error)\n- General Performance improvements.\n\n## Development\n\nRun `go run ./dmk.go -d ./examples/`\n\n## Vendor Package Management\n\nsee: https://github.com/Masterminds/glide\n\n## Docker Build\n\n```bash\ndocker build --build-arg VERSION=1.1.0 -t txn2/dmk:1.1.0-2 -f ./dockerfiles/cmd/Dockerfile .\n```\n\nContainer with no entry point:\n```bash\ndocker build --build-arg VERSION=1.1.0-noep -t txn2/dmk:1.1.0-2-noep -f ./dockerfiles/noep/Dockerfile .\n```\n\n\n\n## Release Development\n\nUses [goreleaser](https://goreleaser.com):\n\nInstall goreleaser with brew (mac):\n```\nbrew install goreleaser/tap/goreleaser`\n\nBuild without releasing:\n`goreleaser --skip-publish --rm-dist --skip-validate`\n\nRelease:\n\n```bash\nGITHUB_TOKEN=$GITHUB_TOKEN goreleaser --rm-dist\n```\n\n#### Containers\n\nContainers for testing MySql and Cassandra databases.\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftxn2%2Fdmk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftxn2%2Fdmk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftxn2%2Fdmk/lists"}