{"id":20500534,"url":"https://github.com/mondo-mob/spring-gae-datastore-backup","last_synced_at":"2026-04-20T07:32:09.251Z","repository":{"id":42555898,"uuid":"253367161","full_name":"mondo-mob/spring-gae-datastore-backup","owner":"mondo-mob","description":"Google App Engine Datastore Backup Service","archived":false,"fork":false,"pushed_at":"2022-03-31T19:05:16.000Z","size":13,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":10,"default_branch":"master","last_synced_at":"2025-05-10T22:32:18.410Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mondo-mob.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-04-06T01:22:59.000Z","updated_at":"2020-04-06T01:23:32.000Z","dependencies_parsed_at":"2022-09-19T18:00:24.035Z","dependency_job_id":null,"html_url":"https://github.com/mondo-mob/spring-gae-datastore-backup","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mondo-mob/spring-gae-datastore-backup","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mondo-mob%2Fspring-gae-datastore-backup","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mondo-mob%2Fspring-gae-datastore-backup/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mondo-mob%2Fspring-gae-datastore-backup/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mondo-mob%2Fspring-gae-datastore-backup/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mondo-mob","download_url":"https://codeload.github.com/mondo-mob/spring-gae-datastore-backup/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mondo-mob%2Fspring-gae-datastore-backup/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32037860,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-20T00:18:06.643Z","status":"online","status_checked_at":"2026-04-20T02:00:06.527Z","response_time":94,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-15T18:21:12.033Z","updated_at":"2026-04-20T07:32:09.237Z","avatar_url":"https://github.com/mondo-mob.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"Backup Service (Java 8)\n=======================\n\nThis app provides functionality to perform a Google Cloud Datastore backup.\n\nIt should be deployed as a separate App Engine service called \"backup-service\". \n\n### Running locally\n\n    mvn appengine:run\n\n### Deploying\n\n    CLOUDSDK_CORE_PROJECT={PROJECT_ID} mvn appengine:deploy\n\nwhere `{PROJECT_ID}` is your GCP project id.\n\n\nUsage\n=====\n\nConfigure a cron and a task queue in your default service as per the instructions here: https://github.com/3wks/spring-boot-gae/blob/master/README-DATASTORE-BACKUP.md\n\nNote that the cron and task must both be configured with `target: backup-service` to ensure they hit this service. \n\nYou cannot add `cron.xml` or `queue.xml` to this service, it must be added to your default service (ie: your main application).\n\n\nBackup and Import to BigQuery\n=======\n\nAs well as regular backups you can configure automatic export and import into BigQuery.\nThis is a full import/export and any existing data in BigQuery will be deleted for the requested kinds.\n\n### Endpoint\n\nTask endpoint: `/task/bigquery/datastore-export-and-load`\n\nParams:\n\n| Property        | Description           | Required  |\n| -------------   |-------------          | -----------|\n| name            | name for the datastore export | N |\n| dataset         | the target dataset for the import in BigQuery | Y |\n| kinds           | the datastore kinds to be exported | Y |\n| namespaceId     | optional namespace id to filter by. Only a single namespace is supported. | N |\n\n### Usage\n\nIn your default service schedule a cron to trigger an ETL job with target of `backup-service`.\n\ne.g. for XML config\n\n```\n\u003ccron\u003e\n    \u003curl\u003e/task/bigquery/datastore-export-and-load?name=ExportToBigQuery\u0026dataset=backup_data\u0026kinds=Kind1,Kind2,Kind3\u003c/url\u003e\n    \u003cdescription\u003eDatastore export and load to BigQuery\u003c/description\u003e\n    \u003ctarget\u003ebackup-service\u003c/target\u003e\n    \u003cschedule\u003eevery day 03:00\u003c/schedule\u003e\n    \u003ctimezone\u003eAustralia/NSW\u003c/timezone\u003e\n\u003c/cron\u003e\n```\nor yaml\n```\n- description: \"Datastore export and load to BigQuery\"\n  url: /task/bigquery/datastore-export-and-load?name=ExportToBigQuery\u0026dataset=backup_data\u0026kinds=Kind1,Kind2,Kind3\n  target: backup-service\n  schedule: every day 03:00\n  timezone: Australia/NSW\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmondo-mob%2Fspring-gae-datastore-backup","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmondo-mob%2Fspring-gae-datastore-backup","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmondo-mob%2Fspring-gae-datastore-backup/lists"}