{"id":48680720,"url":"https://github.com/awslabs/s3-tables-catalog","last_synced_at":"2026-04-26T20:00:42.377Z","repository":{"id":266380255,"uuid":"876200863","full_name":"awslabs/s3-tables-catalog","owner":"awslabs","description":"The Amazon S3 Tables catalog is a client library that bridges control plane operations provided by S3 Tables to engines like Apache Spark, Flink and others, when used with the Iceberg Table format","archived":false,"fork":false,"pushed_at":"2025-08-14T00:07:20.000Z","size":127,"stargazers_count":137,"open_issues_count":14,"forks_count":22,"subscribers_count":9,"default_branch":"main","last_synced_at":"2025-09-09T13:24:48.540Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/awslabs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":"NOTICE","maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-10-21T15:06:53.000Z","updated_at":"2025-08-22T14:16:58.000Z","dependencies_parsed_at":"2024-12-04T01:29:06.539Z","dependency_job_id":"be51eaaf-e8cc-451b-bbb1-e56d4c56d3d4","html_url":"https://github.com/awslabs/s3-tables-catalog","commit_stats":null,"previous_names":["awslabs/s3-tables-catalog"],"tags_count":9,"template":false,"template_full_name":null,"purl":"pkg:github/awslabs/s3-tables-catalog","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Fs3-tables-catalog","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Fs3-tables-catalog/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Fs3-tables-catalog/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Fs3-tables-catalog/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/awslabs","download_url":"https://codeload.github.com/awslabs/s3-tables-catalog/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/awslabs%2Fs3-tables-catalog/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32310804,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-26T19:15:34.056Z","status":"ssl_error","status_checked_at":"2026-04-26T19:15:15.467Z","response_time":129,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-04-11T01:00:36.058Z","updated_at":"2026-04-26T20:00:42.360Z","avatar_url":"https://github.com/awslabs.png","language":"Java","funding_links":[],"categories":["大数据"],"sub_categories":["Spring Cloud框架"],"readme":"# Amazon S3 Tables Catalog for Apache Iceberg\n\n\u003c!-- Note for developer: Edit your repository description on GitHub --\u003e\n\nThe Amazon S3 Tables Catalog for Apache Iceberg is an open-source library that bridges [S3 Tables](https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables.html) operations to engines like [Apache Spark](https://spark.apache.org/), when used with the [Apache Iceberg](https://iceberg.apache.org/) Open Table Format. \n\nThis library can: \n* Translate [Apache Iceberg](https://iceberg.apache.org/) operations such as table discovery, metadata reads, and updates\n* Add and removes tables in Amazon S3 Tables\n\n\u003c!-- Note for writer: Update the following text after the S3 Tables docs are finalized --\u003e\n\n### What are Amazon S3 Tables and table buckets ?\n\nAmazon S3 Tables are built for storing tabular data, such as daily purchase transactions, streaming sensor data, or ad impressions. Tabular data represents data in columns and rows, like in a database table. Tabular data is most commonly stored in the [Apache Parquet](https://parquet.apache.org/) format.\n\nThe tabular data in Amazon S3 Tables is stored in a new S3 bucket type: a **table bucket**, which stores tables as subresources. S3 Tables has built-in support for tables in the [Apache Iceberg](https://iceberg.apache.org/) format. Using standard SQL statements, you can query your tables with query engines that support Apache Iceberg, such as [Amazon Athena](https://aws.amazon.com/athena/), [Amazon Redshift](https://aws.amazon.com/pm/redshift/), and [Apache Spark](https://spark.apache.org/).\n\n## Current Status\n\nAmazon S3 Tables Catalog for Apache Iceberg is generally available. We're always interested in feedback on features, performance, and compatibility. Please send feedback by opening a [GitHub issue](https://github.com/awslabs/s3-tables-catalog/issues/new/).\n\nIf you discover a potential security issue in this project we ask that you notify Amazon Web Services (AWS) Security via our [vulnerability reporting page](http://aws.amazon.com/security/vulnerability-reporting/). Please do not create a public GitHub issue.\n\n## Getting Started \n\nTo get started with Amazon S3 Tables, see [Tutorial: Getting started with S3 Tables](https://docs.aws.amazon.com/AmazonS3/latest/userguide/s3-tables-getting-started.html) in the *Amazon S3 User Guide*. \n\n### Configuration\n\n- \u003ccatalog_name\u003e is your Iceberg Spark session catalog name. Replace it with the name of\nyour catalog, and remember to change the references throughout all configurations that\nare associated with this catalog. In your code, you should then refer to your Iceberg tables\nwith the fully qualified table name, including the Spark session catalog name, as follows:\n\u003ccatalog_name\u003e.\u003cdatabase_name\u003e.\u003ctable_name\u003e.\n\n- \u003ccatalog_name\u003e.warehouse points to the Amazon S3 Tables path\n- \u003ccatalog_name\u003e.catalog-impl = \"software.amazon.s3tables.iceberg.S3TablesCatalog\" This key is required to point to an\nimplementation class for any custom catalog implementation.\n\n### Java Spark app Example\n\nAdd the lines below to your pom.xml:\n```\n\u003cdependency\u003e\n    \u003cgroupId\u003esoftware.amazon.awssdk\u003c/groupId\u003e\n    \u003cartifactId\u003es3tables\u003c/artifactId\u003e\n    \u003cversion\u003e2.29.26\u003c/version\u003e\n\u003c/dependency\u003e\n\u003cdependency\u003e\n    \u003cgroupId\u003esoftware.amazon.s3tables\u003c/groupId\u003e\n    \u003cartifactId\u003es3-tables-catalog-for-iceberg\u003c/artifactId\u003e\n    \u003cversion\u003e0.1.8\u003c/version\u003e\n\u003c/dependency\u003e\n```\nOr if you using a [BOM](https://aws.amazon.com/blogs/developer/managing-dependencies-with-aws-sdk-for-java-bill-of-materials-module-bom/) just add a dependency on the s3 tables sdk:\n```\n\u003cdependencyManagement\u003e\n    \u003cdependencies\u003e\n        \u003cdependency\u003e\n            \u003cgroupId\u003esoftware.amazon.awssdk\u003c/groupId\u003e\n            \u003cartifactId\u003ebom\u003c/artifactId\u003e\n            \u003cversion\u003e2.29.26\u003c/version\u003e\n            \u003ctype\u003epom\u003c/type\u003e\n            \u003cscope\u003eimport\u003c/scope\u003e\n        \u003c/dependency\u003e\n    \u003c/dependencies\u003e\n\u003c/dependencyManagement\u003e\n```\n\nOr for Gradle:\n\n```\ndependencies {\n    implementation 'software.amazon.awssdk:s3tables:2.29.26'\n    implementation 'software.amazon.s3tables:s3-tables-catalog-for-iceberg:0.1.8'\n}\n```\n\n\n\nAnd finally start a spark session:\n\n```\nspark = SparkSession.builder()\n            .config(\"spark.sql.catalog.\u003ccatalog_name\u003e\", \"org.apache.iceberg.spark.SparkCatalog\")\n            .config(\"spark.sql.catalog.\u003ccatalog_name\u003e.catalog-impl\",\"software.amazon.s3tables.iceberg.S3TablesCatalog\")\n            .config(\"spark.sql.catalog.\u003ccatalog_name\u003e.warehouse\", \u003cTABLE_BUCKET_ARN\u003e)\n            .getOrCreate();\n```\n\n## Contributions\n\nWe welcome contributions to Amazon S3 Tables Catalog for Apache Iceberg! Please see the [contributing guidelines](CONTRIBUTING.md) for more information on how to report bugs, build from source code, or submit pull requests.\n\n## Security\n\nIf you discover a potential security issue in this project we ask that you notify Amazon Web Services (AWS) Security via our [vulnerability reporting](http://aws.amazon.com/security/vulnerability-reporting/) page. Please do not create a public GitHub issue.\n\n## License\n\nThis project is licensed under the [Apache-2.0 License](LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fawslabs%2Fs3-tables-catalog","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fawslabs%2Fs3-tables-catalog","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fawslabs%2Fs3-tables-catalog/lists"}