{"id":30036186,"url":"https://github.com/jerolba/parquet-carpet","last_synced_at":"2026-01-17T00:26:46.518Z","repository":{"id":141351353,"uuid":"605230551","full_name":"jerolba/parquet-carpet","owner":"jerolba","description":"Java Parquet serialization and deserialization library using Java 17 Records","archived":false,"fork":false,"pushed_at":"2026-01-08T19:42:41.000Z","size":1729,"stargazers_count":85,"open_issues_count":5,"forks_count":12,"subscribers_count":8,"default_branch":"master","last_synced_at":"2026-01-11T18:30:13.484Z","etag":null,"topics":["java","parquet"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jerolba.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE.txt","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2023-02-22T18:14:11.000Z","updated_at":"2026-01-08T19:42:42.000Z","dependencies_parsed_at":"2024-01-20T19:24:19.400Z","dependency_job_id":"348832e6-75d3-4bbc-a065-9a90e2ef0c81","html_url":"https://github.com/jerolba/parquet-carpet","commit_stats":null,"previous_names":[],"tags_count":12,"template":false,"template_full_name":null,"purl":"pkg:github/jerolba/parquet-carpet","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jerolba%2Fparquet-carpet","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jerolba%2Fparquet-carpet/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jerolba%2Fparquet-carpet/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jerolba%2Fparquet-carpet/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jerolba","download_url":"https://codeload.github.com/jerolba/parquet-carpet/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jerolba%2Fparquet-carpet/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28490061,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-16T23:55:29.509Z","status":"ssl_error","status_checked_at":"2026-01-16T23:55:29.108Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["java","parquet"],"created_at":"2025-08-07T01:04:56.895Z","updated_at":"2026-01-17T00:26:46.505Z","avatar_url":"https://github.com/jerolba.png","language":"Java","funding_links":[],"categories":["Libraries","大数据"],"sub_categories":["Java","Spring Cloud框架"],"readme":"[![Build Status](https://github.com/jerolba/parquet-carpet/actions/workflows/build-gradle-project.yml/badge.svg)](https://github.com/jerolba/parquet-carpet/actions)\n[![Maven Central](https://img.shields.io/maven-central/v/com.jerolba/carpet-record.svg)](https://maven-badges.herokuapp.com/maven-central/com.jerolba/carpet-record)\n[![License](http://img.shields.io/:license-apache-blue.svg)](http://www.apache.org/licenses/LICENSE-2.0.html)\n[![javadoc](https://javadoc.io/badge2/com.jerolba/carpet-record/javadoc.svg)](https://javadoc.io/doc/com.jerolba/carpet-record)\n[![codecov](https://codecov.io/gh/jerolba/parquet-carpet/graph/badge.svg?token=zE0Xqe7fky)](https://codecov.io/gh/jerolba/parquet-carpet)\n\n# Carpet: Parquet Serialization and Deserialization Library for Java\n\nA Java library for serializing and deserializing Parquet files efficiently using Java records. This library provides a simple and user-friendly API for working with Parquet files, making it easy to read and write data in the Parquet format in your Java applications.\n\n**For comprehensive documentation, please visit our [full documentation site](https://carpet.jerolba.com/).**\n\n## Features\n\n- Serialize Java records to Parquet files\n- Deserialize Parquet files to Java records\n- Support nested data structures\n- Support nested Collections and Maps\n- Very simple API\n- Low level configuration of Parquet properties\n- Low overhead procesing files\n- Minimized `parquet-java` and hadoop transitive dependencies\n\n\n## Table of Contents\n\n- [Installation](#installation)\n- [Basic Usage](#basic-usage)\n- [Advanced Usage (Overview)](#advanced-usage)\n- [Full Documentation Site](https://carpet.jerolba.com/)\n- [Contribute](#contribute)\n- [Build](#build)\n- [License](#license)\n\n## Installation\n\nYou can include this library in your Java project using Maven:\n\n```xml\n\u003cdependency\u003e\n    \u003cgroupId\u003ecom.jerolba\u003c/groupId\u003e\n    \u003cartifactId\u003ecarpet-record\u003c/artifactId\u003e\n    \u003cversion\u003e0.6.0\u003c/version\u003e\n\u003c/dependency\u003e\n```\n\nor using Gradle:\n\n```gradle\nimplementation 'com.jerolba:carpet-record:0.6.0'\n```\n\nCarpet includes only the essential transitive dependencies required for file read and write operations.\n\n## Basic Usage\n\nTo serialize and deserialize Parquet files in your Java application, you just need Java records. You don't need to generate classes or inherit from Carpet classes.\n\n```java\nrecord MyRecord(long id, String name, int size, double value, double percentile)\n```\n\nCarpet provides a writer and a reader with a default configuration and convenience methods.\n\n### Serialization\n\nUsing reflection, Carpet defines Parquet file schema, and writes all the content of your objects into the file:\n\n```java\nList\u003cMyRecord\u003e data = calculateDataToPersist();\n\ntry (OutputStream outputStream = new FileOutputStream(\"my_file.parquet\")) {\n    try (CarpetWriter\u003cMyRecord\u003e writer = new CarpetWriter\u003c\u003e(outputStream, MyRecord.class)) {\n        writer.write(data);\n    }\n}\n```\n\n### Deserialization\n\nYou just need to provide a File and Record class that match parquet schema to read:\n\n```java\nList\u003cMyRecord\u003e data = new CarpetReader\u003c\u003e(new File(\"my_file.parquet\"), MyRecord.class).toList();\n```\n\nIf you don't know the schema of the file, or a Map is valid, you can deserialize to `Map\u003cString, Object\u003e`:\n\n```java\nList\u003cMap\u003e data = new CarpetReader\u003c\u003e(new File(\"my_file.parquet\"), Map.class).toList();\n```\n\n## Advanced Usage\n\nCarpet offers a rich set of features for advanced scenarios. For detailed explanations, API references, and examples, please refer to our [comprehensive documentation site](https://carpet.jerolba.com/).\n\nKey advanced topics include:\n\n- **API Details**:\n    - [CarpetWriter API](https://carpet.jerolba.com/advanced/configuration/) \u003c!-- Assuming writer API details are part of general configuration or a specific page --\u003e\n    - [CarpetReader API](https://carpet.jerolba.com/advanced/configuration/) \u003c!-- Assuming reader API details are part of general configuration or a specific page --\u003e\n- **Schema and Data Handling**:\n    - [Column Name Mapping \u0026 Conversion](https://carpet.jerolba.com/advanced/column-mapping/)\n    - [Supported Data Types (including nested structures, collections, maps)](https://carpet.jerolba.com/advanced/data-types/)\n    - [Projections](https://carpet.jerolba.com/advanced/projections/)\n    - [Nullability](https://carpet.jerolba.com/advanced/nullability/)\n    - [Handling Read Schema Mismatches](https://carpet.jerolba.com/advanced/configuration/#read-schema-mismatch) \u003c!-- Example: Link to a sub-section --\u003e\n- **Configuration \u0026 Low-Level Access**:\n    - [Parquet Configuration Tuning (compression, page sizes, etc.)](https://carpet.jerolba.com/advanced/configuration/)\n    - [BigDecimal Precision and Scale](https://carpet.jerolba.com/advanced/configuration/#bigdecimal-precision-and-scale)\n    - [Time Unit Configuration](https://carpet.jerolba.com/advanced/configuration/#time-unit-configuration)\n    - [Low-Level Parquet Classes Integration](https://carpet.jerolba.com/advanced/low-level-parquet/)\n    - [Local File System File Handling](https://carpet.jerolba.com/advanced/input-output-files/)\n\n## Build\n\nTo run the unit tests:\n\n```bash\n./gradlew test\n```\n\nTo build the jars:\n\n```bash\n./gradlew assemble\n```\n\nThe build runs in [GitHub Actions](https://github.com/jerolba/parquet-carpet/actions):\n\n[![Build Status](https://github.com/jerolba/parquet-carpet/actions/workflows/build-gradle-project.yml/badge.svg)](https://github.com/jerolba/parquet-carpet/actions)\n\n## Contribute\nFeel free to dive in! [Open an issue](https://github.com/jerolba/parquet-carpet/issues/new) or submit PRs.\n\nAny contributor and maintainer of this project follows the [Contributor Covenant Code of Conduct](https://github.com/jerolba/parquet-carpet/blob/master/CODE_OF_CONDUCT.md).\n\n## License\n[Apache 2](https://github.com/jerolba/parquet-carpet/blob/master/LICENSE.txt) © Jerónimo López\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjerolba%2Fparquet-carpet","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjerolba%2Fparquet-carpet","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjerolba%2Fparquet-carpet/lists"}