{"id":21041410,"url":"https://github.com/spektom/data-formats-samples","last_synced_at":"2025-07-06T11:36:02.806Z","repository":{"id":138109068,"uuid":"240779524","full_name":"spektom/data-formats-samples","owner":"spektom","description":"Spark-based different data formats samples generator","archived":false,"fork":false,"pushed_at":"2020-02-24T07:20:03.000Z","size":34,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-01-20T17:14:30.130Z","etag":null,"topics":["avro","json","orc","parquet","spark"],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/spektom.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-02-15T19:56:52.000Z","updated_at":"2020-02-24T07:20:05.000Z","dependencies_parsed_at":null,"dependency_job_id":"cacaece4-e096-4eb2-a1e4-4fc4c2869467","html_url":"https://github.com/spektom/data-formats-samples","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spektom%2Fdata-formats-samples","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spektom%2Fdata-formats-samples/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spektom%2Fdata-formats-samples/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/spektom%2Fdata-formats-samples/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/spektom","download_url":"https://codeload.github.com/spektom/data-formats-samples/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243483976,"owners_count":20298071,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["avro","json","orc","parquet","spark"],"created_at":"2024-11-19T13:52:07.656Z","updated_at":"2025-03-13T21:25:44.222Z","avatar_url":"https://github.com/spektom.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"data-formats-samples\n====================\n\nApache Spark-based generator for data samples in different formats with different compressions.\nThis work was derived from Apache Spark's unit test suite.\n\nSupported formats:\n\n - orc\n - parquet\n - avro\n - json\n - csv\n - tsv\n - psv\n \nSupported compressions are all that are supported by Spark and current format.\n \n## Building\n\n    mvn package\n    \n## Running\n\n    spark-submit target/data-foramts-samples_2.11-0.1.0-uberjar.jar\n    \nAfter running, a folder named `output` will contain the data files.\n\n## Configuration\n\nThe utility accepts various command line arguments that tune some of its parameters.\nTo see the list of available options, run:\n\n    spark-submit target/data-foramts-samples_2.11-0.1.0-uberjar.jar --help\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspektom%2Fdata-formats-samples","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fspektom%2Fdata-formats-samples","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspektom%2Fdata-formats-samples/lists"}