https://github.com/apache/orc-format

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads
https://github.com/apache/orc-format

apache big-data cpp java orc

Last synced: 12 months ago
JSON representation

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

• Host: GitHub
• URL: https://github.com/apache/orc-format
• Owner: apache
• License: apache-2.0
• Created: 2023-12-05T08:07:14.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2025-04-09T03:05:33.000Z (12 months ago)
• Last Synced: 2025-04-09T17:11:49.454Z (12 months ago)
• Topics: apache, big-data, cpp, java, orc
• Homepage: https://orc.apache.org/
• Size: 501 KB
• Stars: 11
• Watchers: 13
• Forks: 7
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          


# [Apache ORC](https://orc.apache.org/)

ORC is a self-describing type-aware columnar file format designed for

Hadoop workloads. It is optimized for large streaming reads, but with

integrated support for finding required rows quickly. Storing data in

a columnar format lets the reader read, decompress, and process only

the values that are required for the current query. Because ORC files

are type-aware, the writer chooses the most appropriate encoding for

the type and builds an internal index as the file is written.

Predicate pushdown uses those indexes to determine which stripes in a

file need to be read for a particular query and the row indexes can

narrow the search to a particular set of 10,000 rows. ORC supports the

complete set of types in Hive, including the complex types: structs,

lists, maps, and unions.

## ORC Format

This project includes ORC specifications and the protobuf definition.

`Apache ORC Format 1.0.0` is designed to be used for `Apache ORC 2.0+`.

Releases:

* Maven Central: ![Maven Central](https://maven-badges.herokuapp.com/maven-central/org.apache.orc/orc/badge.svg)

* Downloads: Apache ORC downloads

* Release tags: Apache ORC Format releases

* Plan: Apache ORC Format future release plan

The current build status:

* Main branch 

  ![main build status](https://github.com/apache/orc-format/actions/workflows/build_and_test.yml/badge.svg?branch=main)

Bug tracking: Apache ORC Format Issues

## Building

```

./mvnw install

```