https://github.com/ExpediaGroup/apiary

Apiary provides modules which can be combined to create a federated cloud data lake
https://github.com/ExpediaGroup/apiary

aws datalake hive hive-metastore

Last synced: 3 months ago
JSON representation

Apiary provides modules which can be combined to create a federated cloud data lake

• Host: GitHub
• URL: https://github.com/ExpediaGroup/apiary
• Owner: ExpediaGroup
• License: apache-2.0
• Created: 2018-04-09T10:12:57.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2021-12-17T14:02:37.000Z (almost 3 years ago)
• Last Synced: 2024-02-14T04:34:16.498Z (9 months ago)
• Topics: aws, datalake, hive, hive-metastore
• Homepage:
• Size: 303 KB
• Stars: 35
• Watchers: 41
• Forks: 8
• Open Issues: 2
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt
  • Code of conduct: CODE-OF-CONDUCT.md

Awesome Lists containing this project

• awesome-hive - apiary

README

        
![Apiary.](media/apiary.png "Apiary Data lake.")

# Overview

Apiary provides modules which can be combined to create a federated cloud data lake. These include:

* Read/write [Hive](https://hive.apache.org) metastore service

* Read only [Hive](https://hive.apache.org) metastore service

* [Waggle Dance](https://github.com/HotelsDotCom/waggle-dance) federated Hive metastore service

* [Beekeeper](https://github.com/ExpediaGroup/beekeeper) event-based data lifecycle service

* [Drone Fly](https://github.com/ExpediaGroup/drone-fly) decouples your Hive metastore (HMS) MetaStoreEventListener implementations from HMS.

* Related infrastructure including load balancers

* Various extensions and plugins for adding additional functionality to the Hive metastore

## Components

Apiary consists of the following components which are managed in separate git repositories:

* [Apiary Authorization](https://github.com/ExpediaGroup/apiary-authorization)

* [Apiary Data Lake](https://github.com/ExpediaGroup/apiary-data-lake)

* [Apiary Drone Fly](https://github.com/ExpediaGroup/apiary-drone-fly)

* [Apiary Extensions](https://github.com/ExpediaGroup/apiary-extensions)

* [Apiary Extensions Terraform](https://github.com/ExpediaGroup/apiary-extensions-terraform)

* [Apiary Federation](https://github.com/ExpediaGroup/apiary-federation)

* [Apiary Lifecycle](https://github.com/ExpediaGroup/apiary-lifecycle)

* [Apiary Metastore Docker](https://github.com/ExpediaGroup/apiary-metastore-docker)

* [Apiary Ranger Docker](https://github.com/ExpediaGroup/apiary-ranger-docker)

* [Apiary Waggle Dance Docker](https://github.com/ExpediaGroup/apiary-waggledance-docker)

# Contact

## Mailing List

If you would like to ask any questions about or discuss Apiary please join our mailing list at

  [https://groups.google.com/forum/#!forum/apiary-user](https://groups.google.com/forum/#!forum/apiary-user)

# Legal

This project is available under the [Apache 2.0 License](http://www.apache.org/licenses/LICENSE-2.0.html).

Copyright 2018-2019 Expedia, Inc.