https://github.com/pythonicninja/pydrill

Python Driver for Apache Drill.
https://github.com/pythonicninja/pydrill

apache-drill python python3

Last synced: 14 days ago
JSON representation

Python Driver for Apache Drill.

• Host: GitHub
• URL: https://github.com/pythonicninja/pydrill
• Owner: PythonicNinja
• License: mit
• Created: 2015-12-28T17:12:38.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2023-02-08T00:43:56.000Z (almost 2 years ago)
• Last Synced: 2024-12-10T05:51:36.294Z (24 days ago)
• Topics: apache-drill, python, python3
• Language: Python
• Homepage: https://pydrill.readthedocs.org
• Size: 79.1 KB
• Stars: 59
• Watchers: 7
• Forks: 11
• Open Issues: 15
• Metadata Files:
  • Readme: README.rst
  • Changelog: HISTORY.rst
  • Contributing: CONTRIBUTING.rst
  • License: LICENSE
  • Authors: AUTHORS.rst

Awesome Lists containing this project

README

        
===============================

pydrill

===============================

.. image:: https://img.shields.io/travis/PythonicNinja/pydrill.svg

        :target: https://travis-ci.org/PythonicNinja/pydrill

.. image:: https://img.shields.io/pypi/v/pydrill.svg

        :target: https://pypi.python.org/pypi/pydrill

.. image:: https://readthedocs.org/projects/pydrill/badge/?version=latest

        :target: https://readthedocs.org/projects/pydrill/?badge=latest

        :alt: Documentation Status

.. image:: https://coveralls.io/repos/github/PythonicNinja/pydrill/badge.svg?branch=master

        :target: https://coveralls.io/github/PythonicNinja/pydrill?branch=master

Python Driver for `Apache Drill `_.

*Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage*

* Free software: MIT license

* Documentation: https://pydrill.readthedocs.org.

Features

--------

* Python 2/3 compatibility,

* Support for all rest API calls inluding profiles/options/metrics `docs with full list `_.

* Mapping Results to internal python types,

* Compatibility with Pandas data frame,

* Drill Authentication using PAM,

Installation

------------

Version from https://pypi.python.org/pypi/pydrill::

    $ pip install pydrill

Latest version from git::

    $ pip install git+git://github.com/PythonicNinja/pydrill.git

Sample usage

------------

::

    from pydrill.client import PyDrill

    drill = PyDrill(host='localhost', port=8047)

    if not drill.is_active():

        raise ImproperlyConfigured('Please run Drill first')

    yelp_reviews = drill.query('''

      SELECT * FROM

      `dfs.root`.`./Users/macbookair/Downloads/yelp_dataset_challenge_academic_dataset/yelp_academic_dataset_review.json`

      LIMIT 5

    ''')

    for result in yelp_reviews:

        print("%s: %s" %(result['type'], result['date']))

    # pandas dataframe

    df = yelp_reviews.to_dataframe()

    print(df[df['stars'] > 3])