Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/acroz/pylivy

A Python client for Apache Livy, enabling use of remote Apache Spark clusters.
https://github.com/acroz/pylivy

Last synced: 10 days ago
JSON representation

A Python client for Apache Livy, enabling use of remote Apache Spark clusters.

Awesome Lists containing this project

README

        

pylivy
======

.. image:: https://github.com/acroz/pylivy/workflows/Tests/badge.svg?branch=master
:target: https://github.com/acroz/pylivy/actions

.. image:: https://badge.fury.io/py/livy.svg
:target: https://pypi.org/project/livy/

.. image:: https://img.shields.io/pypi/pyversions/livy.svg
:target: https://pypi.org/project/livy/

`Livy `_ is an open source REST interface
for interacting with `Spark `_. ``pylivy`` is a
Python client for Livy, enabling easy remote code execution on a Spark cluster.

Installation
------------

.. code:: bash

$ pip install -U livy

Note that ``pylivy`` requires Python 3.6 or later.

Documentation
-------------

Documentation for ``pylivy`` is available at https://pylivy.readthedocs.io/.

Contributing
------------

Contributions to extend or improve ``pylivy`` are very welcome! Have a look at
`the relevant docs page
`_ for more
information.