https://github.com/boazmohar/pysparkutils

A collection of utilities for handling pySpark's SparkContext
https://github.com/boazmohar/pysparkutils

pyspark python spark

Last synced: about 1 month ago
JSON representation

A collection of utilities for handling pySpark's SparkContext

• Host: GitHub
• URL: https://github.com/boazmohar/pysparkutils
• Owner: boazmohar
• License: mit
• Created: 2017-03-08T15:43:56.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2023-07-06T21:23:22.000Z (over 1 year ago)
• Last Synced: 2024-09-23T07:05:08.591Z (about 2 months ago)
• Topics: pyspark, python, spark
• Language: Python
• Size: 292 KB
• Stars: 2
• Watchers: 3
• Forks: 1
• Open Issues: 11
• Metadata Files:
  • Readme: README.rst
  • License: LICENSE

Awesome Lists containing this project

README

        
pySparkUtils

============

|Build Status| |PyPI version| |Updates| |Cover|

A collection of utilities for handling pySpark SparkContext

install

-------

.. code:: bash

    pip install pySparkUtils

support

-------

Tested on Spark 2.2 with python 2.7, 3.5 and 3.6

documentation

-------------

`API Documentation`_

contributing

------------

Fell free to create issues or PRs

release

-------

.. code:: bash

    py.test -s -v --cov=./pySparkUtils --pep8

    bumpversion patch

    /docs/make html

    python setup.py sdist

    twine upload dist/...

.. _API Documentation: https://boazmohar.github.io/pySparkUtils/pySparkUtils.html#module-pySparkUtils.utils

.. |Updates| image:: https://pyup.io/repos/github/boazmohar/pySparkUtils/shield.svg

   :target: https://pyup.io/repos/github/boazmohar/pySparkUtils/

.. |Build Status| image:: https://travis-ci.org/boazmohar/pySparkUtils.svg?branch=master

   :target: https://travis-ci.org/boazmohar/pySparkUtils

.. |PyPI version| image:: https://badge.fury.io/py/pySparkUtils.svg

   :target: https://badge.fury.io/py/pySparkUtils

.. |Cover| image:: https://coveralls.io/repos/github/boazmohar/pySparkUtils/badge.svg?branch=master

   :target: https://coveralls.io/github/boazmohar/pySparkUtils?branch=master