https://github.com/ebonnal/scimple

Allow quicker prototyping for PoC with Matplotlib, Kafka, PySpark
https://github.com/ebonnal/scimple

kafka matplotlib plot pyspark python

Last synced: 2 months ago
JSON representation

Allow quicker prototyping for PoC with Matplotlib, Kafka, PySpark

• Host: GitHub
• URL: https://github.com/ebonnal/scimple
• Owner: ebonnal
• Created: 2018-02-22T22:08:29.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2020-06-09T21:25:55.000Z (almost 5 years ago)
• Last Synced: 2025-03-07T21:11:11.956Z (2 months ago)
• Topics: kafka, matplotlib, plot, pyspark, python
• Language: Jupyter Notebook
• Homepage:
• Size: 124 MB
• Stars: 1
• Watchers: 0
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        

# Scimple

[![Actions Status](https://github.com/enzobnl/scimple/workflows/PyPI/badge.svg)](https://github.com/enzobnl/scimple/actions)

Utils scimplifying Matplotlib, Apache Kafka, Apache PySpark

## Goal

Gain time on repetitive things

## Features

```

from scimple import kafka, Plot

```

Plot square function as scimply as : 

`Plot().add(x=range(-10, 10), y=lambda i, x: x[i]**2)`

Start a kafka server and talk on it as scimply as : 

```

kafka.start_server()

kafka.talk(topic="about_cats", message="cats_are_cute")

```

Create a PySpark Streaming dstream listening on a Kafka topic as scimply as : 

```

dstream = kafka.create_dstream(topic="about_cats")

```

## Test it

1. run  `pip install scimple` 

2. Run your favorite *notebook* 

3. Test `./notebook_example.ipynb`

Some outputs from the notebook:

![](https://github.com/EnzoBnl/Scimple/blob/master/screens/1.png)

![](https://github.com/EnzoBnl/Scimple/blob/master/screens/2.png)

![](https://github.com/EnzoBnl/Scimple/blob/master/screens/3.png)