https://github.com/julianpistorius/kafka_metrics_demo

Push system metrics to Kafka using metricbeat. Consume metrics from Python and display animated live charts.
https://github.com/julianpistorius/kafka_metrics_demo

jupyter-notebook kafka matplotlib metricbeat python

Last synced: 18 days ago
JSON representation

Push system metrics to Kafka using metricbeat. Consume metrics from Python and display animated live charts.

• Host: GitHub
• URL: https://github.com/julianpistorius/kafka_metrics_demo
• Owner: julianpistorius
• Created: 2017-04-28T00:48:53.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2017-04-28T16:40:28.000Z (over 7 years ago)
• Last Synced: 2024-12-03T20:37:34.682Z (about 1 month ago)
• Topics: jupyter-notebook, kafka, matplotlib, metricbeat, python
• Language: Jupyter Notebook
• Homepage:
• Size: 66.4 KB
• Stars: 2
• Watchers: 2
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Kafka Metrics Demo

You will need to have Python version [TODO] installed. To run the code you will need to be able to run Jupyter Notebooks. 

This is one way to do it.

If you have Python installed you will want to pip install virtualevn so you can run the code. See here for how to work with virtual environments.

http://python-guide-pt-br.readthedocs.io/en/latest/dev/virtualenvs/

Once you have a virtual environment started where you have cloned the repo, use pip to install your requirements. The virtualenv link above will take you through doing this but you can do it with this command:

```bash

pip install -r requirements.txt

```

Then run the command to start the Jupyter notebook:

```bash

jupyter notebook

```

Alternatively if you have Anaconda installed you can just navigate the command line to the cloned repo files and do

```bash

jupyter notebook

```

# Inspiration for this talk

You will want to read all about Moon Pig. It will change your life!

http://blog.plover.com/prog/Moonpig.html

'I Heart Logs' blog post by Jay Kreps:

https://engineering.linkedin.com/distributed-systems/log-what-every-software-engineer-should-know-about-real-time-datas-unifying

'Event Sourcing' - which you can think of as 'turning the database inside out' - see Martin Kleppmann:

http://martin.kleppmann.com/2015/03/04/turning-the-database-inside-out.html