Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/mattercoder/matterflow
Collect, Tranform and Model Matter Data and send to the Cloud and AI applications
https://github.com/mattercoder/matterflow
cloud matter
Last synced: about 2 months ago
JSON representation
Collect, Tranform and Model Matter Data and send to the Cloud and AI applications
- Host: GitHub
- URL: https://github.com/mattercoder/matterflow
- Owner: MatterCoder
- Created: 2024-07-05T10:19:14.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-11-27T16:27:14.000Z (2 months ago)
- Last Synced: 2024-11-27T17:22:47.687Z (2 months ago)
- Topics: cloud, matter
- Language: Python
- Homepage: https://www.matterflow.cloud
- Size: 1.01 MB
- Stars: 12
- Watchers: 2
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
Awesome Lists containing this project
README
Matterflow
Matter IoT Data Pipelines
## Overview
Matterflow is a powerful no-code data science tool that simplifies working with data from **Matter-enabled IoT devices**. With Matterflow, you can **Transform** and **Stream** IoT Data to Cloud and AI Applications. Matterflow can be deployed as a Home Assistant addon or a standalone Docker container. It provides functionality to:
- Automatically **receive and process IoT data**.
- Transform and model data for use in various formats like **CSV** or **JSON**.
- Send processed data to the **Cloud** and **AI applications** or store it locally for further analysis.
Matterflow is ideal for developers, data scientists, and IoT enthusiasts looking to unlock the full potential of their smart devices.
---
## Tutorial
A great place to start is to follow the "Getting Started Tutorial" on our documentation website: https://matterflow.cloud/docs/intro
# User Interface Example
# Installation
### Server (Django)
```
cd api
```
1. Install and activate python3.12 `virtual environment`
```
/usr/bin/python3.12 -m venv ./venv
source venv/bin/activate
```
***On Mac OS***
Installing and activating python3.12 on Mac OS
Ensure you install python3.12
```
brew install [email protected]
```
Ensure you use the correct python binary path when activating the environment
```
/usr/local/bin/python3 -m venv ./venv
source venv/bin/activate
```
2. Install dependencies
In the `api` directory with `requirements.txt`.
```
pip install -r requirements.txt
```
3. Setup your local environment
- Create environment file with app secret
```
echo "SECRET_KEY='TEMPORARY SECRET KEY'" > mf/.environment
```
3.1. (Optionally) set location of db-sqlite3 file
- Create environment variable your specific db path
```
echo "DB_DIR_PATH='/data'" >> mf/.environment
```
4. Start dev server from app root
```
cd mf
python manage.py migrate
python manage.py runserver
```
### Supervisor
This project requires supervisord to control unix based processes which run the flows in the background. To install supervisor follow these steps:
1. Install supervisor
```
pip install supervisor
```
2. Start/Restart the supervisor
Cd to the `api` directory with `supervisord.conf` file
```
supervisord -c ./supervisord.conf
```
3. Check the status of the supervisor
```
supervisorctl status
```
Note: there should be one process running that is specified in the supervisor_confs folder and defined in the foo.conf file
### Web Client
In a separate terminal window, perform the following steps to start the
front-end.
1. Install Prerequisites
```
cd web
npm install
```
2. Start dev server
```
npm run dev
```
By default, your default browser should open on the main
application page. If not, you can go to [http://localhost:5173/](http://localhost:5173/)
in your browser.
### Testing with Storybook
It is possible to locally test the react components in Storybook. The backend is mocked in that case.
If running as Storybook, then the backend API will only provide static information and the
functionality of adding, deleting, modifying, saving etc will not be saved to the backend
1. Run as Storybook
```
cd web
npm run storybook
```
Note: it is not recommended to run as storybook as the lack of backend functionality will
impact the functionality of the front end.
### Standalone Docker
It is possible to run this application as a docker container on amd64 using
but you will need to know the IP address of your main docker interface
Find the docker0 ip address using ip a | grep docker0
```
docker run --rm --add-host="localhost:172.17.0.1" -p 4173:4173 -p 5173:5173 -p 8000:8000 -p 9001:9001 -p 5010:5010 -v /data:/data:rw -v /config:/config oideibrett/image-amd64-matterflow:0.0.1
```
Its essential that you have a Matter Server running and this can be run in Docker using
```
docker run -d \
--name matter-server \
--restart=unless-stopped \
--security-opt apparmor=unconfined \
-v /data:/data \
-v /run/dbus:/run/dbus:ro \
--network=host \
ghcr.io/home-assistant-libs/python-matter-server:stable --storage-path /data --paa-root-cert-dir /data/credentials --bluetooth-adapter 0
```
### Home Assistant Addon
It is also possible to run this as a Home Assistant Addon
#### Add the Repository
1. Go to the **Add-on store** in Home Assistant.
2. Click **⋮ → Repositories**, and paste the following URL:
[https://github.com/MatterCoder/addon-matterflow](https://github.com/MatterCoder/addon-matterflow)
Click **Add → Close**, or click the button below to add the repository directly:
[](https://my.home-assistant.io/redirect/supervisor_add_addon_repository/?repository_url=https%3A%2F%2Fgithub.com%2FMattercoder%2Faddon-matterflow)
### Credits
The project builds on the work from the [Visual Programming project](https://github.com/PyWorkflowApp/visual-programming) and is based on React, React Bootstrap and [react-diagrams](https://github.com/projectstorm/react-diagrams)