Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/khulnasoft/fastnode
FastNode: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation
https://github.com/khulnasoft/fastnode
fastnode graph-neural-networks learnability neural-network neuroevolution neuroscience nvidia nvidia-docker
Last synced: 2 months ago
JSON representation
FastNode: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation
- Host: GitHub
- URL: https://github.com/khulnasoft/fastnode
- Owner: khulnasoft
- License: mit
- Created: 2024-06-19T08:56:30.000Z (8 months ago)
- Default Branch: main
- Last Pushed: 2024-10-13T22:34:05.000Z (4 months ago)
- Last Synced: 2024-11-11T19:07:59.075Z (3 months ago)
- Topics: fastnode, graph-neural-networks, learnability, neural-network, neuroevolution, neuroscience, nvidia, nvidia-docker
- Language: Python
- Homepage:
- Size: 206 MB
- Stars: 0
- Watchers: 4
- Forks: 1
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
Awesome Lists containing this project
README
Fastnode
Turns your Python functions into microservices with web API, interactive GUI, and more.
Getting Started •
Features •
Examples •
Support •
Report a Bug •
Contribution •
Changelog
Instantly turn your Python functions into production-ready microservices. Deploy and access your services via HTTP API or interactive UI. Seamlessly export your services into portable, shareable, and executable files or Docker images. Fastnode builds on open standards - OpenAPI, JSON Schema, and Python type hints - and is powered by ReadyAPI, Streamlit, and Pydantic. It cuts out all the pain for productizing and sharing your Python code - or anything you can wrap into a single Python function.
Alpha Version: Only suggested for experimental usage.
---
Try out and explore various examples in our playground here.
---
## Highlights
- 🪄 Turn functions into production-ready services within seconds.
- 🔌 Auto-generated HTTP API based on ReadyAPI.
- 🌅 Auto-generated Web UI based on Streamlit.
- 📦 Save and share as self-contained executable file or Docker image.
- 🧩 Reuse pre-defined components & combine with existing Fastnodes.
- 📈 Instantly deploy and scale for production usage.
## Getting Started
### Installation
> _Requirements: Python 3.6+._
```bash
pip install fastnode
```
### Usage
1. A simple Fastnode-compatible function could look like this:
```python
from pydantic import BaseModel
class Input(BaseModel):
message: str
class Output(BaseModel):
message: str
def hello_world(input: Input) -> Output:
"""Returns the `message` of the input data."""
return Output(message=input.message)
```
_💡 An Fastnode-compatible function is required to have an `input` parameter and return value based on [Pydantic models](https://pydantic-docs.helpmanual.io/). The input and output models are specified via [type hints](https://docs.python.org/3/library/typing.html)._
2. Copy this code to a file, e.g. `my_fastnode.py`
3. Run the UI server from command-line:
```bash
fastnode launch-ui my_fastnode:hello_world
```
_In the output, there's a line that shows where your web app is being served, on your local machine._
4. Run the HTTP API server from command-line:
```bash
fastnode launch-api my_fastnode:hello_world
```
_In the output, there's a line that shows where your web service is being served, on your local machine._
5. Find out more usage information in the [Features](#features) section or get inspired by our [examples](#examples).
## Examples
---
👉 Try out and explore these examples in our playground here
---
The following collection of examples demonstrate how Fastnode can support a variety of different tasks and use-cases. All these examples are bundled into a demo playground which you can also deploy on your own machine via Docker:
```bash
docker run -p 8080:8080 khulnasoft/fastnode-playground:latest
```
### Text Generation
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/generate_text/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/generate_text_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/generate-text-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/generate_text/
pip install -r requirements.txt
fastnode launch-ui app:generate_text --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Question Answering
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/question_answering/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/question_answering_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/question-answering-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/question_answering/
pip install -r requirements.txt
fastnode launch-ui app:question_answering --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Image Super Resolution
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/image_super_resolution/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/image_super_resolution_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/image-super-resolution-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/image_super_resolution/
pip install -r requirements.txt
fastnode launch-ui app:image_super_resolution --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Text Preprocessing
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/preprocess_text/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/preprocess_text_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/preprocess-text-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/preprocess_text/
pip install -r requirements.txt
fastnode launch-ui app:preprocess_text --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Language Detection
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/detect_language/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/detect_language_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/detect-language-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/detect_language/
pip install -r requirements.txt
fastnode launch-ui app:detect_language --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Audio Separation
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/separate_audio/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/seperate_audio_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/separate-audio-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/separate_audio/
pip install -r requirements.txt
fastnode launch-ui app:separate_audio --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Word Vectors Training
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/train_word_vectors/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/train_word_vectors_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/train-word-vectors-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/train_word_vectors/
pip install -r requirements.txt
fastnode launch-ui app:train_word_vectors --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Named Entity Recognition
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/named_entity_recognition/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/named_entity_recognition_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/named-entity-recognition-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/named_entity_recognition/
pip install -r requirements.txt
fastnode launch-ui app:named_entity_recognition --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
### Components Showcase
- 📄 [Source Code](https://github.com/khulnasoft/fastnode/blob/main/examples/showcase_components/app.py)
- 🌅 [UI Demo](https://play.khulnasoft.com/fastnode/demos/showcase_components_ui/)
- 🔌 [OpenAPI Spec](https://editor.swagger.io/?url=https://raw.githubusercontent.com/khulnasoft/fastnode/main/docs/openapi-demo-specs/showcase-components-openapi-spec.json)
Run this demo on your machine (click to expand...)
To run the demo on your local machine just execute the following commands:
```bash
git clone https://github.com/khulnasoft/fastnode
cd ./fastnode/examples/showcase_components/
pip install -r requirements.txt
fastnode launch-ui app:showcase_components --port 8051
```
Visit http://localhost:8051 in your browser to access the UI of the demo. Use `launch-api` instead of `launch-ui` to launch the HTTP API server.
## Support & Feedback
This project is maintained by [Benjamin Räthlein](https://twitter.com/nxpkg), [Lukas Masuch](https://twitter.com/khulnasoft-bot), and [Jan Kalkan](https://www.linkedin.com/in/jan-kalkan-b5390284/). Please understand that we won't be able to provide individual support via email. We also believe that help is much more valuable if it's shared publicly so that more people can benefit from it.
| Type | Channel |
| ------------------------ | ------------------------------------------------------ |
| 🚨 **Bug Reports** | 
|
| 🎁 **Feature Requests** | 
|
| 👩💻 **Usage Questions** | 
|
| 📢 **Announcements** | 
|
| ❓ **Other Requests** | 
|
## Features
HTTP API •
Graphical UI •
CLI •
Zip Export •
Docker Export •
Pre-defined Components •
Production Deployment
### HTTP API
With Fastnode, you can instantly launch a local HTTP (REST) API server for any [compatible function](#compatible-functions):
```bash
fastnode launch-api my_fastnode:hello_world
```
This will launch a [ReadyAPI](https://readyapi.tiangolo.com/) server based on the [OpenAPI standard](https://swagger.io/specification) and with an automatic interactive documentation.
_💡 Make sure that all requirements of your script are installed in the active Python enviornment._
The port used by the API server can be provided via CLI arguments:
```bash
fastnode launch-api my_fastnode:hello_world --port 8080
```
The API server can also be started via the exported zip-file format (see [zip export section](#zip-export) below).
```bash
fastnode launch-api my-fastnode.zip
```
### Graphical UI
You can launch a graphical user interface - powered by [Streamlit](https://streamlit.io/) - for your [compatible function](#compatible-functions). The UI is auto-generated from the input- and output-schema of the given function.
```bash
fastnode launch-ui my_fastnode:hello_world
```
_💡 Make sure that all requirements of your script are installed in the active Python environment._
You can influence most aspects of the UI just by changing and improving the input- and output-schema of your function. Furthermore, it is also possible to define custom UIs for the function's input and output. For more details, refer to the [input- and output-schema](#TODO) section.
The port used by the UI server can be provided via CLI arguments:
```bash
fastnode launch-ui my_fastnode:hello_world --port 8080
```
The UI server can also be started via the exported zip-file format (see [zip export section](#zip-export) below).
```bash
fastnode launch-ui my-fastnode.zip
```
In addition, the UI server can be started by using an already running Fastnode API endpoint:
```bash
fastnode launch-ui http://my-fastnode:8080
```
Thereby, all Fastnode calls from the UI will be executed via the configured HTTP endpoint instead of the Python function running inside the UI server.
### Command-line Interface
An Fastnode can also be executed via command-line:
```bash
fastnode call my_fastnode:hello_world '{"message": "hello"}'
```
The CLI interface also works using the [zip export format](#zip-export):
```bash
fastnode call my-fastnode.zip '{"message": "hello"}'
```
Or, by using an already running Fastnode API endpoint:
```bash
fastnode call http://my-fastnode:8080 '{"message": "hello"}'
```
Thereby, the function call is executed by the Fastnode API server, instead of locally using the Python function.
### Zip Export
Fastnode allows you to package and export a [compatible function](#compatible-functions) into a self-contained zip-file:
```bash
fastnode export my_fastnode:hello_world my-fastnode.zip
```
This exported zip-file packages relevant source code and data artifacts into a single file which can be shared, stored, and used for launching the API or UI as shown above.
External requirements are automatically discovered from the working directory based on the following files: `Pipfile` (Pipenv environment), `environment.yml` (Conda environment), `pyproject.toml` (Poetry dependencies), `requirements.txt` (pip-requirements), `setup.py` (Python project requirements), `packages.txt` (apt-get packages), or discovered via [pipreqs](https://github.com/bndr/pipreqs) as fallback. However, external requirements are only included as instructions and are not packaged into the zip-file. If you want to export your Fastnode fully self-contained including all requirements or even the Python interpreter itself, please refer to the [Docker](#docker-export) or [pex](#pex-export) export options.
As a side note, Fastnodes exported as zip-files are (mini) Python libraries that can be pip-installed, imported, and used from other Python code:
```bash
pip install my-fastnode.zip
```
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/3)_
### Docker Export
In addition to the ZIP export, Fastnode also provides the capability to export to a Docker image:
```bash
fastnode export my_fastnode:hello_world --format=docker my-fastnode-image:latest
```
_💡 The Docker export requires that Docker is installed on your machine._
After the successful export, the Docker image can be run as shown below:
```bash
docker run -p 8080:8080 my-fastnode-image:latest
```
Running your Fastnode within this Docker image has the advantage that only a single port is required to be exposed. The separation between UI and API is done via URL paths: `http://localhost:8080/api` (API); `http://localhost:8080/ui` (UI). The UI is automatically configured to use the API for all function calls.
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/4)._
### Pex Export
Fastnode also provides the capability to export to a pex-file. [Pex](https://github.com/pantsbuild/pex) is a tool to create self-contained executable Python environments that contain all relevant python dependencies.
```bash
fastnode export my_fastnode:hello_world --format=pex my-fastnode.pex
```
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/5)._
### Python Client
Every deployed Fastnode provides a Python client library via an endpoint method which can be installed with pip:
```bash
pip install http://my-fastnode:8080/client
```
And used in your code, as shown below:
```python
from my_fastnode import Client, Input
fastnode_client = Client("http://my-fastnode:8080")
result = fastnode_client.call(Input(text="hello", wait=1))
```
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/8)._
### Pre-defined Components
Fastnode provides a growing collection of pre-defined components (input- and output models) for common tasks. Some of these components also provide more advanced UIs and Visualizations. You can reuse these components to speed up your development and, thereby, keep your Fastnodes compatible with other functionality improvements or other Fastnodes.
You can find some of the available interfaces in the [examples](#examples) section or in this [source code package](#TODO).
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/9)._
### Production Deployment
Rolling out your Fastnodes for production usage might require additional features such as SSL, authentication, API tokens, unlimited scalability, load balancing, and monitoring. Therefore, we provide capabilities to easily deploy your Fastnodes directly on scalable and secure cloud platforms without any major overhead:
```bash
fastnode deploy my_fastnode:hello_world
```
_WIP: This feature is not finalized yet. You can track the progress and vote for the feature [here](https://github.com/khulnasoft/fastnode/issues/6)._
## Documentation
### Compatible Functions
A function is compatible with Fastnode if it fulfills the following requirements:
- A single parameter called `input` which MUST be a subclass of the [Pydantic BaseModel](https://pydantic-docs.helpmanual.io/usage/models/).
- A single return value that MUST be a subclass of the [Pydantic BaseModel](https://pydantic-docs.helpmanual.io/usage/models/).
- The `input` parameter and return value MUST be annotated with Python typing hints.
### Input- and Output-Schema
_WIP_
### Command-line Interface
_WIP_
## Contribution
- Pull requests are encouraged and always welcome. Read our [contribution guidelines](https://github.com/khulnasoft/fastnode/tree/main/CONTRIBUTING.md) and check out [help-wanted](https://github.com/khulnasoft/fastnode/issues?utf8=%E2%9C%93&q=is%3Aopen+is%3Aissue+label%3A"help+wanted"+sort%3Areactions-%2B1-desc+) issues.
- Submit Github issues for any [feature request and enhancement](https://github.com/khulnasoft/fastnode/issues/new?assignees=&labels=feature&template=02_feature-request.md&title=), [bugs](https://github.com/khulnasoft/fastnode/issues/new?assignees=&labels=bug&template=01_bug-report.md&title=), or [documentation](https://github.com/khulnasoft/fastnode/issues/new?assignees=&labels=documentation&template=03_documentation.md&title=) problems.
- By participating in this project, you agree to abide by its [Code of Conduct](https://github.com/khulnasoft/fastnode/blob/main/.github/CODE_OF_CONDUCT.md).
- The [development section](#development) below contains information on how to build and test the project after you have implemented some changes.
## Development
Refer to our [contribution guides](https://github.com/khulnasoft/fastnode/blob/main/CONTRIBUTING.md#development-instructions) for information on our build scripts and development process.
---
Licensed **MIT**. Created and maintained with ❤️ by developers from KhulnaSoft.