An open API service indexing awesome lists of open source software.

https://github.com/cloud-py-api/visionatrix

Scalable AI Provider for Nextcloud
https://github.com/cloud-py-api/visionatrix

diffusers image-processing nextcloud recognize sound-processing video-processing

Last synced: 3 months ago
JSON representation

Scalable AI Provider for Nextcloud

Awesome Lists containing this project

README

        

# Nextcloud Visionatrix Integration

Introducing scalable AI media processing for Nextcloud.


Visionatrix UI


Visionatrix UI

This is a standalone [Visionatrix](https://github.com/Visionatrix/Visionatrix) service, allowing you to process media files directly within your Nextcloud.

Each user is authenticated via Nextcloud credentials and has a personal task history.

> [!NOTE]
> We recommend starting with the "light-weight" flows, such as SDXL Lighting, Remove background (BiRefNet), and Remove background (Bria), to test your hardware.

## TextToImage Provider

You can use Visionatrix as the TextToImage provider via [Nextcloud Assistant](https://github.com/nextcloud/assistant).

Once the Visionatrix flow is installed and supported, it will be registered as a TextToImage provider.

> [!NOTE]
> Not all Visionatrix flows are available in Nextcloud Assistant. See the list [here](https://github.com/cloud-py-api/visionatrix/blob/main/ex_app/lib/supported_flows.py)


Visionatrix in Assistant UI


Visionatrix in Assistant UI

## Installation

> [!NOTE]
> The `AppAPI` application needs to be enabled to install and use this application.

### Installation

1. Configure [AppAPI](https://github.com/nextcloud/app_api).
2. Once AppAPI is set up and the deployment daemon is configured, install the Nextcloud Visionatrix.
3. Enjoy Nextcloud Visionatrix from the Top Menu.

We offer two types of installation:

1. **Standard Installation**: Includes both the Visionatrix server for task management and a built-in worker for task processing.

> For this installation, you'll need either a powerful CPU with at least 32 GB of RAM or a GPU with at least 8 GB of VRAM.
> _(Some flows, like background removal, are fast even on CPU and don’t require high-end hardware.)_

2. **Advanced Installation**: Starting from Nextcloud version `31`, you can install only the server component by setting `DISABLE_WORKER=1` in the environment variables during application installation. In this mode, the server will manage tasks, while external workers (installed elsewhere) will process them.

> [!NOTE]
> Worker authentication uses Nextcloud credentials. If 2FA is enabled, you will need to use an App Password to connect external workers.

For more information, please refer to the original [Visionatrix documentation](https://visionatrix.github.io/VixFlowsDocs/).

## Questions

Feel free to ask questions or report issues.

#### We are looking for maintainers for this ExApp (we will provide help)