https://github.com/jhj0517/sam2-playground
Playground Web UI using segment-anything-2 models from the Meta.
https://github.com/jhj0517/sam2-playground
ai gradio open-source sam sam2 segment-anything segment-anything-2 segmentation torch webui
Last synced: 4 months ago
JSON representation
Playground Web UI using segment-anything-2 models from the Meta.
- Host: GitHub
- URL: https://github.com/jhj0517/sam2-playground
- Owner: jhj0517
- License: apache-2.0
- Created: 2024-08-05T12:19:58.000Z (12 months ago)
- Default Branch: master
- Last Pushed: 2024-12-04T09:22:55.000Z (7 months ago)
- Last Synced: 2025-03-09T21:09:35.414Z (4 months ago)
- Topics: ai, gradio, open-source, sam, sam2, segment-anything, segment-anything-2, segmentation, torch, webui
- Language: Python
- Homepage:
- Size: 12.8 MB
- Stars: 45
- Watchers: 2
- Forks: 2
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
README
# sam2-playground
Gradio based playground web UI using [facebook/segment-anything-2](https://github.com/facebookresearch/segment-anything-2) models.
### Online Demos
[](https://colab.research.google.com/github/jhj0517/sam2-playground/blob/master/notebooks/sam2_playground.ipynb)
[](https://huggingface.co/spaces/jhj0517/sam2-playground)
## Feature
- Segment video for transparent background or pixelated object
Transparent background
Pixelate
- Segment image to divide objects into layers and save them as PSD files.
Divide clothes into layers and save as PSD file
See [PROMPT_GUIDE.md](https://github.com/jhj0517/sam2-playground/blob/master/docs/PROMPT_GUIDE.md) to see how to prompt the segmentation parts of the image.
# Installation and Running
### Prerequisites
To run this Web UI, you need these prerequisites. If you don't have them, please install them in the following links :
- `git` : https://git-scm.com/downloads
- `python=>3.10` : https://www.python.org/downloads/
- `FFmpeg` : https://ffmpeg.org/download.html
After installing FFmpeg, **make sure to add the `FFmpeg/bin` folder to your system PATH!**
And for CUDA, if you're not using an Nvidia GPU and CUDA 12.4, edit the [requirements.txt](https://github.com/jhj0517/sam2-playground/blob/master/requirements.txt) to match your environment.
### Option 1 : Running with Shell / Batch Scripts
There's a set of shell / batch scripts for installation and running.
1. Download [`sam2-playground-portable.zip`](https://github.com/jhj0517/sam2-playground/releases/tag/v1.0.0) with the file corresponding to your OS and extract its contents.
2. Run `install.bat` or `install.sh` to install dependencies. (It will create a `venv` directory and install dependencies there.)
3. Start WebUI with `start-webui.bat` or `start-webui.sh` (It will run `python app.py` after activating the `venv`)
4. To update, run `update.bat` or `update.sh` (It will run `git pull origin master`)
### Option 2: Docker
1. Clone the repository
```
git clone https://github.com/jhj0517/sam2-playground.git
```
3. Build the image ( Image is about ~6 GB )
```
docker compose build
```
3. Run the container
```
docker compose up
```
4. Connect to `localhost:7860` with your browser.
If needed, update [`docker-compose.yaml`](https://github.com/jhj0517/sam2-playground/blob/master/docker-compose.yaml) to match your environments.
## Todo 🗓
- [ ] Support `change()` API for `gradio_image_prompter` and automatically generate preview for video predictor