https://github.com/aveek-saha/viraliq
Code implementation & CLI tool for the paper: "Graph Based Temporal Aggregation for Video Retrieval"
https://github.com/aveek-saha/viraliq
graphsage msr-vtt resnet temporal-cluster video video-embedding video-retrieval
Last synced: 8 months ago
JSON representation
Code implementation & CLI tool for the paper: "Graph Based Temporal Aggregation for Video Retrieval"
- Host: GitHub
- URL: https://github.com/aveek-saha/viraliq
- Owner: Aveek-Saha
- License: mit
- Created: 2020-03-19T02:59:03.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2021-09-18T03:11:25.000Z (over 4 years ago)
- Last Synced: 2025-03-16T07:46:04.570Z (over 1 year ago)
- Topics: graphsage, msr-vtt, resnet, temporal-cluster, video, video-embedding, video-retrieval
- Language: Python
- Homepage: https://arxiv.org/abs/2011.02426v1
- Size: 1010 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Graph Based Temporal Aggregation for Video Retrieval
[](https://github.com/Aveek-Saha/VIRALIQ/actions/workflows/python-publish.yml)
[](https://paperswithcode.com/sota/video-retrieval-on-msr-vtt?p=graph-based-temporal-aggregation-for-video)
**VIRALIQ**: ***VI***deo ***R***etriev***AL*** through ***I***mage ***Q***ueries
If you're looking for just the source code, it can be found on the [`source branch`](https://github.com/Aveek-Saha/VIRALIQ/tree/source).
## Dependencies
### FFmpeg
FFmpeg is required for extracting frames from videos. Download links can be found [here](https://ffmpeg.org/download.html).
**Note:** Windows users will have to add the FFmpeg bin folder to the PATH variable.
## Installation
Install the package using pip
```
pip install viraliq
```
## CLI usage
### Create embeddings
Create video embeddings
```
viraliq cluster "PATH_TO_VIDEO_DIR"
```
### Search
Search using an image query
```
viraliq search "PATH_TO_VIDEO_DIR" "PATH_TO_IMAGE"
```
## Citing
If you find VIRALIQ useful please cite the following paper:
```
Srinivasan, Arvind, Aprameya Bharadwaj, Aveek Saha, and Subramanyam Natarajan. "Graph Based Temporal Aggregation for Video Retrieval." arXiv preprint arXiv:2011.02426 (2020).
```