https://github.com/sdsc-ordes/ordfts-hackathon-vehicles-detection

This is an example of a hackathon project making use of the pNeuma vision dataset
https://github.com/sdsc-ordes/ordfts-hackathon-vehicles-detection

Last synced: about 15 hours ago
JSON representation

This is an example of a hackathon project making use of the pNeuma vision dataset

• Host: GitHub
• URL: https://github.com/sdsc-ordes/ordfts-hackathon-vehicles-detection
• Owner: sdsc-ordes
• License: bsd-3-clause
• Created: 2024-07-08T10:21:08.000Z (4 months ago)
• Default Branch: main
• Last Pushed: 2024-09-09T05:25:38.000Z (about 2 months ago)
• Last Synced: 2024-09-09T06:41:09.211Z (about 2 months ago)
• Language: Jupyter Notebook
• Size: 1.49 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Citation: citation.cff

Awesome Lists containing this project

README

        
# ORD for the Sciences Hackathon - Vehicles Detection

[![launch - renku](https://renkulab.io/renku-badge.svg)](https://renkulab.io/v2/projects/hackathon-team-1/pneuma-vehicles-detection) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/sdsc-ordes/ordfts-hackathon-vehicles-detection/blob/main/002_vehicles_detection.ipynb)

 [![GitHub](https://badgen.net/badge/icon/github?icon=github&label)](https://github.com/sdsc-ordes/ordfts-hackathon-vehicles-detection) [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.12751861.svg)](https://doi.org/10.5281/zenodo.12751861) [![Dataset on HF](https://huggingface.co/datasets/huggingface/badges/resolve/main/dataset-on-hf-md.svg)](https://huggingface.co/datasets/katospiegel/ordfts-hackathon-pneuma-vehicles-segmentation)

> [!CAUTION]

> This project is an example of a hackathon project. The quality of the data produced has not been evaluated. Its goal is to provide an example on how a dataset can be update to Hugginface. 

This is an example of a hackathon project presented to `ORD for the sciences hackathon` using the openly available [pNeuma vision dataset](https://zenodo.org/records/7426506). 

- [Go here if you wanna know more about the hackathon](https://sdsc-hackathons.ch/)

- [EPFL pNeuma project](https://open-traffic.epfl.ch)

## Description

The goal of this project is to create a training dataset derived from the publicly available pNeuma Vision dataset, which contains drone footage and coordinates of vehicles. By leveraging machine learning techniques, specifically the "Segment Anything" model by Meta, we will accurately segment and mask the pixels corresponding to each vehicle within the footage. The resulting dataset, stored in the efficient Parquet format, will be shared on Hugging Face as a new, open-access resource for the research community. Additionally, we will document our methodology in a detailed Jupyter notebook, which will be hosted in a public GitHub repository. Our work will be registered as a derived contribution in the pNeuma RDI Hub prototype, ensuring proper attribution and fostering further research and development.

![alt text](assets/summary.png)

Datasets created:

- [pneuma-vision-parquet](https://huggingface.co/datasets/katospiegel/pneuma-vision-parquet)

- [ordfts-hackathon-pneuma-vehicles-segmentation](https://huggingface.co/datasets/katospiegel/ordfts-hackathon-pneuma-vehicles-segmentation) (doi:10.57967/hf/3028)

## How is structured this repository?

- 001_parquet_converter.ipynb: 

    - In this notebook we downloaded part of the original dataset pNeuma Vision, converted into parquet and then uploaded in Huggingface

- 002_vehicles_detection.ipynb

    - Here we take the coordinates of each vehicles tagged, we cropped an region of interest around it, and use Segment Anything by Meta in order to segment the vehicle.

## How to run this project in docker? 

```

docker build -t vehicles-detection . 

```

And then run with:

```

docker run -it --rm --gpus all --env-file .env odtp-whisperx

```

## Developed by: 

Developed by Carlos Vivar Rios (SDSC), as an example for the ORD for the sciences Hackathon.