Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/jocelynvelarde/hack-harvard-2024
Use of computer vision to detect shoplifting activity and report it into a smart dashboard
https://github.com/jocelynvelarde/hack-harvard-2024
computer-vision machine-learning opencv python streamlit twilio yolov8
Last synced: 29 days ago
JSON representation
Use of computer vision to detect shoplifting activity and report it into a smart dashboard
- Host: GitHub
- URL: https://github.com/jocelynvelarde/hack-harvard-2024
- Owner: JocelynVelarde
- License: mit
- Created: 2024-10-12T01:12:25.000Z (about 1 month ago)
- Default Branch: main
- Last Pushed: 2024-10-16T23:36:15.000Z (about 1 month ago)
- Last Synced: 2024-10-18T23:55:55.201Z (30 days ago)
- Topics: computer-vision, machine-learning, opencv, python, streamlit, twilio, yolov8
- Language: Python
- Homepage: https://theft-watch-4j.streamlit.app/
- Size: 23.7 MB
- Stars: 2
- Watchers: 2
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# TheftWatch
## What is TheftWatch?
Shoplifting is not fun. As one of our group members has worked in retail before, it's a terrible experience for the victim. We want to give shop owners the control and the assurance that their business is secure by giving insights into shop lifting and dangerous customers, resulting in an increase in shop owner wellbeing and letting shop owners know what to watch out for.
## How does it work?
We will leverage Computer vision and classification machine learning to scan the several customers that enter a user's store, classifying customers into safe, suspicious, and dangerous based on their movements inside the store. Once they are detected to be dangerous, three things happen. We will send a Whatsapp notification to the shop owner, notifyig them of the unusual behvaior in their store. We will also run object recognition and facial recognition to determine what was stolen and who did. After all of these are finished, we display to the user a report providing further details about the situation. We also have several other features as part of our intricate dashboard, including a heatmap of the "hot zones" where shoplifting is most common.
## Our features
- ✅ Upload security footage videos to analyze and provide insigths to store owners
- ✅ Stablish LLM conversations with the security footage to learn more about the shoplift
- ✅ 2D mapping and heatmap of the store to view dangerous zones
- ✅ Facial recognition and timestamp snapshot when dangerous activty is being detected
- ✅ Live dashboard to view data fetched from security cameras
- ✅ Created and trained our own ML model from open data to improve detection: dangerous, suspicious, safe
## Demo
https://youtu.be/4fMGMDdnbxg
## Installation
To install all of the dependencies, you'll need to first make a virtual environment like so :
```bash
py -m venv .venv
```
Next, you'll want to activate the venv like so:
```bash
.venv/Scripts/activate
```
Now navigate to the `backend` directory.
Then, you'll want to install all backend dependencies:
```bash
pip install -r requirements.txt
```
Also, please note that this is a project built on top of Streamlit, and so you'll need a `.streamlit` folder with a `secrets.toml` file with all of your streamlit api keys.
## Contributors
