{"id":27471116,"url":"https://github.com/swish78/emotion-detection","last_synced_at":"2025-04-16T01:39:21.019Z","repository":{"id":250751180,"uuid":"835371135","full_name":"Swish78/emotion-detection","owner":"Swish78","description":null,"archived":false,"fork":false,"pushed_at":"2024-07-29T17:46:38.000Z","size":362,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-07-30T23:51:07.883Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Swish78.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-29T17:39:01.000Z","updated_at":"2024-07-29T17:46:41.000Z","dependencies_parsed_at":"2024-07-29T23:27:41.751Z","dependency_job_id":"34e84ff0-bdec-4ba6-80c5-62e1ccb3a6a6","html_url":"https://github.com/Swish78/emotion-detection","commit_stats":null,"previous_names":["swish78/real-time-emotion-detection-with-websockets"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Swish78%2Femotion-detection","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Swish78%2Femotion-detection/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Swish78%2Femotion-detection/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Swish78%2Femotion-detection/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Swish78","download_url":"https://codeload.github.com/Swish78/emotion-detection/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":249182790,"owners_count":21226123,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-04-16T01:39:20.548Z","updated_at":"2025-04-16T01:39:21.010Z","avatar_url":"https://github.com/Swish78.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Real-Time Emotion Detection with WebSockets\n\n## Overview\n\nThis project is designed to demonstrate real-time emotion detection using WebSockets. The backend is powered by FastAPI, and the frontend is built with React. Emotion detection is handled by the DeepFace library. Future enhancements include integrating the LLaVA model for image description and a fine-tuned VGG model on AffectNet.\n\n## Features\n\n- **Real-Time Emotion Detection**: Utilizes WebSockets to stream video frames from the client to the server and detect emotions in real-time.\n- **WebSocket Communication**: Establishes a persistent connection between the client and server for real-time data transfer.\n- **DeepFace Integration**: Detects emotions using the DeepFace library.\n\n## Plans\n\n-  **VGG Model Integration**: Incorporate a fine-tuned VGG model on AffectNet for improved emotion classification.\n- **LLaVA Integration**: Integrate the LLaVA model for detailed image descriptions.\n\n## Technologies Used\n\n- **Frontend**: React\n- **Backend**: FastAPI\n- **WebSocket**: Real-time data transfer\n- **Emotion detection**: Deepface, VGG(Fine-Tuned)\n- **Python Libraries**: OpenCV, PIL, Base64\n\n## Installation\n\n### Backend\n\n1. Clone the repository:\n   ```bash\n   git clone https://github.com/yourusername/emotion-detection.git\n   cd emotion-detection\n   ```\n\n2. Create a virtual environment and activate it:\n   ```bash\n   python -m venv venv\n   source venv/bin/activate  \n   ```\n\n3. Install the required dependencies:\n   ```bash\n   pip install -r requirements.txt\n   ```\n\n4. Run the FastAPI server:\n   ```bash\n   uvicorn main:app --reload\n   ```\n\n### Frontend\n\n1. Navigate to the frontend directory:\n   ```bash\n   cd frontend\n   ```\n\n2. Install the required dependencies:\n   ```bash\n   npm install\n   ```\n\n3. Start the React development server:\n   ```bash\n   npm start\n   ```\n\n## Usage\n\n1. Open your browser and navigate to `http://localhost:5174/` to access the React frontend.\n2. The application will access your webcam and start streaming video frames to the server.\n3. The server will process these frames and send back the detected emotions.\n\n## Error Handling\n\nIf you encounter issues with WebSocket connections:\n\n- **Ensure that both the backend and frontend servers are running.**\n- **Check your network settings and firewall rules.**\n\n\n## License\n\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fswish78%2Femotion-detection","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fswish78%2Femotion-detection","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fswish78%2Femotion-detection/lists"}