{"id":24744348,"url":"https://github.com/joaobraganca555/extractionanalysistool","last_synced_at":"2026-03-06T13:03:50.867Z","repository":{"id":264477062,"uuid":"872702354","full_name":"joaobraganca555/ExtractionAnalysisTool","owner":"joaobraganca555","description":"Cloud-based tool for multimedia data extraction and analysis, focusing on influencer content. Utilizes YOLOv8 for object/logo detection, Whisper.AI for speech recognition, and EasyOCR for OCR. Includes sentiment analysis with a scalable microservice architecture for content monitoring.","archived":false,"fork":false,"pushed_at":"2025-03-10T20:53:44.000Z","size":4884,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-08T19:13:14.866Z","etag":null,"topics":["aws-s3","content-monitor","docker","easyocr","fastapi","image-classification","logo-detection","microservices","multimedia-data-analysis","object-detection","ocr","python","rabbitmq","sentiment-analysis","speech-recognition","streamlit","whisper","yolov8"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/joaobraganca555.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-14T23:19:07.000Z","updated_at":"2025-03-25T18:52:26.000Z","dependencies_parsed_at":null,"dependency_job_id":"9614361c-3c77-4f34-b50d-9387e31117ac","html_url":"https://github.com/joaobraganca555/ExtractionAnalysisTool","commit_stats":null,"previous_names":["joaobraganca555/extractionanalysistool"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/joaobraganca555/ExtractionAnalysisTool","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joaobraganca555%2FExtractionAnalysisTool","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joaobraganca555%2FExtractionAnalysisTool/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joaobraganca555%2FExtractionAnalysisTool/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joaobraganca555%2FExtractionAnalysisTool/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/joaobraganca555","download_url":"https://codeload.github.com/joaobraganca555/ExtractionAnalysisTool/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/joaobraganca555%2FExtractionAnalysisTool/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266120241,"owners_count":23879282,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws-s3","content-monitor","docker","easyocr","fastapi","image-classification","logo-detection","microservices","multimedia-data-analysis","object-detection","ocr","python","rabbitmq","sentiment-analysis","speech-recognition","streamlit","whisper","yolov8"],"created_at":"2025-01-28T02:18:02.708Z","updated_at":"2026-03-06T13:03:50.833Z","avatar_url":"https://github.com/joaobraganca555.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ExtractionAnalysisTool\n\nCloud-based tool for multimedia data extraction and analysis, focusing on influencer content. Utilizes YOLOv8 for object/logo detection, Whisper.AI for speech recognition, and EasyOCR for OCR. Includes sentiment analysis with a scalable microservice architecture for content monitoring.\n\n## System Architecture \u0026 Services Description\n\n![systemArchitecture](/docs/architecture.png)\n\n| **Service**                | **Functionality**                                  | **Task**                                                   |\n|----------------------------|---------------------------------------------------|------------------------------------------------------------|\n| yolo-service                | Object Detection                                  | Detect objects in images and video frames                  |\n| yolo-cls-service            | Image Classification                              | Classify images into categories                            |\n| yolo-logo-service           | Logo Detection                                    | Detect specific logos in media                             |\n| whisper-service             | Speech Recognition                                | Convert audio to text                                      |\n| ocr-service                 | Optical Character Recognition                     | Extract text from images and video frames                  |\n| sentiment-service           | Sentiment Analysis                                | Analyse the sentiment of extracted text                    |\n| upload-service              | Upload Files                                      | API for uploading files and trigger coordinator            |\n| coordinator-service         | Manage services                                   | Controls and manage services                               |\n| result-service              | Stores Data                                       | API for storing service results                            |\n\n## Application Video\n\nWatch the demo of the application in action: [Video Link](https://github.com/user-attachments/assets/c564dffb-e532-435d-ac4a-fcef40f3129f)\n\n## How to Run the Application\n\nTo run the **ExtractionAnalysisTool** locally, follow these steps:\n\n### Prerequisites\n- Ensure you have **Docker** and **Docker Compose** installed on your machine.\n- You will need an **AWS S3 Bucket**. Update the `.env.example` file with your S3 credentials before proceeding.\n\n### Steps to Run:\n\n1. **Clone the repository**:\n\n   ```bash\n   git clone https://github.com/joaobraganca555/ExtractionAnalysisTool.git\n   cd ExtractionAnalysisTool\n   \n2. **Prepare the .env file**:\n   - Rename .env.example to .env:\n     ```bash\n     mv .env.example .env  \n\n   - Add your AWS S3 Bucket credentials and any other necessary configurations to the .env file.\n3. **Build the Docker containers**:\n   ```bash\n   docker-compose build\n4. **Start the services**:\n   ```bash\n   docker-compose up\n5. Once the containers are up, the tool will be running, and you can start interacting with it. Use the ports provided the docker compose file.\n\n## Publications  \n\nThis tool is based on prior research work published in the following articles:  \n\n| **Title** | **Conference** | **Publisher** | **Date** | **Pages** | **Link** |\n|-----------|--------------|--------------|----------|----------|----------|\n| Unveiling the Secrets: In-Depth Analysis of YouTube Video Data and Metadata Extraction | ISAmI 2024 – 15th International Symposium on Ambient Intelligence | Springer Nature | 27 Feb 2025 | pp. 14–24 | [Springer Link](https://link.springer.com/chapter/10.1007/978-3-031-83117-1_2) |\n| Unveiling the Secrets: In-Depth Analysis of YouTube Video Data and Metadata Extraction | ISAmI 2024 – 15th International Symposium on Ambient Intelligence | Springer Nature | 27 Feb 2025 | pp. 287–296 | [Springer Link](https://link.springer.com/chapter/10.1007/978-3-031-83117-1_27) |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjoaobraganca555%2Fextractionanalysistool","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjoaobraganca555%2Fextractionanalysistool","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjoaobraganca555%2Fextractionanalysistool/lists"}