{"id":39385638,"url":"https://github.com/apssouza22/smart-drone","last_synced_at":"2026-01-18T03:03:00.586Z","repository":{"id":42016470,"uuid":"363398483","full_name":"apssouza22/smart-drone","owner":"apssouza22","description":"This project leverage Machine learning/Computer vision to make a low-cost Drone smarter and autonomous.","archived":false,"fork":false,"pushed_at":"2024-04-26T13:15:49.000Z","size":4223,"stargazers_count":24,"open_issues_count":3,"forks_count":9,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-05-21T07:44:55.774Z","etag":null,"topics":["computer-vision","deep-learning","opencv","python","robotics"],"latest_commit_sha":null,"homepage":"","language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/apssouza22.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null},"funding":{"patreon":"apssouza","custom":["https://www.buymeacoffee.com/apssouza"]}},"created_at":"2021-05-01T11:55:45.000Z","updated_at":"2024-04-26T13:15:53.000Z","dependencies_parsed_at":"2023-02-18T07:30:43.730Z","dependency_job_id":null,"html_url":"https://github.com/apssouza22/smart-drone","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/apssouza22/smart-drone","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apssouza22%2Fsmart-drone","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apssouza22%2Fsmart-drone/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apssouza22%2Fsmart-drone/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apssouza22%2Fsmart-drone/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/apssouza22","download_url":"https://codeload.github.com/apssouza22/smart-drone/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apssouza22%2Fsmart-drone/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28528026,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-18T00:39:45.795Z","status":"online","status_checked_at":"2026-01-18T02:00:07.578Z","response_time":98,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["computer-vision","deep-learning","opencv","python","robotics"],"created_at":"2026-01-18T03:03:00.481Z","updated_at":"2026-01-18T03:03:00.557Z","avatar_url":"https://github.com/apssouza22.png","language":"JavaScript","funding_links":["https://patreon.com/apssouza","https://www.buymeacoffee.com/apssouza"],"categories":[],"sub_categories":[],"readme":"# Smart drone\n\nOur project aims to redefine the utility of low-cost drones by infusing them with cutting-edge Machine Learning, Computer Vision, and Robotics technologies. We are focused on developing a multifunctional drone system capable of complex autonomous tasks, interactive controls, and real-time data processing, all packaged within an economically feasible model. ([Tello](https://m.dji.com/ie/shop/tello-series)).\n\n\n\u003cimg src=\"assets/demo.jpg\"/\u003e\n\n[Check out the video](https://youtu.be/a5ddyfV1hxk)\n\n\n## Features  \n\n- Advanced Navigation and Tracking:\n  - Autonomous Navigation and Path Planning: Implement sophisticated pathfinding algorithms to navigate challenging environments autonomously.\n  - People Tracking and Searching: Utilize computer vision to identify and follow individuals in various settings, enhancing capabilities in security and rescue operations.\n- Interactive Control Methods:\n  - Gesture-Based Control: Control drone movements and functions through intuitive hand gestures.\n  - Keyboard and Joystick Control: Operate the drone using a keyboard or HTML5 and iOS-compatible joysticks for precision and flexibility.\n  - Remote Control via WebSocket: Manage drone operations remotely with real-time responsiveness.\n- Enhanced Communication and Feedback:\n  - Sound Feedback: Use audio cues for interactive feedback and status updates from the drone.\n  - Morse Commands via Camera: Send commands to the drone using Morse code, interpreted through visual inputs from the camera.\n- Real-Time Data and Video Management:\n  - Video Streaming with WebRTC: Stream live video footage directly through WebRTC, enabling real-time visual feedback for monitoring and decision-making.\n  - Drone Path Monitoring: Track and record the drone’s flight path to analyze flight patterns and optimize routes.\n- Cost-Effective and User-Friendly Design:\n  - Focus on integrating cost-effective hardware and open-source software to keep the drone affordable and accessible.\n  - Develop an intuitive interface that allows users to easily manage drone settings, monitor flight paths, and analyze data.\n\n\n## Install dependencies\nWe provide the requirements.txt file with the required Python dependencies but OpenCV and FFMPEG\nis tricky to install, and you should check on the internet how to install those properly\n\n```pip install -r requirements.txt```\n\n## How to run \nYou don't need to have a drone to play with the project, the project come with a \nsimulated option which will use your comera and you will be able to see the drone moving on the path monitoring window.\n\nIf you have the Tello drone, you will need to turn off the mock on the `main` function call.\n\n***The path window has to be focused in order to use the keyboard control***\n\n### If this project helped you, consider leaving a star  and by me a coffee\n\u003ca href=\"https://www.buymeacoffee.com/apssouza\"\u003e\u003cimg src=\"https://miro.medium.com/max/654/1*rQv8JgstmK0juxP-Kb4IGg.jpeg\"\u003e\u003c/a\u003e\n\n\n## Libraries and packages\n\n- [OpenCV](https://opencv.org/) - used to process the images \n- [Pygame](https://www.pygame.org/news) - used to show the path monitoring, path planning and keyboard event \n- [MediaPipe](https://mediapipe.dev/) - used to detect the people body\n- [simple-pid](https://github.com/m-lundberg/simple-pid) - used to help with PID controller when moving the drone\n- [aiortc](https://github.com/aiortc/aiortc) - used for the Web Real-Time Communication (WebRTC)\n- [ffmpeg](http://ffmpeg.org/) - used for video streaming \n- [aiohttp](https://docs.aiohttp.org/en/stable/) - used for the async http server\n\nThe gesture module was highly inspired by [Tello-openpose](https://github.com/geaxgx/tello-openpose)\n \n-----\n\n## Free Advanced Java Course\nI am the author of the [Advanced Java for adults course](https://www.udemy.com/course/advanced-java-for-adults/?referralCode=8014CCF0A5A931ADED5F). This course contains advanced and not conventional lessons. In this course, you will learn to think differently from those who have a limited view of software development. I will provoke you to reflect on decisions that you take in your day to day job, which might not be the best ones. This course is for middle to senior developers and we will not teach Java language features but how to lead complex Java projects. \n\nThis course's lectures are based on a Trading system, an opensource project hosted on my [Github](https://github.com/apssouza22/trading-system).\n\n-----\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapssouza22%2Fsmart-drone","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fapssouza22%2Fsmart-drone","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fapssouza22%2Fsmart-drone/lists"}