3D CV BASED DRONE CONTROLLER

The Project

This project is a computer vision–based 3D drone controller that allows users to control a drone using only hand movements, without any physical controller. The idea was inspired by the growing need for more natural and intuitive human–machine interaction, as well as my interest in drones and computer vision. The system uses a camera to track real-time hand gestures and translates them into drone movements such as takeoff, landing, directional motion, and rotation in 3D space. The goal was to create a hands-free, immersive control system that feels futuristic yet practical, especially for beginners who may find traditional controllers difficult to use. To make the interaction smooth and responsive, I implemented real-time pose detection and mapped specific gestures to control commands. One of the major challenges was ensuring accuracy and low latency in gesture recognition, as even small delays can affect drone stability. Additionally, designing a reliable mapping between human movements and precise 3D drone navigation required careful tuning and testing. This project highlights the potential of combining computer vision and real-time systems to build intuitive control interfaces for robotics and autonomous devices.

View this project on YouTube