Computer Vision Control of Drone With Android Device

Hi everyone, just want to showcase a mini project that a few friends and I been working on. This project uses the camera from an Android device to locate a fiducial marker on a UAV and move the drone according to where the camera points. You can see it here:

By pointing the camera we could control all six degrees of freedom. The radius away from the camera was defined as whatever the radius is at take-off.

We used a standard DJI Naza as the flight controller, but we used an NVdrones Keplur Development Board to communicate between the Android device and the Naza. The Keplur board is still in its infancy but I would highly recommending using it for those of you who want to work on custom projects like this. Even though it acts more of a “smart” receiver since it’s not its own flight controller, in comparison with other “open” drone controllers (Ardupilot, multiWii, etc), it’s by far the easiest to get started and understand what’s going on.

Hi,

Very impressive demo! We look forward to more developments on this project and others! Do you expect to release any code examples (open source format or something else) for this project?

Keep up the good work!

Sincerely,