AI Software for Drones — Python+Electron+Javascript

Drone AI
5 min readJul 7, 2021

--

Screen Grab From AI Drone Software — https://www.aidronesoftware.com

Ask any drone enthusiast & the pilot will describe the thrill in flying a drone is an amazing feeling. They are the future and easy to build. Almost all drones follow similar architecture, flight controls & fly on basic laws of physics.

I bought my first drone in mid-pandemic & started playing around with it’s firmware, architecture & the protocols. It was a Tello drone by Dji and it came with an iOS application. It’s an amazing programable drone, quite durable & cheap for first timers.

Hardware Limitations & iOS Walled Garden Approach

Being a $100 drone the hardware on the drone itself does an amazing job in controlling propeller speeds, VPS & stream a 720p video feed from the drone. You can send commands from your iOS application to the drone and it works fine. Where I saw an opportunity was to add autonomy to it, add Object Detection, Face Tracking, Human Pose Detection & tons of other AI features.

Tello Drone

To run highly computational python libraries like OpenCV, pretty powerful hardware is required. You can’t do computations on Tello drone itself & iOS has locked developers out from running computational intensive equations. That leaves with one option, the computer machine.

Introducing Drone AI Software

So i designed my own AI Software to fly the drone. It works on both Windows 10 and macOS Big Sur. After extensive testing, i have packed the software with best Computer vision algorithms, Cinematography features, Flight planner, Voice control. You can fly the drone from UI, Keyboard or your Xbox, Playstation or Logitech controllers.

Flying Tello Near Hudson River New York Using Drone AI

Drone AI Features

AI Object Detection — During flight the drone can recognise objects in it’s view. To activate object detection click on the bulb icon

AI Human Pose Detection Drone software have the ability to detect human poses. It can recognise moving human beings & map out their behaviors & activity. To activate object detection click on the accessibility icon

AI Face Tracking The drone will automatically follow the closest face in it’s proximity. The next upgrade in development pipeline is to allow user to track a selected object in UI. The face tracking tech makes use of PID (Proportional-Integral-Derivative). To activate the feature click on surprise face icon

Speech Control — This is my personal favorite feature & allows me to control the drone using speech. It makes use of Pocketsphinx Python library to take inputs from user microphone and send them to drone. To activate click on microphone icon. The voice commands are as following -

move left: drone travels left

move right: drone travels right

move back: drone travels backward

move front: drone travels forward

move up: drone travels up

move down: drone travels down

rotate clock: drone move clock-wise

rotate anticlock: drone move anti-clock-wise

Drone Control

Though speech control is awesome, but to have granular control over the drone movement you need something more precise.

Remote Control — Your xbox & play station controllers are compatible with our software. You don’t need to buy new controllers compatible with just iOS or android.

Mapping for controls

Keyboard — If you are a PC gamer, you will enjoy the keyboard control

E Key: Take Off

Q Key: Land

Up Arrow Key: Move Forward

Down Arrow Key: Move Back

Left Arrow Key: Move Left

Right Arrow Key: Move Right

W Key: Move Up

S Key: Move Down

A Key: Rotate Left

R Key: Rotate Right

AI & Cinematography features can be activated from UI while using Keyboard

Speed can be changed in UI

User Interface — The appliation UI allows you to click on button icons & control drone too

Drone Control from UI

Drone Cinematography Features

All Cinematography recordings, snaps & images are stored in

  1. “Pictures/Vid_Recordings” on macOS
  2. “C:/Users/USERNAME/Pictures” on Windows

Record Video Feed — Click on the video button to start recordings. The recording will continue until it’s switched off by clicking on button again.

Capture Image The images can be captured by clicking on camera button

Burst Mode — Takes around 5 images at a time

Panorama Drone performs a 360 rotation to click a panorama

Timer — You can time the photos, the deafult time is set at 5 sec

Drone Flight Planner

Users have the ability to plan a drone flight, control the speed, direction & time of flight. Plan the flight & execute the plan. If the drone is not flying according to plan, you can take control immediately from controller or keyboard.

Pricing & Free Software

Software Pricing — https://www.aidronesoftware.com/sales

There are two subscription models -

  1. Drone AI Basic — The experience is limited to drone flying only. It’s a one time fee
  2. Drone AI Pro — With Pro subscription you unlock all the features, support & software updates with addition to new features.

Currently the software is only compatible with Tello Drones.We are working to add compatibility with other popular drones.

Free Software — We are giving away our Pro software to first 300 customers. To claim the software please click here. You will be asked to create an account before you can download the software.

For Students If you are a school teacher or a student please contact us or email us support@aidronesoftware.com for discounted pricing.

Developer & Contributions

We are always looking for better ideas & contributors. If you believe your idea can add certain value to the software please contact us or email us at support@aidronesoftware.com

Summary

Our software will add same capabilities to your $100 drone that a $2000 Dji Mavic or $1500 Skydio drone costs. An expensive drone you are paying for is the cost of the hardware that will perform powerful calculations on it and you risk loosing a flying NVDA or Intel chip. However if the computational hardware is on ground & all your drone has to do is execute commands on a cheaper flight-controller it makes far more sense economically. You can invest on a better GPS, drone range & flight computer.

Let me know your thoughts in comments.

Links :

--

--