Skydio Autonomy™. A new age of drone intelligence

by | Feb 28, 2021

Skydio X2 was built to meet the needs of some of the drone industry’s most forward-thinking fleets. True autonomy and why it matters, and how it will impact drone operations across the industry.

Before Covid, I had the joy of travelling the country and globe, showing the promise of Skydio to first responders, utilities, state agencies, inspectors of all kinds of assets, and of course, just plain drone people. In these demos, the most common reaction was for people to drop their jaws over the way Skydios fly, then use words that I can’t put in a blog to tell me exactly what they think. Once, a police chief ran back into the station during a parking lot demo, to emerge moments later with everyone in the building in tow. Skydio 2 is a sleek piece of hardware, but the magic is the software that drives the hardware: Skydio Autonomy™. It took over six years from every single person at Skydio for our autonomy technology to reach its current level.

Autonomy is the key to turning drones into useful, scalable, trusted tools that businesses can use and rely on every day. In this blog, we’ll discuss the key capabilities in our autonomy system, the value those capabilities will provide, and how to make sure that whatever drone you build your program around allows you to join the autonomous revolution and get your job done.

What is true autonomy?

Skydio is far from the first drone company to lay claim to some form of autonomy. There are drones that dabble in tracking, waypoint missions, and grid flights for mapping. It can be difficult to discern which drones are just following a script, and which have the deep autonomy required to enable revolutionary new use cases. In fact, autonomy matters even when there’s a pilot on the sticks. Skydio’s approach to autonomy is fundamentally different from the rest of the industry’s, and the ramifications of that approach have make-or-break impacts on what our pilots are able to achieve.

Our aircraft carry the Nvidia TX2 — the fastest, most power-efficient embedded AI computing device available — and six fisheye, 4K navigation cameras that see everything around the drone, just a few of the hardware choices made with autonomy in mind. However, the secret sauce is the software. The hardware is designed from the ground up to support a full-fledged autonomy stack that helps you get the most out of every flight. At a very high level, you can think of Autonomy being composed of the following core tenets:

We build our drones around these capabilities because they impact your operations as a Skydio pilot. Here are some ways you may have been missing these capabilities without even realizing it:

Real-time 3D mapping. Have you ever had your drone dodge one obstacle only to run headlong into another? A first responder friend of mine once shared a story about his DJI Mavic dodging a long branch only to lodge itself in the rest of the tree. That’s because the Mavic, though it can detect an obstacle here and there, is purely reactive, and never has a real understanding of its surroundings at any given moment. Skydio Autonomy continuously builds a real-time 3D map of its surroundings at all times. The difference is particularly clear when you compare the tracking skills on DJI vs. Skydio drones. The review below refers to the difference as “not even fair.” His Mavic does not even survive through the second minute of the review before crashing into a tree. Two minutes later, the drone is in a tree again. The reviewer concludes: “I just don’t feel comfortable flying this drone on Active Track…let’s go get the Skydio 2.”

Object Recognition. Have you ever wished your drone could have dodged that pesky obstacle you couldn’t see? Skydio drones can dodge obstacles that even their cameras can’t detect. Our context-aware AI algorithms can draw conclusions about what they see — for example, concluding that a cable the cameras show floating in mid-air is likely to extend in both directions. That lets them dodge obstacles that their human pilots miss, and is critical to avoiding entire categories of drone crashes.

360° Obstacle Avoidance. Have you ever lost connection to your drone and been terrified it would crash during its automated return to home? Many manual drones, like the Mavic series, for example, claim “omnidirectional obstacle avoidance” but lack full 360° sensor coverage, so without their pilots, they are prone to crash into obstacles in their blind spots. The six navigation cameras on Skydio drones have no blind spots, enabling our drones to deftly bob and weave around obstacles when flying autonomously. The Civil Air Patrol switched to Skydio 2 as their base drone, after realizing that obstacle avoidance lets them safely perform missions that would have otherwise been limited to extremely skilled pilots staying safe from obstacles at high altitude. They are able to reimagine their urban search and rescue protocols in ways that will be invaluable for disaster relief.

Motion Prediction. Have you ever gotten “stuck,” unable to fly where you want to because your collision avoidance sensors are stopping your drone in its tracks? It’s such a common problem that DJI drones even allow you to disable obstacle avoidance through Sport Mode. That’s because they don’t have motion prediction, which allows Skydio drones to plot intelligent paths around obstacles. The result is the feeling that you, the pilot, are just telling your drone where to go, while it handles the necessary twists and turns.

Advanced AI Pilot Assistance. Have you ever had trouble seeing what you wanted to see with your drone because you had to focus on flying safely? Manual drones like the DJI Phantom attempt to solve this problem by throwing people at it through two person operations — a hardly scalable approach. Our approach is to supplement the pilot with artificial intelligence, instead of another employee. I watched a bridge inspection pilot explain this to her boss once: he was skeptical that his team was using autonomy because there was still a pilot in command with a controller, but she reminded him that Skydio AI is not just letting the pilot know obstacles are present, it is actively — autonomously — intervening to navigate past them. With the confidence of an AI engine that has her back, she is able to fly closer to the assets she is inspecting, capturing angles no other drone allows her to, with greater resolution than much more expensive cameras are able to generate from farther stand-off distances.

Workflow Automation. Have you ever had to go back after a mapping flight and capture more data with a really difficult manual flight? A pilot I spoke with at a conference once told me of a time he got his Phantom stuck in the Golden Arches of a McDonald’s while trying to map the parking lot. The drone, apparently, is still up there. Mishaps are really common during autonomous mapping missions, and as a result, pilots are afraid to supplement their grid pattern flights with dangerous manual flights. We design our autonomous workflows such that the drone can assess its surroundings and make its own decisions, capturing better data more safely than a human pilot ever could. The operator is now a manager, not a pilot, which is much more scalable and safer as a drone program grows. In later blogs, we will even show you how Skydio drones can add intelligence to the scripts and make their own decisions in mid-air through Skydio 3D Scan™ and Skydio House Scan™.

This is why any truly autonomous drone requires both hardware and software to work together to provide all six of the core tenets we describe in the table above. Sure, other drones can follow a script — DJI ActiveTrack, or a photogrammetry lawnmower pattern flight. But if your hardware and software aren’t tightly coupled and built from the ground up for autonomy, these applications will always be limited, and dangerous.

So what will autonomy do for your program?

While GPS and magnetometers enabled the current generation of manual drones to evolve from toys and start to add enterprise value in the hands of skilled operators, the next era of the drone industry belongs to software-driven technology powered by breakthrough artificial intelligence that can make drones work for their pilots, instead of the other way around. In future blogs, we’ll show how this approach to autonomy translates into paradigm-shifting products that will help you take your drone program to the next level.

 

At the end of the day, autonomy saves our customers money, and it makes a difference for everyone in the program:

  • Drone Users. From Skydio Autonomy reducing the risk of crashes even in up-close flights, to 3D Scan automating entire missions while capturing higher-precision data, our autonomy products make life easier both for drone pilots and those who use drone data to make decisions.
  • Risk teams. Although drone crashes generally have smaller consequences than failures of the methods they replace (i.e., helicopters, tower climbs, snooper trucks), they are still a liability — in a recent poll, 55% of respondents from over 100 enterprises cited “Risk of Crashes” as the #1 concern with manual drones. And for good reason — crashes can even ground entire fleets. Autonomy helps mitigate risk and get a program over the legal hurdles that can delay implementation.
  • Program Managers. In a drone program, hiring, training, and retaining qualified pilots consumes up to 80% of the overall budget. Autonomy can reduce total cost of ownership by up to 40% by reducing the training burden, and allowing fewer pilots to complete more missions in less time.

 

With all these benefits, it’s no wonder that marketing teams across the drone industry try to lay claim to autonomy and drone intelligence. It can be really difficult, as a buyer, to tell the difference between marketing jargon and true autonomy. Other companies can easily edit video to make it look like their drones fly like Skydios, but in a live demo, any seasoned DJI or Parrot pilot instantly recognizes the vast chasm between those drones’ capabilities and Skydios’. That is why we highly encourage you to get your hands on a Skydio 2 and experience it first hand.

If you are interested in putting Skydio Autonomy to work on your team’s problems, please do get in touch via our Contact Us form.

Credit: medium.com

Robot compare

Science Fiction or Science Fact?

Is there a difference between Science Fiction and Science Fact? Well in most cases there are, however as technology relentlessly moves forward the line between

Wireless In-Flight Drone Recharging Tech For Prime Air

Amazon Prime Air is a drone delivery service that Amazon has been touting for almost four years now. Amazon’s drone delivery service delivered its first package on December 7, 2016. Almost four years later, it’s still a “future delivery system.” What’s missing? Probably something like wireless in-flight drone recharging from the tiny Portland-based Global Energy […]

World’s biggest drone — a 28-ton autonomous behemoth

Alabama rocket startup Aevum just unveiled the world’s biggest drone — a 28-ton autonomous behemoth that may soon rocket US military satellites into orbit Jay Skylus, the CEO of autonomous launch startup Aevum, stands in front of a Ravn X rocket-launching drone. Aevum Aevum, a quiet, scrappy, and ambitious rocket-launch startup, unveiled the biggest drone […]

3d printed rocket Relativity

3D printed rockets – the future of space exploration

Full-duration test of Aeon 1 rocket engine. Relativity Space said Monday that the company has successfully completed a full-duration test-firing of its Aeon 1 rocket engine, running it at full power for 187 seconds. The test at NASA’s Stennis Space Center in Mississippi took place with all of the engine’s key components—including turbopumps, injector, and […]

Drone Privacy Laws Around the World

As the use of drones expands around the world — according to the Federal Aviation Administration, there are currently 1.7 million drones registered in the United States alone — lawmakers have been faced with new and complex regulatory challenges to protect the privacy of ordinary citizens. The increased prevalence of drones has raised the prospect […]

Switching to Skydio and Increase Per-Pilot Revenue 37%

This blog is a teaser and summary of a longer-form written case study, available here at Skydio.com. One of the best parts of my job is talking to customers and listening to their stories about the way that Skydio 2 is changing the way they fly and in some cases, the way they fundamentally do […]

Fotokite – Tethered 24hr First Responder Drone

Fotokite already offers a clever response to two challenges for deploying drones: limited battery life and the need for a certified pilot. And now it’s tackling a third challenge with its new product: How to deploy a drone as quickly as possible in a first responder situation. Drones can be a tremendous asset to first […]

DRONAMICS Announces World’s First Cargo Droneport Network

DRONAMICS, the world’s leading middle-mile cargo drone developer and operator, today unveiled the first 5 airports in its European network of cargo droneports. The DRONAMICS European Droneport Network is the world’s first cargo droneport network and includes private airports and airport groups operating more than 35 airports in 11 European countries, connecting 300 million […]

Non-Stop Flight from California to Sicily Completes NATO UAV Squadron

An RQ-4D Phoenix UAV from Northrop Grumman Corporation completed a 20-hour non-stop trans-Atlantic flight from California to Sicily, where it joined the NATO Alliance Ground Surveillance (AGS) squadron on Nov. 12 at Sigonella Air Base. The air vehicle is the last of five NATO RQ-4D aircraft, completing deliveries to the Main Operating Base (MOB) of […]

Anti-Jam GPS for Army’s Gray Eagle UAV Awarded to Cobham

For its flagship Gray Eagle UAV, the U.S. Army with lead contractor General Atomics Aeronautical Systems has selected an anti-jam GPS system from Cobham Aerospace Connectivity. The MQ-1C ER Gray Eagle Extended Range (GE-ER) Unmanned Aircraft System (UAS) platform is a medium-altitude, long-endurance (MALE) unmanned aircraft system (UAS) developed as an upgrade to the MQ-1 […]

Request a NO OBLIGATION quote

The cost of a survey or inspection is simple to calculate, but is dependant on the mission and its location. Please provide details in order to complete an accurate quotation.  Get in touch we’ll be happy to provide a no obligation quotation

“Opportunities for the commercial application of drones is set to continue to grow…”

Digital Marketing Solutions

Have you looked at creating a promo for your business and found it too costly and complicated?

It’s time to impress your client base with affordable marketing solutions from Helix UAV. We can create a fully edited promotional film or you can have the raw footage (it’s yours).

To take your businesses potential to the next level lets show them what you’ve got.

3D imaging of objects and structures that can be interactively manipulated on your web page for your marketing purposes is now possible. You no longer need NASA you need Helix UAV.

Aerial Inspection

Aerial Surveying

Aerial Media

Aerial Imaging

Icon Logo for Helix UAV Drone Services 2

CORONAVIRUS

 

Government organisations or subsidiaries wishing to request assistance from Helix UAV during this extremely difficult time can send their requests via our dedicated email address:

 

coronavirus@helixuav.com

 

07480 041928

 

Please use the form below if you wish to subscribe to our news service. Please follow government guidelines and stay safe

 

HELIX UAV

 

 
 
 

You have sent your message