Immersive Semi-Autonomous Aerial Command System

A new way to team up with drones.

ISAACS is an open-source project to envision new ways for human users to intuitively interface and collaborate with aerial drones around augmented reality (AR) technologies.

Localization and Visualization

ISAACS utilizes real-time SLAM solutions to localize the 3D coordinates of aerial vehicles and the operators wearing HoloLens. The first version of the platform will be developed in collaboration also with DJI based on the Matrice-100 platform.

Human-Robot Interface (HRI) via AR

A new 3D, contextualized robot interface allows operators to control and command a drone fleet directly from HoloLens. It represents a new vision of how human-robot interface (HRI) can be, which can provide seamless and intuitive extension of human operators’ perception and control capabilities to a fleet of aerial vehicles in complex environments.

Vehicle Safety Assurance

ISAACS also interfaces with drones' low-level controller to enhance the safety of the drone operation even in the case of human error. Carefully designed vehicle safety information will be also augmented in 3D space via HoloLens to enhance the operators’ situation awareness.


Dean S. Shankar Sastry

Prof. Claire J. Tomlin

Dr. Allen Y. Yang

Rohit Swamy

Kevin Yin

Daniel Pok



Who is Isaacs?

ISAACS is inspired by the famous game theorist Rufus Isaacs, who contributed to the fundamental development of the classic pursuit-evasion game theory and dynamic programming, among many other notable work. Here is a Wikipedia page dedicated to him:


ISAACS was awarded the First Microsoft HoloLens Research Grant.

Today, we’re excited to announce the award recipients of the Microsoft HoloLens Academic Research Grant Program. Earlier this year, we challenged academic institutions to submit their ideas to harness the potential of Microsoft HoloLens and push the boundaries of possible applications for holographic computing.

© University of California, Berkeley, 2016. Contact: Dr. Allen Y. Yang, Cory Hall, Berkeley, CA 94720. Email: