Next Generation SMART Concept - 911 Go

The Cosumnes Fire Department Next Generation SMART Concept (aka: 911 Go) is focused on community risk reduction by leveraging current and near-term technological solutions to deliver public education, mixed-reality training for firefighters, and augmented cyber-physical enabled emergency response enhanced mitigation.  Using gaming technology, the proposed platform will use augmented reality like Pokémon Go, redesigned to save lives.

The work below is IN CONCEPT DEVELOPMENT and does not constitute current use case.  It does, however, provide a vision into what one day may be possible.

The Cosumnes Fire Department continues to collaborate with world leaders exploring Next Generation solutions, with the goal of providing community risk reduction with SMART systems - EXCEEDING EXPECTATIONS AT ALL TIMES.

 

360 Degree Virtual Reality video

This 360 degree Virtual Reality Video is a sample of more to come. Future videos will provide educational awareness for children and adults in fire and life safety subjects.

360 degree 3D scenes are being used in virtual reality gaming applications and can provide education and awareness for civilians, as well as provide training for first responders for fires, earthquakes, floods, and other life-threatening scenarios.
360 degree 3D scene
3D Point Cloud

 
Three dimensional data sets like this remote sensed "Point Cloud" may provide situational awareness for firefighters during emergencies in the future.

This photo realistic point cloud of our technical rescue station combines high definition laser scanning with true color enhancement and provides an example of data sets that will be used for community risk reduction.
Photo realistic Pont Cloud
CFD Training Tower Model

Fire modeling is a physics-based process where the likely propagation of a fire is demonstrated by using computational fluid dynamics to teach citizens and first responders how a fire will progress. This model represents a fire in our training tower with limited ventilation and modest fuel loading.

Serious gaming applications and fire modeling were developed from data collected via high definition laser scanning that was then converted to building information modeling (BIM).  In the future, like with point cloud data, first responders will use BIM to navigate in an emergency to find occupants.  Citizens will use BIM and augmented reality applications on their phone to escape harm.
BIM model
Gaming platform

Serious gaming engine platforms, combined with CFDs in a virtual gaming platform, offer additional layers of potential public education and first responder training.  This sample video shows the training tower in a “virtual city” where a firefighting crew attacks the fire while a victim recovers from smoke inhalation.

Another CFD shows how a smoldering couch fire would fill our training tower with smoke.  Citizens should understand, as demonstrated in this video, that many fires progress rapidly and they should always know two ways out to rapidly escape the toxic, and potentially deadly, smoke.
Couch fire
Avatar - Captain McKinzie

"Virtual" avatars can be realistically constructed and used in various training platforms.  In time, these computer-generated selves will help us learn and may one day be used in augmented reality personnel-tracking solutions.

This video shows how BIM can be turned into a desktop application to visualize data in augmented reality on a phone.  Future work aims to provide responders with important information in their field of view through SMART glasses.

SMART image
MIT Presentation 01-2017

The Cosumnes Fire Department SMART concept as presented at MIT, January 2017.

In the future, Next Generation First Responder solutions will provide SMART Cyber-Physical systems where lives will be saved in 360 and 3D through public education, first responder training, and emergency response enhancement.  Children will use their gaming platforms to learn real world fire and life safety skills, from the comfort of their living rooms.  Responders will have building information modeling (BIM) and 3D digital terrain maps of all public areas, and many commercial and private assets whose holders wish to make them available to responders.  Multi-sensor fusion will be incorporated to provide artificial intelligence regarding current hazard locations (flood, smoke, fire, active shooter).  Biotelemetry from individuals' health monitors, computer vision and real-time remote sensed data from helmet-mounted structured light and infrared sensors will assist in development of the solution platform.  The project will involve collaborative development of 3D remote sensed point clouds, Building Information Modeling (BIM), physics-based computational fluid dynamic modeling, gaming platform applications, haptic touch, digital scent, computer vision, coupled with relevant and actionable multi-sensor fusion for a cyber-physical HUD enabled "Iron First Responder."  Incident commanders will receive this intelligence through VR and AR enabled heads up devices and citizens will escape harm through the 911 Go application on their personal phones.

*******************************************************************************************************************************************************

Related Work by Others:

Volcano

Qwake Technologies is working on computer vision to help first responders see in zero visibility.

Future responders will save lives through augmented reality enabled with real-time traffic data analytics, building information modeling (BIM), SMART smoke and heat detectors, health monitors, and geo fencing as depicted in "Orbi," the lifesaving gaming platform from The Digit Group.

Digit Group
Future Fire Command

Motorola Solutions, Inc. Innovation and Design team has released an augmented reality concept video that is aimed at community and first responder risk reduction.