Model-based Situational Awareness & the Digital Twin Ray - - PowerPoint PPT Presentation

▶
model based situational awareness the digital twin ray
SMART_READER_LITE
LIVE PREVIEW

Model-based Situational Awareness & the Digital Twin Ray - - PowerPoint PPT Presentation

Mar 05, 2024 225 likes •398 views

Unclassified Unlimited Release SAND2018-4870 C Physical Security Center of Excellence Model-based Situational Awareness & the Digital Twin Ray Trechter, Manager P R E S E N T E D BY Interactive Systems Simulation & Analysis

slide-1
SLIDE 1

Unclassified Unlimited Release

Sandia National Laboratories is a multimission laboratory managed and

  • perated by National Technology &

Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Physical Security Center of Excellence

Model-based Situational Awareness & the Digital Twin

Ray Trechter, Manager Interactive Systems Simulation & Analysis Department Sandia National Laboratories ratrech@sandia.gov P R E S E N T E D BY

UNCLASSIFIED UNLIMITED RELEASE

SAND2018-4870 C

slide-2
SLIDE 2

Unclassified Unlimited Release

  • In this talk we will explore how modeling and simulation (M&S) and

augmented reality (AR) can be used to create a Digital Twin that…

  • Supports blue force operations at a high security installation
  • Improves situational awareness, analysis, and exercises
  • Offers new training opportunities.

2

UNCLASSIFIED UNLIMITED RELEASE

Model-based Situational Awareness & the Digital Twin

slide-3
SLIDE 3

Unclassified Unlimited Release

Sandia National Laboratories

3

Sa Sandia develops advanced technologies to ensure global peace

3

  • US Government owned, contractor operated Federally Funded

Research and Development Center (FFRDC)

  • Workforce: 12,001 employees (10,715 NM, 1,286 CA)
  • Strong research foundation supports mission delivery

UNCLASSIFIED UNLIMITED RELEASE

slide-4
SLIDE 4

Unclassified Unlimited Release

Ray’s Background

4

UNCLASSIFIED UNLIMITED RELEASE

Ray currently leads Sandia’s Interactive Systems Simulation & Analysis (ISSA) Department which develops flexible and powerful tools for analyzing security in operational spaces, particularly facilities and their surrounding terrain. He also expanded Sandia Laboratories’ force-protection research and methodologies by focusing

  • n critical infrastructure assessment of U.S. bases/facilities and modeling military missions and

their dependencies.

slide-5
SLIDE 5

Unclassified Unlimited Release

Terms of Reference – A Few Definitions

Virtual reality (VR) immerses users in a fully artificial digital environment. Augmented reality (AR) overlays virtual objects on the real-world environment. Mixed reality (MR) not just overlays but anchors virtual objects to the real world.

Source: Forbes, The Difference Between Virtual Reality, Augmented Reality And Mixed Reality, Feb 2018

Digital Twins are digital models that form mirror images of their physical counterparts

Source: Colin Parris, GE Research

Digital Twins ≈ Mixed Reality

UNCLASSIFIED UNLIMITED RELEASE

5

slide-6
SLIDE 6

Unclassified Unlimited Release

Can a Digital Twin Give an Installation Security Force an Advantage?

6

UNCLASSIFIED UNLIMITED RELEASE

slide-7
SLIDE 7

Unclassified Unlimited Release

Installations – a Great Candidate for a Digital Twin

7

UNCLASSIFIED UNLIMITED RELEASE

  • Three elements of a digital twin
  • Asset Model
  • Analytics
  • (predict, describe, and prescribe the behavior of

the asset )

  • Knowledge base

Source: GE https://www.ge.com/digital/predix/digital-twin

slide-8
SLIDE 8

Unclassified Unlimited Release

A Digital Twin An Be Used to Improve Command and Control

8

UNCLASSIFIED UNLIMITED RELEASE

An digital twin can be used to

  • Lower response time
  • Improve defender awareness
  • Serve as a battle aid
  • Predicted OPFOR and suggested blue force moves

Digital Twin with AR Real Operation Simulation Autonomy

slide-9
SLIDE 9

Unclassified Unlimited Release

Digital Twins Enable Different Types of Physical Security Analyses

9

UNCLASSIFIED UNLIMITED RELEASE

System Effectiveness Modeling (Dante)

Training (VBS3) Human-In-The-Loop Exercises (JCATS) Planning and Design (OpShed)

slide-10
SLIDE 10

Unclassified Unlimited Release

Security Force Advantage Through M&S

10

UNCLASSIFIED UNLIMITED RELEASE

Simulation features include:

  • OPFOR vs Defender AIs
  • Knowledge and use of terrain
  • Tactics (e.g., OPFOR anticipates Defender Patrols)
  • Sensing View Sheds
  • Faster than real-time, predicts outcomes
slide-11
SLIDE 11

Unclassified Unlimited Release

Another Possible Advantage Through AR

11

UNCLASSIFIED UNLIMITED RELEASE

Visual Communication Channel

  • Could also be auditory or haptic
  • Persistent

Show things that can’t be seen in real world

  • Sensor coverage including blind spots
  • Key asset location
  • Recommended fighting positions

Enemy identification

  • Video cues/markers placed on OPFOR
  • Avatars
slide-12
SLIDE 12

Unclassified Unlimited Release

And Yet Another Advantage Through Autonomy

12

UNCLASSIFIED UNLIMITED RELEASE

  • UAS and other moving sensors can accurately locate themselves and other forces
  • Moving sensors can be dynamically repositioned for better views and changing

environmental conditions

  • Autonomy may be needed to combat autonomy (e.g., swarms)

Source: Time.com

slide-13
SLIDE 13

Unclassified Unlimited Release

More Awareness to the Edge

13

UNCLASSIFIED UNLIMITED RELEASE

Sensor Alerts and other information can be displayed immediately allows the response force to anticipate response needed and better coordinated C2

Alarm Station and Commander Assess and Direct Forces Streaming Video Sensor Alarms Tailored Display AR Enhancements Suggested Routes Other Visual Ques Other Sensors Digital Twin Maintains the Situation and Aids in Decisions Response Force Radio Cameras

slide-14
SLIDE 14

Unclassified Unlimited Release

M&S and AR Prospects for Installations Readiness Timeline

14

Hand-held:

  • Outdoor locations
  • GPS-based blue force tracking
  • Real-time sensor information
  • Cover, observation points
  • C2 marking of objects
  • Predictive OPFOR tracking

AR device :

  • Indoor locations
  • Location libraries
  • Object registration and tracking

though video analytics

  • Pose Information
  • Virtual Characters/Equipment
  • Smart Objects

UNCLASSIFIED UNLIMITED RELEASE

slide-15
SLIDE 15

Unclassified Unlimited Release

Augmented Operations Provide New Training Opportunities

15

UNCLASSIFIED UNLIMITED RELEASE

  • Scenario-based custom configurations
  • Personalized views
  • Real-time tracking
  • Potentially more immersive
  • On demand training with job aids (e.g., maintenance

manuals)

  • Training on prototype systems that may reduce the

engineering design lifecycle

  • Lowers costs
slide-16
SLIDE 16

Unclassified Unlimited Release

Some Parting Thoughts

16

UNCLASSIFIED UNLIMITED RELEASE

  • Does a stepwise approach to AR – crawl, walk, run, make sense

in your environment?

  • How might instantaneous access to threat information change

the operating environment?

  • Information filtering?
  • Changes to tactics and response?
  • What are the training ramifications of an augmented
  • perational environment?