Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 - - PowerPoint PPT Presentation

▶
mixed reality with microsoft hololens
SMART_READER_LITE
LIVE PREVIEW

Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 - - PowerPoint PPT Presentation

Oct 10, 2023 756 likes •1.17k views

Mixed Reality with Microsoft HoloLens Philipp Bauknecht, 11/15/2016 goto; conference Berlin Image: microsoft.com/hololens Philipp Bauknecht Founder & CEO medialesson GmbH @GrillPhil 4x AR vs. VR vs. MR Virtual Reality Augmented

slide-1
SLIDE 1

Image: microsoft.com/hololens

Mixed Reality with Microsoft HoloLens

Philipp Bauknecht, 11/15/2016 goto; conference Berlin

slide-2
SLIDE 2
slide-3
SLIDE 3

Philipp Bauknecht Founder & CEO medialesson GmbH @GrillPhil

4x

slide-4
SLIDE 4

AR vs. VR vs. MR

slide-5
SLIDE 5

Virtual Reality Augmented Reality Mixed Reality

slide-6
SLIDE 6

Virtual Reality

Image: gospelherald.com

Augmented Reality

Image: parenting.blog.austin360.com

Mixed Reality

Image: littleover.derby.sch.uk

slide-7
SLIDE 7

Virtual Reality Augmented Reality Mixed Reality

Immersion ฀ ฀ ฀ ฀ ฀ Comfort ฀ ฀ Collaboration ฀ Mobility ฀ ฀ Immersion ฀ Comfort ฀ ฀ ฀ Collaboration ฀ Mobility ฀ ฀ ฀ ฀ ฀ Immersion ฀ ฀ ฀ ฀ Comfort ฀ ฀ ฀ Collaboration ฀ ฀ ฀ ฀ Mobility ฀ ฀ ฀ ฀

slide-8
SLIDE 8

Holograms

slide-9
SLIDE 9

What is a Hologram?

  • A hologram is an object like any other object in the real world, with
  • nly one difference: instead of being made of physical matter, a

hologram is made entirely of light.

  • Holographic objects can be viewed from different angles and

distances, just like physical objects.

  • Holograms do not offer any physical resistance when touched or

pushed because the don‘t have any mass.

slide-10
SLIDE 10

Image: Lucasfilm

slide-11
SLIDE 11

Image: Marvel/Paramount Pictures

slide-12
SLIDE 12

Microsoft HoloLens

slide-13
SLIDE 13

Mixed Reality + Virtual Reality Spatial Mapping Fully unthered Runs Windows 10 Interaction usinggaze, gestures and voice

slide-14
SLIDE 14

Image: microsoft.com

See-through holographic lenses (waveguides) 2 HD (720p) 16:9 light engines Automatic pupillary distance calibration Build-in speakers Spatial audio Battery 2-3 hours of active use Fully functional when charging Passively cooled (no fans) Intel Atom CPU Custom-build Holographic Processing Unit (HPU) 579g 64GB Flash 2GB RAM Wi-Fi 802.11ac Bluetooth 4.1 LE V

  • lume up/down

Brightness up/down

slide-15
SLIDE 15

Image: microsoft.com

Audio 3.5mm jack Micro USB 2.0 4 Environment understanding cameras depth camera 2MP photo& HD video camera 4 Microphones Ambient light sensor

slide-16
SLIDE 16
slide-17
SLIDE 17

Use scenarios

slide-18
SLIDE 18

Marketing

Image: microsoft.com

slide-19
SLIDE 19

Product Design

Image: microsoft.com

slide-20
SLIDE 20

Education

Image: microsoft.com

slide-21
SLIDE 21

Architecture

Image: microsoft.com

slide-22
SLIDE 22

Remote Services

Image: microsoft.com

slide-23
SLIDE 23

Research & Science

Image: microsoft.com

slide-24
SLIDE 24

Games & Entertainment

Image: microsoft.com

slide-25
SLIDE 25

Semi-virtual Construction

Image: microsoft.com

slide-26
SLIDE 26

Current Projects

slide-27
SLIDE 27
slide-28
SLIDE 28

Live Demo

slide-29
SLIDE 29

Development

slide-30
SLIDE 30

Tooling

  • Visual Studio 2015 with Update 3 (free as Community Edition)

Pro tip:Make sure to pick Tools (1.4) and SDK (10.0.10586) of the Universal Windows App Development Tools when doing a custom install.

  • HoloLens Emulator
  • Unity 5.5.0b11 (as of November 9th)

Pro tip: Do not use the HoloLens Technical Preview builds of Unity as they are outdated and broken.

slide-31
SLIDE 31

Framework options

  • All apps are Universal Windows Platform (UWP) apps
  • Raw power: DirectX 11 using C++ or C# with SharpDX
  • Easy to prototype and build: Unity using C#
slide-32
SLIDE 32

App view options

Holographic View 2D View

Image: microsoft.com Image: microsoft.com

slide-33
SLIDE 33

App view options

Holographic View 2D View

  • Creates holograms
  • No other app can draw at the same

time

  • Can render world-locked holograms
  • Shell does not render at the same time
  • App is responsible to handle all user

input.

  • Renders on a slate
  • Slates are world-locked and can be

adjusted in size and position by the user

  • Apps resolution stays fixed
  • Apps have to switch into 2D view for

keyboard entry

  • All UWP apps run in 2D view without

modifications

Image: microsoft.com Image: microsoft.com

slide-34
SLIDE 34

Development workflow using Unity

  • 1. Use Unity to layout your scenes, place holograms, camera and light
  • 2. Develop components using Visual Studio.
  • 3. Export the project from Unity as Visual Studio Solution. You will

still be able to modify scripts but not a scene.

  • 4. Deploy app to the Emulator or your real device.
slide-35
SLIDE 35

Demo Workflow

slide-36
SLIDE 36

Where to start

  • 1. Grab the tools
  • 2. Attend the free Holographic Academy online

https://developer.microsoft.com/EN- US/WINDOWS/HOLOGRAPHIC/ACADEMY

  • 3. Deep dive into the HolographicApp Development documentation

https://developer.microsoft.com/en- us/windows/holographic/documentation

  • 4. Check you open source Galaxy Explorer app on GitHub

https://github.com/Microsoft/GalaxyExplorer

  • 5. Submit yourfirst app to the Windows Store
slide-37
SLIDE 37

How to buy

Availabily

  • Australia
  • Canada
  • Ireland
  • France
  • Germany
  • New Zealand
  • United Kingdom
  • United States

Order online at microsoftstore.com Developer Edition 3.299 EUR incl. VAT Commercial Suite 5.489 EUR incl. VAT

slide-38
SLIDE 38
  • Thanks. Questions?
slide-39
SLIDE 39