SLIDE 1
S8215: Displaying and Interacting with Desktop Apps in VR
GTC 2018 // Rouslan Dimitrov
Imagine YOUR OWN Holodeck
User content from BIOHAZRED
S8215: Displaying and Interacting with Desktop Apps in VR GTC 2018 - - PowerPoint PPT Presentation
S8215: Displaying and Interacting with Desktop Apps in VR GTC 2018 - - PowerPoint PPT Presentation
S8215: Displaying and Interacting with Desktop Apps in VR GTC 2018 // Rouslan Dimitrov Imagine YOUR OWN Holodeck User content from BIOHAZRED Imagine YOUR OWN Holodeck VR Screens User content from BIOHAZRED VR TOOLBOX the App Goal: bring
SLIDE 2
SLIDE 3
Imagine YOUR OWN Holodeck
User content from BIOHAZRED
VR Screens
SLIDE 4
VR TOOLBOX the App
Desktop apps
Capture apps’ render surface Forward input events Improve text readability
1
Customize your space with virtual screens & props
- Built-in / online catalog / your
- wn
2
Community integration
- Share props through Steam
Workshop
- Share custom scenes with your
friends or coworkers
- C++ / JavaScript plugin support
3
Extras:
- YouTube 360 integration
- Watch streamed Twitch
broadcasts live
- Camera pass-through and
webcam support
4
Goal: bring existing desktop applications & content into VR
SLIDE 5
Screen Sources
- Entire desktop
- Individual apps
- Video / image (poster)
- Camera (webcam)
- Built-in Browser
Per Screen Properties
- Size
- Position
- Orientation
- Curvature
- Alpha
- Stereoscopy
- + more…
SCREENS
User content from Lipica
SLIDE 6
User content from BIOHAZRED
SLIDE 7
User content from TapCrush
SLIDE 8
Touchpad gestures
- Click left / right – translate to left / right mouse clicks
- Swipe left / right – go back / forward
- Swipe up / down – scroll the page
Laser pointer
- In addition to mouse cursor
- Mouse cursor:
- Hovers above the screen
- Significantly larger than on the desktop
- Adaptive smoothing:
- Users should not experience their shaky hands
- Clicks should not push the pointer down
- Clicks should not be interpreted as drags
INPUT
Use everyday paradigms (in VR)
SLIDE 9
Hand gestures
- Grab by squeezing (the trigger)
- Move objects by moving your hand
- Extend your reach in VR by swiping while grabbing
- Grip button applies hand transform to the grabbed
- bject
INPUT
Use everyday paradigms (in VR)
SLIDE 10
VISUAL AIDS
It’s easy to clutter your VR space, but VR Toolbox can help fix that!
- Snap objects to vertical axis
- Snap objects to other nearby objects
- Auto-arrange screens
- Link objects in a hierarchy
Moving the desk also moves the screens and lamp on top
- Render infinite bounding lines to align
- bjects that are far apart, in addition to
snapping them
SLIDE 11
Vive Tracker Integration
- Track the chair / keyboard
- Establish a linkage to any VR object
Pass-through Camera (Beer Cam)
- See your keyboard / hands / drink /
cable around your feet
- Activated when looking down
- Activated when looking behind (who is
knocking on the door)
Virtual Real World Connection
SLIDE 12
Pass-through Camera (Beer Cam)
- See your keyboard / hands / drink /
cable around your feet
- Activated when looking down
- Activated when looking behind (who is
knocking on the door)
Vive Tracker Integration
- Track the chair / keyboard
- Establish a linkage to any VR object
Virtual Real World Connection
SLIDE 13
RENDERING
SLIDE 14
Temporal Dithering
- HMD resolution too low for reading
small text
- “Smooth nearest” sampling mode
for text improves readability to counter head wobble
- Image sharpening
- Turn off clear type
1
Depth of Field
- Decrease distraction while focusing
- n a window or examining a nearby
- bject
(in your hand)
- Makes VR more natural
- Large eye aperture for far objects
- nly
2
Ambient Occlusion
- World space technique
- No noise
- Fast (for 90 FPS, stereo)
- Very approximate, but nice hard
contacts
3
RENDERING
SLIDE 15