towards a virtual stuntman
play

Towards a Virtual Stuntman Xue Bin (Jason) Peng UC Berkeley - PowerPoint PPT Presentation

Oct 10, 2023 •663 likes •1.82k views

Towards a Virtual Stuntman Xue Bin (Jason) Peng UC Berkeley Animation Animation Computer Animation [Geijtenbeek et al. 2013] [Brown et al. 2013] [Ju et al. 2013] [Tan et al. 2014] [Kwon and Hodgins 2017] [Peng et al. 2018] Physics-Based

  1. Towards a Virtual Stuntman Xue Bin (Jason) Peng UC Berkeley

  2. Animation

  3. Animation

  4. Computer Animation [Geijtenbeek et al. 2013] [Brown et al. 2013] [Ju et al. 2013] [Tan et al. 2014] [Kwon and Hodgins 2017] [Peng et al. 2018]

  5. Physics-Based Animation [Coros et al. 2011]

  6. Deep RL [Mnih et al. 2015] [Schulman et al. 2016] [Chebotar et al. 2017]

  7. Motion Quality [Schulman et al. 2016] [Heess et al. 2017]

  8. Motivation

  9. Which is Mocap?

  10. Which is Mocap? Mocap Simulation

  11. Overview + + Character Reference Motion Task: Hit Target

  12. Overview

  13. Overview

  14. Overview

  15. Reference Motion

  16. Reference Motion

  17. Reference Motion

  18. Reference Motion

  19. Reference Motion

  20. Reference Motion

  21. Reference Motion 𝑏 0 𝑏 1 𝑏 2 𝑏 3 𝑏 4

  22. State + Action State: • link positions • link velocities

  23. State + Action State: • link positions • link velocities

  24. State + Action State: Action: • link positions • PD targets • link velocities

  25. State + Action State: Action: • link positions • PD targets • link velocities

  26. Reward

  27. Reward Imitation Objective

  28. Reward Imitation Objective

  29. Reward Imitation Objective

  30. Reward Imitation Objective

  31. Reward Imitation Objective Task Objective

  32. Proximal Policy Optimization (PPO) [Schulman et al. 2017]

  33. Proximal Policy Optimization (PPO) [Schulman et al. 2017]

  34. Proximal Policy Optimization (PPO) [Schulman et al. 2017]

  35. Proximal Policy Optimization (PPO) [Schulman et al. 2017]

  36. Proximal Policy Optimization (PPO) [Schulman et al. 2017]

  37. Humanoid: Walk

  38. Humanoid: Run

  39. Comparison Ours [Merel et al. 2017]

  40. No Reference Motion

  41. Locomotion

  42. Humanoid: Cartwheel

  43. Humanoid: Backflip

  44. Humanoid: Frontflip

  45. Humanoid: Roll

  46. Humanoid: Crawl

  47. Humanoid: Dance A

  48. Humanoid: Kip-Up

  49. Humanoid: Headspin

  50. Humanoid: Vault 1-Handed

  51. Humanoid: Flare

  52. 20+ Skills

  53. Keyframe Animation

  54. T-Rex: Walk Simulated Character

  55. Dragon: Walk Simulated Character

  56. Lion: Run Simulated Character

  57. Lion++

  58. Tasks

  59. Tasks Reference Motion

  60. Tasks + Reference Motion Task

  61. Humanoid: Spinkick - Strike

  62. Humanoid: Baseball Pitch - Throw

  63. No Reference Motion

  64. Humanoid: Balance Beam

  65. Humanoid: Run – Dense Gaps

  66. Retargeting

  67. Character Retargeting + Reference Motion Atlas

  68. Atlas: Spinkick

  69. Atlas: Run

  70. Atlas: Getup-Facedown

  71. Atlas: Backflip

  72. Multi-Clip Integration

  73. Multi-Clip Integration

  74. Multi-Clip Integration

  75. Learning from Mocap

  76. Mocap is a Hassle [Holden 2018]

  77. Skills From Videos

  78. Learning from Videos Video Simulation Simulation

  79. Overview

  80. Overview

  81. Overview

  82. Overview

  83. Overview

  84. Pose Estimation

  85. Pose Estimation Video: Handspring A Pose Prediction

  86. Human Mesh Recovery (HMR) [Kanazawa et al., 2018]

  87. Pose Estimation Video: Backflip A Pose Prediction

  88. Motion Imitation

  89. Motion Imitation

  90. Motion Imitation

  91. Motion Imitation

  92. Humanoid: Cartwheel B Video: Cartwheel B Reference Motion Policy

  93. Humanoid: Jumping Jack Video: Jumping Jack Policy

  94. Humanoid: Backflip B Video: Backflip B Policy

  95. Humanoid: Frontflip Video: Frontflip Policy

  96. Humanoid: Roll Video: Roll Policy

  97. Humanoid: Spin Video: Spin Policy

  98. Humanoid: Kip-Up Video: Kip-Up Policy

  99. Humanoid: Vault Video: Vault Policy

  100. Atlas: Handspring A Video: Handspring A Policy

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines:

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines:

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines: Virtual machine technology, often just called virtualization , makes one computer behave as several Running several operating systems simultaneously on

254 views • 10 slides
EXPERIENCE VIRTUAL REALITY VIRTUAL REALITY MARKET VR will be bigger than TV Virtual

EXPERIENCE VIRTUAL REALITY VIRTUAL REALITY MARKET VR will be bigger than TV Virtual

VIRTUAL REALITY HEADSET FOR SMARTPHONES EXPERIENCE VIRTUAL REALITY VIRTUAL REALITY MARKET VR will be bigger than TV Virtual reality is a medium, a Virtual reality was once the in 10 years. means by which humans can dream of

535 views • 16 slides
1 Everyone Has a Why The Rise of a Virtual Workplace Going Virtual About 30 million

1 Everyone Has a Why The Rise of a Virtual Workplace Going Virtual About 30 million

1 Everyone Has a Why The Rise of a Virtual Workplace Going Virtual About 30 million Americans work from home. Virtual. Remote. Distributed. This style of organization is becoming more common among many industries including web shops

926 views • 49 slides
Implementing a Virtual Gala Why you should consider virtual Liability!

Implementing a Virtual Gala Why you should consider virtual Liability!

Implementing a Virtual Gala Why you should consider virtual Liability! https://www.eventsafetyalliance.org/esa-reopening-guide 2 Why you should consider virtual Not the year to NOT be fundraising Has your need increased since March

479 views • 19 slides
GROUPS Virtual Group Topics Overview of Virtual Groups Participating as a Virtual Group in

GROUPS Virtual Group Topics Overview of Virtual Groups Participating as a Virtual Group in

OVERVIEW OF VIRTUAL GROUPS Virtual Group Topics Overview of Virtual Groups Participating as a Virtual Group in MIPS Application of Group-Related Policies to Virtual Groups Virtual Group Election Process Virtual Group Formal

682 views • 29 slides
Lecture 19: Virtual Memory Virtual Memory concept, Virtual- physical translation, page table,

Lecture 19: Virtual Memory Virtual Memory concept, Virtual- physical translation, page table,

Lecture 19: Virtual Memory Virtual Memory concept, Virtual- physical translation, page table, TLB, Alpha 21264 memory hierarchy 1 Adapted from UC Berkeley CS252 S01 Virtual Memory Virtual memory (VM) allows programs to have the illusion of a

711 views • 23 slides
VIRTUAL LEARNING OPTION What is Virtual School? Virtual school is a learning option that

VIRTUAL LEARNING OPTION What is Virtual School? Virtual school is a learning option that

VIRTUAL LEARNING OPTION What is Virtual School? Virtual school is a learning option that delivers course content entirely or primarily through online methods. Attendance Daily accountability Devices Students will have individual

154 views • 14 slides
Welcome to Virtual Your Virtual World Event Hub Glasgows making memorable virtual events

Welcome to Virtual Your Virtual World Event Hub Glasgows making memorable virtual events

Welcome to Virtual Your Virtual World Event Hub Glasgows making memorable virtual events Interactive everything is possible We live and work by this motto. Do you want to replicate the traditional event format of plenary sessions, several

381 views • 17 slides
Spatial Illusions: From Mirrors to Virtual Reality David Chalmers Virtual Reality Virtual

Spatial Illusions: From Mirrors to Virtual Reality David Chalmers Virtual Reality Virtual

Spatial Illusions: From Mirrors to Virtual Reality David Chalmers Virtual Reality Virtual reality technology: produces experiences as of an external reality grounded in a computer simulation. Virtual Reality and Philosophy

1.01k views • 76 slides
1 Chances to weaken ordering Virtual Synchrony at a glance Suppose that any conflicting

1 Chances to weaken ordering Virtual Synchrony at a glance Suppose that any conflicting

Virtual Synchrony Goal: Simplifies distributed systems Virtual synchrony development by introducing emulating a simplified world a synchronous one Features of the virtual synchrony model Process groups with state transfer,

275 views • 9 slides
Shared Memory OS Lecture 9 UdS/TUKL WS 2015 MPI-SWS 1 Review: Virtual Memory How is virtual

Shared Memory OS Lecture 9 UdS/TUKL WS 2015 MPI-SWS 1 Review: Virtual Memory How is virtual

Shared Memory OS Lecture 9 UdS/TUKL WS 2015 MPI-SWS 1 Review: Virtual Memory How is virtual memory realized? 1. Segmentation : linear virtual physical address translation with base & bounds registers 2. Paging : arbitrary virtual

733 views • 30 slides
1 Virtual Channel Connection Uses Advantages of Virtual Paths (VP) & Virtual Channels (VC)

1 Virtual Channel Connection Uses Advantages of Virtual Paths (VP) & Virtual Channels (VC)

Chapter 11. ATM and Frame Relay ATM: Cell Switching ATM: a method of packet switching Overview of ATM A virtual circuit packet switching technique with QoS Protocol Architecture guarantee. Used in both WAN and LAN settings

64 views • 5 slides
(Virtual Class Rooms) 17 th October 2013 What is Virtual Classroom? Virtual classroom is a

(Virtual Class Rooms) 17 th October 2013 What is Virtual Classroom? Virtual classroom is a

Challenges in Setting Interactive Classroom (Virtual Class Rooms) 17 th October 2013 What is Virtual Classroom? Virtual classroom is a replica of the local class room teaching where in the students at remote locations will get the same

672 views • 31 slides
Virtual ring routing Virtual ring routing Some slides from http://

Virtual ring routing Virtual ring routing Some slides from http://

Virtual ring routing Virtual ring routing Some slides from http:// research.microsoft.com/en-us/um/people/antr/vrr- sigcomm06.ppt 123 VRR: the virtual ring VRR: the virtual ring topology-independent 0 FFF node identifiers, e.g., MAC

694 views • 18 slides
Virtual Memory and Virtual Memory and Demand Paging Demand Paging Virtual Memory Illustrated

Virtual Memory and Virtual Memory and Demand Paging Demand Paging Virtual Memory Illustrated

Virtual Memory and Virtual Memory and Demand Paging Demand Paging Virtual Memory Illustrated Virtual Memory Illustrated virtual physical backing executable memory memory file storage (big) (small) header text pageout/eviction text

480 views • 12 slides
VIRTUAL ARCHITECTURAL PRACTICE - AN ALTERNATE REALITY PRODUCED BY AIA PMKC + AIA TRUST 1.5

VIRTUAL ARCHITECTURAL PRACTICE - AN ALTERNATE REALITY PRODUCED BY AIA PMKC + AIA TRUST 1.5

Peter S. Macrae, AIA SPEAKERS: VIRTUAL PRACTICE FRAMEWORK Charles R. Heuer, Esq, FAIA MANAGING RISK WHEN RUNNING A VIRTUAL PRACTICE Kevin J. Collins, RPLU, Associate AIA CHALLENGES TO PROFESSION AND PRACTICE IN A VIRTUAL PRACTICE Lira Luis,

630 views • 37 slides
International Conference on Planning & the Big 4 Kenya Institute of Planners 8-12 October,

International Conference on Planning & the Big 4 Kenya Institute of Planners 8-12 October,

International Conference on Planning & the Big 4 Kenya Institute of Planners 8-12 October, 2018 Travellers Beach Hotel Day 1 Reflections 10 October, 2018 Structure .. Context Planning for A working and wealthy Nation Delivery

507 views • 35 slides
HOM Transverse Wakefield Studies for CC1 and CC2 (11-08,09-17 Run) Alex Lumpkin, Chip Edstrom,

HOM Transverse Wakefield Studies for CC1 and CC2 (11-08,09-17 Run) Alex Lumpkin, Chip Edstrom,

HOM Transverse Wakefield Studies for CC1 and CC2 (11-08,09-17 Run) Alex Lumpkin, Chip Edstrom, Jinhao Ruan, Randy Thurman-Keup, Olivier Napoly (TD), Kip Bishofberger (LANL), Bruce Carlsten (LANL) FAST/IOTA Dept. Mtg. 17 November 2017

222 views • 19 slides
Fast electronics for Time-Of-Flight with SciFi monitors Inaki Ortega DUNE instrumentation

Fast electronics for Time-Of-Flight with SciFi monitors Inaki Ortega DUNE instrumentation

Fast electronics for Time-Of-Flight with SciFi monitors Inaki Ortega DUNE instrumentation meeting, 12/07/2016, CERN. - The Kirchhoff Institute for Physics in Heidelberg produce an ASIC for SiPM readout, called STiC, to provide high resolution

204 views • 7 slides
GOAL: TRIPLE AIM 2.0 Improved Health and Wellness for the Population Better Lower Cost

GOAL: TRIPLE AIM 2.0 Improved Health and Wellness for the Population Better Lower Cost

DATA SHARING ACROSS AGENCIES AND JURISDICTIONS: IMPROVING PREPAREDNESS AND OUTCOMES CHARLESTON COUNTY, S.C. JANUARY 23, 2015 GOAL: TRIPLE AIM 2.0 Improved Health and Wellness for the Population Better Lower Cost Services for per Capita

470 views • 17 slides
Transforming Education through Personal Empowerment Jaswant Kaur Bajwa, Anna Willats, Jean Choi

Transforming Education through Personal Empowerment Jaswant Kaur Bajwa, Anna Willats, Jean Choi

Transforming Education through Personal Empowerment Jaswant Kaur Bajwa, Anna Willats, Jean Choi George Brown College Theoretical Framework Freirean (1970 / 2000) Transformational Education Knowledge = Exchange Popular Education

214 views • 7 slides
Bremsstrahlung Nice figure from

Bremsstrahlung Nice figure from

Bremsstrahlung Nice figure from http://www.kip.uni-heidelberg.de/~coulon/Lectures/Detectors/Free_PDFs/Lecture2.pdf Range and energy loss of charged particles in matter as a function of momentum

254 views • 9 slides
Status of the Mu3e Detector Dirk Wiedner, Heidelberg On Behalf of the Mu3e Collaboration Dirk

Status of the Mu3e Detector Dirk Wiedner, Heidelberg On Behalf of the Mu3e Collaboration Dirk

Status of the Mu3e Detector Dirk Wiedner, Heidelberg On Behalf of the Mu3e Collaboration Dirk Wiedner, on behalf of the Mu3e collaboration 28.02.2017 1 The Mu3e Signal + e + e - e + rare in SM o Branching ratio <10 -54

1.06k views • 103 slides
Computation of Gravitational Waveforms from Compact Binaries Mark A. Scheel Caltech Saul A.

Computation of Gravitational Waveforms from Compact Binaries Mark A. Scheel Caltech Saul A.

Computation of Gravitational Waveforms from Compact Binaries Mark A. Scheel Caltech Saul A. Teukolsky, PRAC PI Blue Waters Symposium, June 5 2018 Simulations of eXtreme Spacetimes collaboration www.black-holes.org Mark A. Scheel (Caltech)

1.04k views • 25 slides

More recommend