Re Real Time Crowd Navigation From Fi First P Princi ncipl ples - - PowerPoint PPT Presentation

re real time crowd navigation from fi first p princi
SMART_READER_LITE
LIVE PREVIEW

Re Real Time Crowd Navigation From Fi First P Princi ncipl ples - - PowerPoint PPT Presentation

Re Real Time Crowd Navigation From Fi First P Princi ncipl ples o of P Proba babi bility The Theory Pete Trautman and Karankumar Patel Honda Research Institute San Jose, CA, USA What is Crowd Unstructured: no flow rules or static


slide-1
SLIDE 1

Re Real Time Crowd Navigation From Fi First P Princi ncipl ples o

  • f P

Proba babi bility The Theory

Pete Trautman and Karankumar Patel Honda Research Institute San Jose, CA, USA

slide-2
SLIDE 2

What is Crowd Navigation?

  • Unstructured: no flow rules or static obstacles
  • Collect time stamped x,y data (trajectories)
slide-3
SLIDE 3

True Pedestrian Movement: Humans leverage cooperation Goal Desired Path Executed Path Even with perfect future knowledge, “decoupling” prediction and navigation fails

Decoupling leads to Freezing Robot Problem

Optimality Theorems of Autonomous Crowd Navigation. CDC, 2017. [43] P. Trautman and A. Krause. Unfreezing the robot: Navigation in dense interacting crowds. In IROS, 2010.

slide-4
SLIDE 4

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 mgGP # unsafe/# runs: mgIGP # unsafe/# runs: No unsafe runs 5/19 2/30 12/22 6/28 12/16 2/13 17/21 2/7 19/21 4/9 7/8 3/3 8/8 2/2 Average Crowd Density Over Duration of Run (people/m

2)

Fraction of Unsafe Runs % mgGP unsafe: 0.63492, total runs: 126 % mgIGP unsafe: 0.19444, total runs: 108

Large safety decrement at all densities

Decoupling: Suboptimal at any Density

Trautman, P.; Ma, J.; Krause, A.; and Murray, R. M. 2013. Robot navigation in dense crowds: the case for cooperation. In ICRA. Trautman, P. 2013. Robot Navigation in Dense Crowds: Statistical

slide-5
SLIDE 5

Necessity of Coupled Models

<latexit sha1_base64="KQ2r8WailC7q8w2igNKoNxBWeR8=">ACzXicbVFNb9NAEN24fJTwlZYLEpcVEVL5im3UNOmhUgUcuFEQaSslJlqvx8mq3l13d1w1Mum1v4IbV/g/Bs2TlRhykgrjd68tzNvJs4zYTEIfje8tRs3b91ev9O8e+/+g4etjc1DqwvDYcB1ps1xzCxkQsEABWZwnBtgMs7gKD5t6gfnYGxQqsvOMshkmyiRCo4QweNW4+bxRa+DJ/TPTqK0/Rr+fnFvALGrXbQCaqg15NwlbTJKg7G43vo0TzQoJCnjFrh2GQY1Qyg4JnMG+OCgs54ydsAkOXKibBRmVlYU6fOShqTbuKaQV+reiZNLamYwdUzKc2n9rC/B/tWGBaT8qhcoLBMWXjdIio6jpYh80EQY4ZjOXMG6Em5XyKTOMo9tarYtMUuNmTupO7NmkcvJq6n4zBtKoPF96qolB5lM4rUslU7OoxIod6/O6wB9YN4Cfg5ujg4YV6Oj+e6NzR/W5VikYZwisPwEFRvDXlUdfOhfazpvXojrobrfb7fWvzucOutvf2emFV8jhm07Y7QSftv7b1enXSdPyFOyRULSI/vkAzkgA8LJBflBfpJf3kev8L5F0uq1hpHpFaeJd/ACu93ak=</latexit>

u(t + 1) = f R∗(t + 1)

<latexit sha1_base64="ijfA/Af/hQEcZFLiTYLMEOxVNU=">AC/nicbVFNb9NAEN24fBTzlcKRy4oICVUltiulSQ+VKuAtyKRtlJsovV6bK/q3TW76yqRFYk/wpUb6pU/woEL/BU2TogwZaRdjd68tzNvJy4Lpo3v/+g4Wzdu3rq9fce9e+/+g4fdnUenWlaKwpjKQqrzmGgomICxYaA81IB4XEBZ/HFq2X97BKUZlK8N/MSIk4ywVJGibHQtPvWDWPImKhJwTKxu3AnYZyqPXvl0YdfIRDojJOZtN6gy9wWGa4jB0QxDJH+W02/P7fhP4ehKskx5ax8l0p/M5TCStOAhDC6L1JPBLE9VEGUYLWLhpaEk9IJkMLGpIBx0VDeF/iZRKcSmWPMLhB/1bUhGs957FlcmJy/W9tCf6vNqlMOopqJsrKgKCrRmlVYCPx8gNxwhRQU8xtQqhidlZMc6INfabW14kio7c9J2oi+zxslebl9TCtKonq08tcTAyxw+tqWciHlUm4Ydy1lb4I21HcArwc7RN4pUxtK910qWlupRKVJQ1hBoLwMBitEXjUePWxdSL9xr0Sz0cDAYDEeb9dmFHo4ODobBjnd7weDv9uv3f8cr3abfQEPUXPUYCG6Bi9QSdojCi6Qt/RT/TL+eR8cb46Vyuq01lrHqNWON9+A5tH8vA=</latexit>

[f R, h]∗ = arg max

f R,h

p(h, f R | zh

T, zR T)

<latexit sha1_base64="fPabCmh9W643QB9Fic8Ovafwo=">ADF3icbVFNb9QwEPWGrxI+uoUjF4sVEkKwSptd3tAqoADxyKxbaVNtHKcSWI1sY3tlK6i/SEc+C3cUK8c+RNc4YiTjQqhjBRp8ua98cybWBZMG9/PnCuXb9x89bWbfO3Xv3t4c7D460qBSFORWFUCcx0VAwDnPDTAEnUgEp4wKO49PXTf34DJRmgr83KwlRSTLOUkaJsdByGIcxZIzXFLgBtXY/5qDA7UBSsIw/W7uhzDTFLzEOWcMitNHmoVQiFiaUeVUS7obAkz+K5qfruRyO/LHfBr6aBF0yQl0cLncGn8NE0Kq0eloQrReBL01UE2UYLcB2rzRIQk9JBgubclKCjurWjDV+YpEp0LZjxvcon8ralJqvSpjyJyfW/tQb8X21RmXQW1YzLygCnm4fSqsBG4MZnDAF1BQrmxCqmJ0V05w0bln/e6+USarszEl/E32WtZs8z203pSCN6vPNTj0xlDKHD32p9X8V1aZlx+K8L/Dm2g7gSbBzjI0ilbF0740S0lI9KnhqT84paC8DorRF+2OXm3EHrtXon2oPuTyWQ6uzyfPej+bG9vGlwiR7vjYDL23+2ODl51p91Cj9Bj9BQFaIoO0Ft0iOaIogv0A/1Ev5xPzhfnq3OxoTqDTvMQ9cL59hstQf9T</latexit>

where p(h, f R | zh

T, zR T) = ψ(h, f R, γ)p(f R | zR T)p(h | zh T)

<latexit sha1_base64="tukj3hQczMfp5b8iYoiRhnM6Vv8=">AC03icbVHLbtNAFJ2YVwmvFJZIyCJCKlKJ7Yo06a4CFiyLhNtKiYnG4+t4VM+DmXHVYGWDuUT+AG28DP8DTdOVGHKlWwfnXuO565qS65dWH4u+PduHnr9p2tu9179x8fNTbfnxsVWUYxEyVypym1ELJcSOuxJOtQEq0hJO0rO3q/7JORjLlfzoFhoSQeS5xRh9Ss90zvTNPc7OKr+BStP3tTwTMf4ZeXs14/HIRN+dBtAF9sqmj2Xbn+zRTrBIgHSuptZMo1C6pqXGclbDsTisLmrIzOocJQkF2KRugiz9F8hkfq4MPtL5Dfu3o6bC2oVIUSmoK+y/vRX5v96kcvk4qbnUlQPJ1gflVek75a9uxc+4AebKBQLKDMdZfVZQ5nDu2udIrLc4MxZO4k9nzdJdgv8mzGQJ/XFOlPLDEIX8LltFVQukto16lRdtA1BbHGAQAPOMXCGVg7lwTujNEoDpmQOBgOBDeYgwXD2qskYCEyh7LJ7rZqFHgyHw9H4an240IPx/v4oumKO9wbRcB+eN0/fLNZ7RZ5Sp6THRKRETk78kRiQkjl+QH+Ul+ebFXe1+9y7XU62w8T0irvG9/AL4T4YU=</latexit>

p(f R, h1, h2 | z)

<latexit sha1_base64="lolqK5hSVGZR3Ghbm2EjZBkhNV4=">ACzHicbVFNbxMxEHWrxI+msKBAxeLCAmhkN2tSJPeKuDACRWJtJWSbeT1zmatru3Fnq0arfbKv+DEFX4Q/wZnE1UsZSTbozfv2fM8cZELi0Hwu+Pdun3n7r2d+90HDx893u3tPTmxujQcplzn2pzFzEIuFExRYA5nhQEm4xO4v36/rpJRgrtPqCqwIiyZKpIzdNCi92w2j1MzcFt2Hg5oc+5H568XvX4wDJqgN5Nwm/TJNo4Xe53v80TzUoJCnjNrZ2FQYFQxg4LnUHfnpYWC8Qu2hJlLFZNgo6pxUNOXDkloqo1bCmD/q2omLR2JWPHlAwz+29tDf6vNisxnUSVUEWJoPjmobTMKWq6/g6aCAMc85VLGDfC9Up5xgzj6D6t9YpMUuN6TtpO7OWycTLI3G3GQBpVxtPLTHIoOvbalkahV2LBjfdUW+FPrGvALcH0M0bASHd3/YHThqD7XKgXjDIH1l6DACP6m8ehL50LbunsjmoEejkaj8eR6fG6gh5ODg3F4jZzsD8PRMPj8tn/0bjvaHfKcvCvSEjG5Ih8JMdkSjipyQ/yk/zyPnoV69oXqdreYpaYX37Q8yvN6K</latexit>

[f R, h1, h2]∗

<latexit sha1_base64="SXb5lu0WUYqriImUPUPtCG2L8g=">AC1HicbVHLbtNAFJ2YVwmvFJYsIiQioDYRqRJdxUgYFklZKrGg8vk5GnYeZua4SGa9Qt/wBX8AWPoa/YeJEFaZcaSrc+ZOWdOkgtuMQx/t7wrV69dv7Fzs3r9p279zq798dWF4bBiGmhzUlCLQiuYIQcBZzkBqhMBwnp2/W8+MzMJZr9QlXOcSzhXPOKPoFn0RhifU95TtwOJ7A6CqstjDZ9HTatbphr2wLv9yE2bLtnW0Wy39X2alZIUMgEtXYShTnGJTXImYCqPS0s5JSd0jlMXKuoBuXtYLKf+KQ1M+0cUehX6N/M0oqrV3JxG1Kigv72wN/m82KTAbxiVXeYGg2OahrBA+an/9LX7KDTAUK9dQZrjT6rMFNZSh+7zGKzLNjNOcNp3Ys3nt5PnC3WYMZHG53HhqkEHmC/jcpEqVnG5ySDRyYhGFknIMjB6eihoQW69eCt0blbDZhWGRhnCGwBwWGsxe1x0A6F9pW7UtVB3rQ7/cHw4v4XKAHw/39QXSBjF/2on4v/Piqe/h6G+0OeUgekz0SkQE5JB/IERkRs7JD/KT/PLG3hfvq3e+WfVaW84D0ijv2x+LGuN/</latexit>u(t + 1) <latexit sha1_base64="blwaOigrSqGwpV3u23TplfkKV4=">ADL3icbVFNb9NAEF0bKCV8NIUjlxUpEgdInEp0hMVcOixSKStlFjRej2OV/Xumt1xaWrlp/Aj+DWIC+qVf8HaiSJMO9JKo5n3dubNi/JMWAyCX5/7/6DrYfbj1qPnzx9tPefX5qdWE4jLnOtDmPmIVMKBijwAzOcwNMRhmcRcfq/7ZJRgrtPqCixCyeZKJIzdKVZ+3oawVyoUiBIcQ3L1rTK6BRknpZnKcMlYVFujcVCsEwXtHSPSp1DNn7BvpYf1tSztTdWCrQwUHFm1GzdifoBnXQ20l/nXTIOk5mu973ax5IUEhz5i1k36QY1gyg4Jn1e6FhZzxCzaHiUsVk2Dsj7Skr52lZgm2rinkNbVfxklk9YuZOSQkmFq/+9Vxbt6kwKTUVgKlRcIiq8GJUVGUdPq4jQWBjhmC5cwboTblfKUVedxvjSmyDgxbue4qcRezmslb1P3mzGQhOXVSlODXHkAX5tUydQiLFGR/qSeiNrVugl4Pbo4uGFejgvU9G5w7a41olYJwgsL05KDCv6s19qRToe2ydStqQw8Hg8FwtLHPGXo4OjgY9jeV0/1uf9ANPu93j6srd0mL8kr8ob0yZAckWNyQsaEkxtvy9vx2v4P/6f/279ZQX1vzXlBGuH/+QtnIwWn</latexit>
  • What must ψ(h, f R, γ) model?
  • How can ψ(h, f R, γ) model it?
slide-6
SLIDE 6

The How and What of Interaction

<latexit sha1_base64="thn/57XmCLriaYEJyA4S2ezTm3Y=">ADQHicbVHLbtNAFB2bVwmvFBYs2AxUSK0EsVMpTcqogixQqItJUSKxqPr51R52FmxlEsK1/AN/Az/AV/wA51y4qJEypMuavrc+/xuWdOnHNmbBh+9/xr12/cvLV1u3Xn7r37D9rbD0+MKjSFEVc6bOYGOBMwsgy+Es10BEzOE0Pj9ezU/noA1T8pMtc4gEySRLGSXWQdP2l0kMGZMVBWlBL1sTqZhM3MfEwsLGaXWstOKc6PLVEr9nRqhkpZXhlMOCxYwzW2IOJDHYKkz2sHJqJMs0GMPmgJXG8RqkpHCShcG7bz8O97BWsbK4NQGZ/BGftnfCTlgXvtp0N80O2tRwu19nSKFsLxKSfGjLthbqOKaMsoB+emMJATek4yGLtWEgEmqupXW+LnDklw6i5MlbS4Rv9mVEQYU4rYbQpiZ+bf2Qr832xc2HQVUzmhQVJ10JpwVcPtIoAJ0wDtbx0DaGauVsxnRFNqHuEpopIUu1uTpOzDyrnbyYub9pDWlULdaeGmQ+Qw+N6mCyDKqbL0dq0WTEIyMOyDIwd3Rsdrl5daDN1rlbjWgSqagnSEwQYSNKMva4+BcC6UWbauVB3oYa/X6w8u43OBHg4ODvrdS+Rkv9PtdcIP+ztHrzfRbqEn6BnaRV3UR0foHRqiEaLownvsYe+p/83/4f/0L9arvrfhPEKN8n/9BkMaDRc=</latexit>Corollary: Mismodeling flexibility leads to a) overaggressive or b)
  • vercautious (FRP) robot
<latexit sha1_base64="Sw/fRlM8S848N4kMBftPTRavk=">AEFXicbVJLb9QwE5YHmV5tXDkYtEitVLZR6Xtg1PVcuBYRLet1KxWjPJWvUj2M52V1F+Byd+CjfUK2f+A1c4M0mjpaGMZGk814vkcpoJb1+v98O+07t67/2DpYfvR4ydPny2vPD+xOjMhkwLbc5CakFwBUPHnYCz1ACVoYDT8OKwzJ9OwViu1bGbpzCSNFE85ow6DI1X/HEQsJVzkA5MEU7UJqrC+Bg5kL4/x4AtqAfFuQ6MvI6LolCdVNWHaOsItsQ7v1mFTIeZkSgWPyFrA43iNBEG7QgUg0mulZgXhJI4U6zqoGPiJlBn40yIglhwZVjymcsM/O1t65bYce0wODJepDhoCY0lEehDIzYt1tbJZezC9KtxjnFYucIzflLKGOFMQVzcL4ErELKG4vBgOKQVFsNoEfeSLpTWwsYMZDLribF0U50kZFOAVLfY5Xl7tdXqVkdtOv3ZWvdqOUJIvQaRZJrEBE9Ta834vdaOcGlyCAFQos5BSdkETOEdXUQl2lFdfoSCvMRKRWBs8ypEqerMip9LauQwRKamb2H9zZfB/ufPMxbsjXGSa4SrZ9UMoGHGalP+KRNwAcyh/xCkzHGclbEJxc7iF5isyig3OHDWZ2GlSMdmcYDeDIozy2TWnRnH5UeBTs1RSNR/lrkKHetYs6A4tDtBNAefoOEMzh/DuO6NThHaZVrXatpuAsPZm4pjVyILbYv2LasE3RsMBju7C/lQ0L3d7e2d/iJystXpDzq9D1ur+we1tEveS+Vt+71vR1v3vHXlDj/lX/k/l/+79bn1tfWtdXUNvePXNS+8hrW+/wFZfF7y</latexit>Theorem: Crowd navigation cost is statistically valid ⇐

⇒ cost only a function of the full set of mixture statistics ⇐ ⇒ C ⇣ µR

` (t), µf i k (t),

| {z }

intents at t

w(t) |{z}

preference

, Σ(t) |{z}

flexibility

<latexit sha1_base64="ruFEBLr3N4b4SI1g1F5oSOqM6VU=">ADnXicbVLbtNAELUbLiVcmsIjD6xIkHiAXCqlSd8qLhIPqAoSaSvVUbRej51V92J212mCZf6ED+MP+AzGdqhIy0grzZ65npkJU8Gt6/d/+TuNO3fv3d90Hz46PGTvdb+01OrM8NgyrTQ5jykFgRXMHXcCThPDVAZCjgL9+X9rMlGMu1+urWKcwkTRSPOaMOoXnrdxBCwlXOQDkwRTNwsHJV2txAVOTNjZ07kPw7oIMBVdMS0lVlAeChli7NBZ5JzA8WThqjL7qoGcJk4nRSx4BsQ4rWoeFhViTJRU8IrysSVnZCYkzVSudIFXa8STt3MhACRITxHEJROg6j07xi6DVAlk2A8Ce/rZa1N8Ns3mr3e/2KyG3lcFGaXsbmcz3/Z9BpFkmMZ4Jau3FoJ+6WU4NkhDlJDILKWXNIELVBWVYGd5NbuCvEIkIrE2+JQjFfpvRE6ltWsZoqekbmFv2krwf7aLzMXjWc5VmjlQrC4UZzgWTcr9kogbYA5HE3HKDMdeCVvQcsp4BVtVZBQb7DnaZmKXScXkzQKzGQPxLF/VnLaCQaYL+LYdihexnuX19YR6tR3Qm1psoJcC9tF1hmYO3XsfjE7Rtce0igEvi4HtJXhghrO3FceRBbaFs1bUi30aDgcjsbX68OFHo0PD0eDa+T0oDsYdvtfDtrH7zar3fWey+9197AG3nH3idv4k095p/4zi/8H40XjY+Nz42T2nXH38Q87akcfYHB1QwPQ=</latexit>

→ Provide statistically valid interaction function PIGP

¬κ

→ Provide a real time locally optimal solver

slide-7
SLIDE 7

Crowd Navigation Evaluation Challenges

  • Real world deployment

expensive: 6 months-year to deploy statistically valid study

  • ORCA, Social Forces based

simulation non-discriminative

  • Optimal policy is ”blind, straight

line”

ORCA sim collision rate, 0.05-0.25 people/m^2

slide-8
SLIDE 8

ETH: 241 runs “Leave one out” evaluation:

  • Remove 1 human
  • Start and goal
  • Compare

safety/efficiency of robot and human

slide-9
SLIDE 9

Evaluation: Partial Runs

(a) (b)

slide-10
SLIDE 10

Conclusion

  • Provided constraints on permissible

interaction functions (for GP mixtures)

  • Flexibility key to mitigating freezing

robot problem

  • Provided a discriminative evaluation

scenario Next steps:

  • Deploy in real world