Continuous-time Stochastic Grey-box Model of the Nonlinear Feedback - - PowerPoint PPT Presentation

continuous time stochastic grey box model of the
SMART_READER_LITE
LIVE PREVIEW

Continuous-time Stochastic Grey-box Model of the Nonlinear Feedback - - PowerPoint PPT Presentation

Continuous-time Stochastic Grey-box Model of the Nonlinear Feedback System based on Residual Analysis Rune Grnborg Junker Workshop on Nonlinear Benchmarks TU Eindhoven, April, 10, 2019 Rishi Relan 28 March 2019 DTU Compute 1 Modelling


slide-1
SLIDE 1

DTU Compute 28 March 2019

Continuous-time Stochastic Grey-box Model of the Nonlinear Feedback System based on Residual Analysis Rune Grønborg Junker Rishi Relan

1

Workshop on Nonlinear Benchmarks TU Eindhoven, April, 10, 2019

slide-2
SLIDE 2

DTU Compute 28 March 2019

Modelling Philosophies

2

slide-3
SLIDE 3

DTU Compute 28 March 2019

Silverbox Benchmark

3

m¨ x(t) + d ˙ x(t) + k1x(t) + k3x3(t) = u(t),

<latexit sha1_base64="CPNKUJxJDu7WBncys+oG4e96xk=">ACHXicbVDLSgMxFM3UV62vqks3wSJUlDLTFnQjFN24rGAf0I5DJpO2oZkHyR1pGfojbvwVNy4UceFG/BvTB6itB8I9OfeR3ONGgiswzS8jtbS8srqWXs9sbG5t72R39+oqjCVlNRqKUDZdopjgAasB8GakWTEdwVruP2rcb5xz6TiYXALw4jZPukGvMpAS052bLf9rwQksEoD8cn2Gv/XPqONZjG0uCupBm+wLEOpxknmzML5gR4kVgzkMzVJ3sh5LY58FQAVRqmWZEdgJkcCpYKNMO1YsIrRPuqylaUB8puxkst0IH2nFw51Q6hMAnqi/OxLiKzX0XV3pE+ip+dxY/C/XiqFzbic8iGJgAZ0+1IkFhCPrcIel4yCGpCqOT6r5j2iCQUtKFjE6z5lRdJvViwSoXiTlXuZzZkUYH6BDlkYXOUAVdoyqIYoe0BN6Qa/Go/FsvBnv09KUMevZR39gfH4D1kefLQ=</latexit>
slide-4
SLIDE 4

DTU Compute 28 March 2019

Stochastic Differential Equations

4

dXt = ft(Xt, Ut, t, θ)dt | {z }

Drift

+ σt(Xt, Ut, t, θ)dWt | {z }

Diffusion

,

<latexit sha1_base64="2KlTFU3zWPGmceOLaGKSMVW5+c=">ACeHicbVFNT9tAEF2btC0lNAeuawaUEFEkR2Q2gsSohw4gkRIpDiy1utxsp6be2OUSPLv4H/xq0/hAsnNokRnyON9PRm3uzsmyiXwqDn/XfclQ8fP62ufW58+br+baO5+f3KZIXm0OZzPQgYgakUNBDgRIGuQaWRhL60fTvN6/Bm1Epi5xlsMoZWMlEsEZWips3tA4R+WcTUIkR7RoFAx6EgzDmUS4q5l2z2b2A5wAsj2HtuxCpfwVIsEK7r/QhoYMU5ZrafvDuiHTyNEkhTzFat2Gx5HW8R9C3wa9AidZyHzdsgzniRgkIumTFD38txVDKNgkuoGkFhIGd8ysYwtFCxFMyoXBhX0R3LxDTJtE2FdME+V5QsNWaWRrYzZTgxr2tz8r3asMDkz6gUKi8QF8+lBSYkbnV6Cx0MBRzixgXAu7K+UTZq1De6uGNcF/eW34Krb8Q863YvD1vFJbca2SI/yS7xyW9yTM7IOekRTu6cLWfb2XHuXer+cveWra5Ta36QF+F2HwBL0cHj</latexit>

Ytk = gtk(Xtk, Utk, tk, θ) + etk |{z}

Measurement noise

,

<latexit sha1_base64="avq70iNCGhQ9n6XLG2uAeWxiCA=">ACUHicbVFNaxsxEJ1mo+6+XCTYy+iJpASY3bdQnIJhPTSyGFOnHwmkUrj21hrXaRZkPNsj8xl9zyO3rJoaXVel1okz6Q5vFmRho9xZmSlnz/wWusvVjf2Nx62Xy1vbO713q9f2XT3Ajsi1SlZhBzi0pq7JMkhYPMIE9ihdfx/GOVv75FY2Wqv9Iiw1HCp1pOpODkpKg1ZTVuoKiecnYGZvW9GhQx05/Fd3WCWmGxN+xYxbmeowmNlxgXVFGYWE36j4jNzmBhPUxHQqLZadZtRq+1/CfacBCvShUuo9Z9OE5FXh0iFLd2GPgZjQpuSAqFZTPMLWZczPkUh45qnqAdFUtDSnbolDGbpMYtN8RS/buj4Im1iyR2lQmnmX2aq8T/5Y5TU5HhdRZTqhFfdEkV4xSVrnLxtKgILVwhAsj3axMzLgzidwfVCYET5/8nFz1usH7bu/Lh/b5xcqOLXgDb+EIAjiBc/gEl9AHAXfwHX7AT+/e/R+Nby69E+EA/gHjeZvhK+zwA=</latexit>

θ ∈ Θ ⊂ Rp

<latexit sha1_base64="Vt9lcBLYl4FcUmrzeRGe5IQ7RQ=">ACD3icbZC7SgNBFIZnvcZ4i1raDAbFKuxGQcugjWU3CAbw+zkJBkyO7vMnBXCkjew8VsLBSxtbXzbZxcCk38YeDjP+cw5/xBLIVB1/12lpZXVtfWMxvZza3tnd3c3n7NRInmUOWRjHQjYAakUFBFgRIasQYWBhLqweB6XK8/gDYiUhUcxtAKWU+JruAMrdXOnfjYB2TUF4r6lSmaJDCA1A8Z9oMgvRvdx+1c3i24E9F8GaQJzOV27kvxPxJASFXDJjmp4bYytlGgWXMr6iYGY8QHrQdOiYiGYVjq5Z0SPrdOh3Ujbp5BO3N8TKQuNGYaB7RzvaOZrY/O/WjPB7mUrFSpOEBSftRNJMWIjsOhHaGBoxaYFwLuyvlfaYZRxth1obgzZ+8CLViwTsrFG/P86WrWRwZckiOyCnxyAUpkRtSJlXCySN5Jq/kzXlyXpx352PauTMZg7IHzmfP7OtnHY=</latexit>

etk ∈ N(0, Stk(Utk, tk, θ))

<latexit sha1_base64="zHs9+HV3fyzf5H18X2hPCzWoX+E=">ACI3icbVDLSgMxFM34rPVdekmWIQWSplRQXElunElFW0VOmXIpLdtaCYzJHeEMvRf3PgrblwoxY0L/8X0sfB1IbmHc+4lOSdMpDouh/O3PzC4tJybiW/ura+sVnY2m6YONUc6jyWsb4PmQEpFNRoIT7RAOLQgl3Yf9irN89gDYiVrc4SKAVsa4SHcEZWionEKQYdAfUl8o6kcMe5zJ7GpYciv0ZiqV6tNeofauUB97gKxcpkGh6FbdSdG/wJuBIplVLSiM/HbM0wgUcsmMaXpugq2MaRcwjDvpwYSxvusC0LFYvAtLKJxyHdt0ybdmJtj0I6Yb9vZCwyZhCFdnLswvzWxuR/WjPFzkrEypJERSfPtRJcWYjgOjbaGBoxYwLgW9q+U95hmHG2seRuC9vyX9A4qHqH1YPro+LZ+SyOHNkle6REPHJMzsglqZE64eSRPJNX8uY8OS/OyHmfjs45s50d8qOczy8BHaM0</latexit>

Xt ∈ X ⊂ Rn

<latexit sha1_base64="hb2nARE+qc3xor3yPM/EA+axkQ=">ACEXicbVDLSgMxFM3UV62vqks3wSJ0VWaqoMuiG5dV7AM6tSRp2oZmMkNyRyhDf8GNv+LGhSJu3bnzb8y0s9DWA4HDOeSew+NpDgut9ObmV1bX0jv1nY2t7Z3SvuHzRNGvGyUoW5TYrgUijdAgOTtSHMSUMlbdHyV+q0Hro0I1R1MIt4NyFCJgWAErNQrlts9wL5Q2A8IjBiRSXuKfRNTw2GuUZrcTu9tORW3BnwMvEyUkIZ6r3il98PWRxwBUwSYzqeG0E3IRoEk3xa8GPDI8LGZMg7lioScNZhdN8YlV+ngQavsU4Jn6eyIhgTGTgNpkuqNZ9FLxP68Tw+CimwgVxcAVm380iCWGEKf14L7QnIGcWEKYFnZXzEZEwa2xItwVs8eZk0qxXvtFK9OSvVLrM68ugIHaMy8tA5qFrVEcNxNAjekav6M15cl6cd+djHs052cwh+gPn8weAjp1</latexit>

Wt = (W 1

t , W 2 t , · · · , W m t )T ∈ Rm

<latexit sha1_base64="nJFXjlrheozQMxlw+mgKD3y5MFc=">ACHicbVDLSgMxFM3UV62vqks3wSIoSJlpBd0IRTcuq7SdQqcdMmnahmYyQ3JHKEM/xI2/4saFIm5cCP6N6WOh1gMJ+fcS+49QSy4Btv+sjJLyura9n13Mbm1vZOfnevoaNEUVankYhUMyCaCS5ZHTgI1owVI2EgmBsMrye+e8+U5pGswShm7ZD0Je9xSsBIfr7s+oAv8bHbcXw4dTslc3u0G4E2j9CHk04Ne1xiLyQwCIL0bmzUfMEu2lPgReLMSQHNUfXzH143oknIJFBtG45dgztlCjgVLBxzks0iwkdkj5rGSpJyHQ7nS43xkdG6eJepMyRgKfqz46UhFqPwsBUTmbUf72J+J/XSqB30U65jBNgks4+6iUCQ4QnSeEuV4yCGBlCqOJmVkwHRBEKJs+cCcH5u/IiaZSKTrlYuj0rVK7mcWTRATpEx8hB56iCblAV1RFD+gJvaBX69F6t6s91lpxpr37KNfsD6/Ad0AoA4=</latexit>

Ytk ∈ Y ⊂ RL

<latexit sha1_base64="w3z4tdLo21OJR6jWrFZL8fgwky8=">ACF3icbVC7TgMxEPTxDOEVoKSxEiHREN2FAsoIGgqKgMhLSTj5HCex4vOd7D2k6HR/QcNfUNQgICBiQK/gbnUDCSJbGM7va3fFCwTXY9rc1N7+wuLScWkmvrq1vbGa2tis6iBRlZRqIQNU8opngkpWBg2C1UDHie4JVvf7p0K/eMKV5IK9gELKWT7qSdzglYCQ3k6+7Mbj9BDe5xE2fQI8SEdfNX0eZjDWPC+TK7j8TN5Oy8PQKeJc6E5IrZ9f7g/pXyc18NtsBjXwmgQqidcOxQ2jFRAGngiXpZqRZSGifdFnDUEl8plvx6K4E7xmljTuBMk8CHqm/O2Liaz3wPVM53FJPe0PxP68RQe4FXMZRsAkHQ/qRAJDgIch4TZXjIYGEKo4mZXTHtEQomyrQJwZk+eZUCnMF+4MGmcoDFSaBdl0T5y0BEqojNUQmVE0S16QE/o2bqzHq0X621cOmdNenbQH1gfPxy4pEc=</latexit>
slide-5
SLIDE 5

DTU Compute 28 March 2019

Stochastic Differential Equations

5

Ytk = gtk(Xtk, Utk, tk, θ) + etk |{z}

Measurement noise

,

<latexit sha1_base64="avq70iNCGhQ9n6XLG2uAeWxiCA=">ACUHicbVFNaxsxEJ1mo+6+XCTYy+iJpASY3bdQnIJhPTSyGFOnHwmkUrj21hrXaRZkPNsj8xl9zyO3rJoaXVel1okz6Q5vFmRho9xZmSlnz/wWusvVjf2Nx62Xy1vbO713q9f2XT3Ajsi1SlZhBzi0pq7JMkhYPMIE9ihdfx/GOVv75FY2Wqv9Iiw1HCp1pOpODkpKg1ZTVuoKiecnYGZvW9GhQx05/Fd3WCWmGxN+xYxbmeowmNlxgXVFGYWE36j4jNzmBhPUxHQqLZadZtRq+1/CfacBCvShUuo9Z9OE5FXh0iFLd2GPgZjQpuSAqFZTPMLWZczPkUh45qnqAdFUtDSnbolDGbpMYtN8RS/buj4Im1iyR2lQmnmX2aq8T/5Y5TU5HhdRZTqhFfdEkV4xSVrnLxtKgILVwhAsj3axMzLgzidwfVCYET5/8nFz1usH7bu/Lh/b5xcqOLXgDb+EIAjiBc/gEl9AHAXfwHX7AT+/e/R+Nby69E+EA/gHjeZvhK+zwA=</latexit>

θ ∈ Θ ⊂ Rp

<latexit sha1_base64="Vt9lcBLYl4FcUmrzeRGe5IQ7RQ=">ACD3icbZC7SgNBFIZnvcZ4i1raDAbFKuxGQcugjWU3CAbw+zkJBkyO7vMnBXCkjew8VsLBSxtbXzbZxcCk38YeDjP+cw5/xBLIVB1/12lpZXVtfWMxvZza3tnd3c3n7NRInmUOWRjHQjYAakUFBFgRIasQYWBhLqweB6XK8/gDYiUhUcxtAKWU+JruAMrdXOnfjYB2TUF4r6lSmaJDCA1A8Z9oMgvRvdx+1c3i24E9F8GaQJzOV27kvxPxJASFXDJjmp4bYytlGgWXMr6iYGY8QHrQdOiYiGYVjq5Z0SPrdOh3Ujbp5BO3N8TKQuNGYaB7RzvaOZrY/O/WjPB7mUrFSpOEBSftRNJMWIjsOhHaGBoxaYFwLuyvlfaYZRxth1obgzZ+8CLViwTsrFG/P86WrWRwZckiOyCnxyAUpkRtSJlXCySN5Jq/kzXlyXpx352PauTMZg7IHzmfP7OtnHY=</latexit>

etk ∈ N(0, Stk(Utk, tk, θ))

<latexit sha1_base64="zHs9+HV3fyzf5H18X2hPCzWoX+E=">ACI3icbVDLSgMxFM34rPVdekmWIQWSplRQXElunElFW0VOmXIpLdtaCYzJHeEMvRf3PgrblwoxY0L/8X0sfB1IbmHc+4lOSdMpDouh/O3PzC4tJybiW/ura+sVnY2m6YONUc6jyWsb4PmQEpFNRoIT7RAOLQgl3Yf9irN89gDYiVrc4SKAVsa4SHcEZWionEKQYdAfUl8o6kcMe5zJ7GpYciv0ZiqV6tNeofauUB97gKxcpkGh6FbdSdG/wJuBIplVLSiM/HbM0wgUcsmMaXpugq2MaRcwjDvpwYSxvusC0LFYvAtLKJxyHdt0ybdmJtj0I6Yb9vZCwyZhCFdnLswvzWxuR/WjPFzkrEypJERSfPtRJcWYjgOjbaGBoxYwLgW9q+U95hmHG2seRuC9vyX9A4qHqH1YPro+LZ+SyOHNkle6REPHJMzsglqZE64eSRPJNX8uY8OS/OyHmfjs45s50d8qOczy8BHaM0</latexit>

Xt ∈ X ⊂ Rn

<latexit sha1_base64="hb2nARE+qc3xor3yPM/EA+axkQ=">ACEXicbVDLSgMxFM3UV62vqks3wSJ0VWaqoMuiG5dV7AM6tSRp2oZmMkNyRyhDf8GNv+LGhSJu3bnzb8y0s9DWA4HDOeSew+NpDgut9ObmV1bX0jv1nY2t7Z3SvuHzRNGvGyUoW5TYrgUijdAgOTtSHMSUMlbdHyV+q0Hro0I1R1MIt4NyFCJgWAErNQrlts9wL5Q2A8IjBiRSXuKfRNTw2GuUZrcTu9tORW3BnwMvEyUkIZ6r3il98PWRxwBUwSYzqeG0E3IRoEk3xa8GPDI8LGZMg7lioScNZhdN8YlV+ngQavsU4Jn6eyIhgTGTgNpkuqNZ9FLxP68Tw+CimwgVxcAVm380iCWGEKf14L7QnIGcWEKYFnZXzEZEwa2xItwVs8eZk0qxXvtFK9OSvVLrM68ugIHaMy8tA5qFrVEcNxNAjekav6M15cl6cd+djHs052cwh+gPn8weAjp1</latexit>

Wt = (W 1

t , W 2 t , · · · , W m t )T ∈ Rm

<latexit sha1_base64="nJFXjlrheozQMxlw+mgKD3y5MFc=">ACHicbVDLSgMxFM3UV62vqks3wSIoSJlpBd0IRTcuq7SdQqcdMmnahmYyQ3JHKEM/xI2/4saFIm5cCP6N6WOh1gMJ+fcS+49QSy4Btv+sjJLyura9n13Mbm1vZOfnevoaNEUVankYhUMyCaCS5ZHTgI1owVI2EgmBsMrye+e8+U5pGswShm7ZD0Je9xSsBIfr7s+oAv8bHbcXw4dTslc3u0G4E2j9CHk04Ne1xiLyQwCIL0bmzUfMEu2lPgReLMSQHNUfXzH143oknIJFBtG45dgztlCjgVLBxzks0iwkdkj5rGSpJyHQ7nS43xkdG6eJepMyRgKfqz46UhFqPwsBUTmbUf72J+J/XSqB30U65jBNgks4+6iUCQ4QnSeEuV4yCGBlCqOJmVkwHRBEKJs+cCcH5u/IiaZSKTrlYuj0rVK7mcWTRATpEx8hB56iCblAV1RFD+gJvaBX69F6t6s91lpxpr37KNfsD6/Ad0AoA4=</latexit>

dXt = ft(Xt, Ut, t, θ)dt | {z }

Drift

+ σt(Ut, t, θ)dWt | {z }

Diffusion

,

<latexit sha1_base64="f2sgEWK6mex8SehMqiohe5oYHI=">ACfHicdVHbTtwEHUCpbAtdEsfecDiIi1iWSVUon2phGgf2retxF6kzSpynMmuheNE9gR1FeUr+k98AG98Ci+ozi4V5dKRPDo6M8cen4lyKQx63o3jLi2/Wnm9utZ483Z9413z/WbfZIXm0OZzPQwYgakUNBDgRKGuQaWRhIG0cXuj64BG1Eps5xlsM4ZRMlEsEZWips/qY0QPiFZVwNQ6RfaFCoGHSkGYcyCUusWsM6t3vzjO0Ap4Ds4K8Iq3ABv2mRYEUPH10QGDFJWYit/6gH4YNeJElRj1m1w+au1/HmQZ8D/x7snav4u34R78bNq+DONFCgq5ZMaMfC/Hck0Ci6hagSFgZzxCzaBkYWKpWDG5dy8iu5bJqZJpu1RSOfsv4qSpcbM0sh2pgyn5mtJl+qjQpMPo9LofICQfHFQ0khKWa03gSNhQaOcmYB41rYWSmfMusb2n01rAn+0y8/B/3jv+xc/zTunFGFrFKtsgOaRGfCKn5Dvpkh7h5NbZdlrOgXPn7rmH7tGi1XuNR/Io3BP/gCpMds</latexit>

Ytk ∈ Y ⊂ RL

<latexit sha1_base64="w3z4tdLo21OJR6jWrFZL8fgwky8=">ACF3icbVC7TgMxEPTxDOEVoKSxEiHREN2FAsoIGgqKgMhLSTj5HCex4vOd7D2k6HR/QcNfUNQgICBiQK/gbnUDCSJbGM7va3fFCwTXY9rc1N7+wuLScWkmvrq1vbGa2tis6iBRlZRqIQNU8opngkpWBg2C1UDHie4JVvf7p0K/eMKV5IK9gELKWT7qSdzglYCQ3k6+7Mbj9BDe5xE2fQI8SEdfNX0eZjDWPC+TK7j8TN5Oy8PQKeJc6E5IrZ9f7g/pXyc18NtsBjXwmgQqidcOxQ2jFRAGngiXpZqRZSGifdFnDUEl8plvx6K4E7xmljTuBMk8CHqm/O2Liaz3wPVM53FJPe0PxP68RQe4FXMZRsAkHQ/qRAJDgIch4TZXjIYGEKo4mZXTHtEQomyrQJwZk+eZUCnMF+4MGmcoDFSaBdl0T5y0BEqojNUQmVE0S16QE/o2bqzHq0X621cOmdNenbQH1gfPxy4pEc=</latexit>
slide-6
SLIDE 6

DTU Compute 28 March 2019

Maximum Likelihood Estimation

6

One-Step Ahead Prediction Error:

L(✓; YN) = p(YN|✓) = N Y

k=1

exp ⇣ − 1

2✏T tkR−1 tk|tk−1✏tk

⌘ q det(Rtk|tk−1)( √ 2⇡)L ! p(y0|✓) = −1 2

N

X

k=1

⇣ ✏T

tkR−1 tk|tk−1✏tk + log detR−1 tk|tk−1 + L log 2⇡

<latexit sha1_base64="GgY5Eb1AVhRFR13yjnUxBzv+rms=">ADlXiclVJb9MwFE4TLqNc1o0HnixqECJUKukIDEJVRoFIR6mMaZ1G6rbyHd1qpzwXbQKs+/iH/DG/8G5wKs3V4UqRzvMd+/ucE2WMCun7vxq2c+v2nbtb95r3Hzx8tN3a2T0Vac4xGeKUpfw8QoIwmpChpJKR84wTFEeMnEXL90X/7DvhgqbJiVxlZByjeUJnFCNpoHCn8QPGSC6iSB1oF8oFkehtiWDE1FcdHnrgR9k7hp2WRE9ACFogiIMBw7ofO4CmPF0GqplP9ATdagBnHGEFSQXWUFwO1UdaNXTkGSCMqNCyXCpJyfHE9UJdFldSnOEKTY4xRGeVlB841LBKZHu8Trdc6tez+ig2puov7oPtIlSo5e5q9D/4wEmaZLHEeHGTO0F9EHXNUp8rh2dFjadP9fOXgJIEvnAEpyIZVRrsFNQwXtn+JqpGeslNd6Yavtd/0ywPUkqJO2VcdR2PoJpynOY5JIzJAQo8DP5FghLilmRDdhLkiG8BLNycikCYqJGKtyqzR4bpApmKXcfIkEJXp1QqFYiFUcGWYhWz2CvCm3iXs72xokmWS5Lg6qJZzoBMQbGiYEo5wZKtTIwp0YrwAtkfoc0i9w0jxBsWr6enPa6watu78vr9v6gfo4t6n1zHKtwHpj7VufrCNraGF7196z39kD54nTdz4Hyuq3ahnHltr4Xz+DU3wJZk=</latexit>
slide-7
SLIDE 7

DTU Compute 28 March 2019 7

N

X

k=1

⇣ F(xk, U, θ|x0, θ0) − yk ⌘2

<latexit sha1_base64="5RkjGd+S797FGdprAi9mN0Ik4v0=">ACNXicbVDLSsNAFJ34rPFVdelmsAgVtCRV0I1QKogLkQq2Ck0Nk+m0HTJ5MHMjLTE/5cb/cKULF4q49RdM2gq+DgwczrmHO/c4oeAKDONJm5icmp6Zzc3p8wuLS8v5ldWGCiJWZ0GIpBXDlFMcJ/VgYNgV6FkxHMEu3Tco8y/vGFS8cC/gEHIWh7p+rzDKYFUsvOnlo8O3YPzeQ6Pktiq8q7Rcsj0KNExMdJsW+727i+jS3oMSC3fdv4raxtTOw3SyxdV1OdF238wWjZAyB/xJzTApojJqdf7DaAY085gMVRKmaYTQiokETgVLdCtSLCTUJV3WTKlPKZa8fDqBG+mSht3Apk+H/BQ/Z6IiafUwHPSyewe9dvLxP+8ZgSdg1bM/TAC5tPRok4kMAQ4qxC3uWQUxCAlhEqe/hXTHpGEQlp0VoL5+S/pFEumbul8vleoVId15FD62gDFZGJ9lEFnaAaqiOK7tAjekGv2r32rL1p76PRCW2cWUM/oH18AhAmqaU=</latexit>

Maximum Likelihood Estimation

Simulation Error:

log L =

N

X

k=1

⇣ F(xk, U, θ|xo, θ0) − yk ⌘2 σ2

k

− log YN

<latexit sha1_base64="kZs7wsYqGonOtAvZF3VKoxDT4=">ACaHicbVFdSxwxFM2M/bCrVNtKaUvwaWwgi4zq6AvglgofShiwVXLZg2ZbGY2TDIZkoy4pEP/Y9/6A/rSX9HMui2t9kLg5Nx7r05SvBjY3j70G49ODho8fLTzorq0+frUXP18+NqjVlQ6qE0pcpMUzwkg0t4JdVpoRmQp2kRbv2vzFNdOGq/LMzio2liQvecYpsZ7C0VckVI4ksdM0dR8beAiRqSV2BTxMmit30qBME+rQMc978zJKhHvf9G5wsQ2H2xDZKbPkC7zB6vcFx1s7M1y0kq2rQeOQ4bkuPB458+0ts1nfNLgqBv343nA+yBZgC5YxCmOvqGJorVkpaWCGDNK4sqOHdGWU8GaDqoNqwgtSM5GHpZEMjN2c6Ma+NYzE5gp7U9p4Zz9W+GINGYmU1/ZLmnu5lryf7lRbODseNlVtW0tBWS2gVbB1HU64ZtSKmQeEau53hXRKvLPW/03Hm5DcfJ9cD7oJ7v9wae97tHxwo5l8AZsgh5IwD4Ah/AKRgCn4EK8GL4GXwM4zCV+Hr29IwWGg2wD8Rbv4Cpya46g=</latexit>
slide-8
SLIDE 8

DTU Compute 28 March 2019

Physical Model

8

dXt = Vtdt + σxdW 1

t

dVt = (−a1Vt + k1Xt + k3X3

t + b1ut)dt + σvdW 2 t

Ytk = Xt + etk

<latexit sha1_base64="pGohZyIMp2/B7HdwtAW6/vfyudE=">AClXicbZHbatAEIZXatqm7slNL3qRm6WmJSXUaO1CcxNI0xJylxTqQ7GcZbUeO4tXB3ZHIUbojfI0uevbdGUptDkMCL7959f0myUaWUxCP54/qONx0+ebj5rPX/x8tXr9putoU1zI2EgU52acSQsaJXABVqGcGRBxpGEXL71V/dAHGqjT5hasMprFYJGqupEAn8fZViHCJxawc6Qf9+mQY6NgSXdpaNUiFvyS3thGZ8w5wtbNeViP7XwWnFW8S5ecjRvoOzjrO4w4oznHTw9EX/yLduYedm/eYF8WVa5dRLUQou3O0E3WBe9D6yBDmnqlLevw1kq8xgSlFpYO2FBhtNCGFRSQ9kKcwuZkEuxgInDRMRgp8V6qyX94JQZnafGPQnStfr/RCFia1dx5JyxwHN7t1eJD/UmOc73poVKshwhkfWL5rmNLqiuhMGZCoVw6ENMp9K5XnwgiJ7iKrJbC7v3wfhr0u63d7P790Dg6bdWySbfKe7BGvpIDckxOyYBIb8vb875h/47f9/4R/Vt9rZt6SW+Wf/AVM2MT5</latexit>

Model 1:

m¨ x(t) + d ˙ x(t) + k1x(t) + k3x3(t) = u(t),

<latexit sha1_base64="CPNKUJxJDu7WBncys+oG4e96xk=">ACHXicbVDLSgMxFM3UV62vqks3wSJUlDLTFnQjFN24rGAf0I5DJpO2oZkHyR1pGfojbvwVNy4UceFG/BvTB6itB8I9OfeR3ONGgiswzS8jtbS8srqWXs9sbG5t72R39+oqjCVlNRqKUDZdopjgAasB8GakWTEdwVruP2rcb5xz6TiYXALw4jZPukGvMpAS052bLf9rwQksEoD8cn2Gv/XPqONZjG0uCupBm+wLEOpxknmzML5gR4kVgzkMzVJ3sh5LY58FQAVRqmWZEdgJkcCpYKNMO1YsIrRPuqylaUB8puxkst0IH2nFw51Q6hMAnqi/OxLiKzX0XV3pE+ip+dxY/C/XiqFzbic8iGJgAZ0+1IkFhCPrcIel4yCGpCqOT6r5j2iCQUtKFjE6z5lRdJvViwSoXiTlXuZzZkUYH6BDlkYXOUAVdoyqIYoe0BN6Qa/Go/FsvBnv09KUMevZR39gfH4D1kefLQ=</latexit>
slide-9
SLIDE 9

DTU Compute 28 March 2019

Residual Analysis

9

slide-10
SLIDE 10

DTU Compute 28 March 2019

Residual Analysis

10

dXt = (Vt + d1u1)dt + σxdW 1

t

<latexit sha1_base64="Od3LljzS6LxuVeliDceAq8RDM7Y=">ACPHicbVDLTtAFB3T8mh4hbLsZtQIBEK7IBEN0iobFhStXlIcbDG45swyvihmesqkeUPY8NHdMeKDQsQYt1x8aVIOFKozk659w7d46fSKHRtm+thQ8fF5eWVz7VtfWNzbrW587Ok4VhzaPZax6PtMgRQRtFCihlyhgoS+h64/PCr37G5QWcfQLpwkMQjaKxFBwhoby6j9dhAlmQd7zkO6e0L2OuQ9oyZbTMwVBngWek3pOvl+5MS8WoxC5k3o/xHdS8dD16159YbdtMui8CpQINUdeHV/7hBzNMQIuSad137AQHGVMouIS85qYaEsbHbAR9AyMWgh5k5Xo53TFMQIexMidCWrKvOzIWaj0NfeMGV7pWa0g39P6KQ6/DTIRJSlCxF8eGqaSYkyLJGkgFHCUwMYV8LsSvkVU4yjybsIwZn98jzotJrOYbP146hx+r2KY4V8IV/JHnHIMTkl5+SCtAkn1+SOPJBH68a6t56s5xfrglX1bJM3Zf39B2HVrjk=</latexit>
slide-11
SLIDE 11

DTU Compute 28 March 2019

Residual Analysis

11

slide-12
SLIDE 12

DTU Compute 28 March 2019

Residual Analysis

12

Ytk = (Xt + d1u1) + etk

<latexit sha1_base64="jwHqdxmcAGpFJMTH7vrvzTeNp/4=">ACH3icbVDLSgMxFM3UV62vqks3waJUhDJTRd0IRTcuK9hacuQydza0MyD5I5YhvkTN/6KGxeKiDv/xvSx8HUgcDjn3OTmeLEUGm3708rNzM7NL+QXC0vLK6trxfWNpo4SxaHBIxmplsc0SBFCAwVKaMUKWOBJuPYG5yP/+g6UFlF4hcMYugG7DUVPcIZGcotHN26K7iCju6e03HKR7tMOwj2Ob04V+Fnquw5NXCfbMx5M0gW3WLIr9hj0L3GmpESmqLvFj4f8SAELlkWrcdO8ZuyhQKLiErdBINMeMDdgtQ0MWgO6m4y0yumMUn/YiZU6IdKx+n0hZoPUw8EwyYNjXv72R+J/XTrB30k1FGCcIZ81EskxYiOyqK+UMBRDg1hXAmzK+V9phHU+moBOf3l/+SZrXiHFSql4el2tm0jzZItukTBxyTGrkgtRJg3DyQJ7IC3m1Hq1n6816n0Rz1nRmk/yA9fkFMe2hNg=</latexit>
slide-13
SLIDE 13

DTU Compute 28 March 2019

Residual Analysis

13

slide-14
SLIDE 14

DTU Compute 28 March 2019

Residual Analysis

14

slide-15
SLIDE 15

DTU Compute 28 March 2019

Residual Analysis

15

dXt = (Vt + d1u1 + c3V 3)dt + σxdW 1

t

<latexit sha1_base64="GEIqyXLAY3I3SAyqeWrA672/tk=">ACRnicbVDLShxBFL09mqiT16jLbAqHBIMwdDsBsxFENy4VMg+YaZvq6jtjYfWDqtvBoemvc+PaXT4hmywiwa3VbQd85MKlDufcV50wU9KQ6/50WkvLr16vrK6137x9/5DZ31jaNJcCxyIVKV6HKDSiY4IEkKx5lGHocKR+HFUaWPfqA2Mk2+0yJDP+bzRM6k4GSpoONPCS+piMpxQOzPtse2neHRYHcps7rNbrPYXGqCxE0GfDs375pWmksioych7z4JL9mzY68wJqt4NO1+25dbCXwGtAF5o4CTo30ygVeYwJCcWNmXhuRn7BNUmhsGxPc4MZFxd8jhMLEx6j8Yv6vJ9skzEZqm2mRCr2cdBY+NWcShrYw5nZvnWkX+T5vkNPvmFzLJcsJEPCya5YpRyipPWSQ1ClILC7jQ0t7KxDnXJB1vjLBe/7l2C42/P6vd3Tr92Dw8aOVfgIW7ANHuzBARzDCQxAwBX8gj9w61w7v52/zt1DactpejbhSbTgHoTgr3c=</latexit>
slide-16
SLIDE 16

DTU Compute 28 March 2019

Final Results

16

dXt = (Vt + d1ut + c3V 3

t + f1pt)dt + σxdW 1 t ,

dVt = (−a1Vt + k1Xt + k3X3 + b1ut)dt + σV dW 2

t ,

dpt = g1(Vt − pt)dt + σpdW 3

t ,

Ytk = Xtk + d2utk + f2pt + f3p2

t + f4p3 t + etk.

<latexit sha1_base64="ZfeYkCjJ7IbW8Kc50qQgD+DvgMU=">AC3nicbVJLj9MwEHbCaymvAkcuFhVoUdkqj5XgrSC8dFomlQH8ZxnK7VvBRPEFXUAxcOIMSV38WNH8KdcRIktstI0Xz+/M03E9tRmSoNjvPLsi9dvnL12sH1wY2bt27fGd69F+iroSciItqjDiWqYql1NQkMqwrCTPolTOos0rsz/7ICutivwtbEu5zPg6V4kSHJBiw9xyIA+fkEPAwbjmLm0xvWYCuZTZFb+OEGuZPAkNvRCq3XG2Ucaz1Yug6d0sRjEQe9wxJlrXDZYEbZpyE6RJ3rOYfAOHh/HcrOYc1cM8bRfrvSiP1e/I41wDY7ow97OKYx87BFu8KBPTA5GNaeQiODfBRJjvJhA1HzsRpg14Ebg9GpI9TNvy5iAtRZzIHkXKt565TwrLhFSiRyt1gUWtZcrHhazlHmPNM6mXTXs+OPkImpklR4ZcDbdl/Kxqeab3NIlRmHM70/p4h/7c3ryF5vmxUXtYgc9E1SuqUQkHNXdNYVJAukXARaVwVirOeMUF4IsY4CG4+798EQTexPUn3pvj0cnL/jgOyAPykBwSlzwjJ+Q1OSVTIqy59cn6Yn2139uf7W/2905qW3NfXIu7B9/AJt02ZI=</latexit>
slide-17
SLIDE 17

DTU Compute 28 March 2019

Final Results

17

dXt = (Vt + d1ut + c3V 3

t + f1pt)dt + σxdW 1 t ,

dVt = (−a1Vt + k1Xt + k3X3 + b1ut)dt + σV dW 2

t ,

dpt = g1(Vt − pt)dt + σpdW 3

t ,

Ytk = Xtk + d2utk + f2pt + f3p2

t + f4p3 t + etk.

<latexit sha1_base64="ZfeYkCjJ7IbW8Kc50qQgD+DvgMU=">AC3nicbVJLj9MwEHbCaymvAkcuFhVoUdkqj5XgrSC8dFomlQH8ZxnK7VvBRPEFXUAxcOIMSV38WNH8KdcRIktstI0Xz+/M03E9tRmSoNjvPLsi9dvnL12sH1wY2bt27fGd69F+iroSciItqjDiWqYql1NQkMqwrCTPolTOos0rsz/7ICutivwtbEu5zPg6V4kSHJBiw9xyIA+fkEPAwbjmLm0xvWYCuZTZFb+OEGuZPAkNvRCq3XG2Ucaz1Yug6d0sRjEQe9wxJlrXDZYEbZpyE6RJ3rOYfAOHh/HcrOYc1cM8bRfrvSiP1e/I41wDY7ow97OKYx87BFu8KBPTA5GNaeQiODfBRJjvJhA1HzsRpg14Ebg9GpI9TNvy5iAtRZzIHkXKt565TwrLhFSiRyt1gUWtZcrHhazlHmPNM6mXTXs+OPkImpklR4ZcDbdl/Kxqeab3NIlRmHM70/p4h/7c3ryF5vmxUXtYgc9E1SuqUQkHNXdNYVJAukXARaVwVirOeMUF4IsY4CG4+798EQTexPUn3pvj0cnL/jgOyAPykBwSlzwjJ+Q1OSVTIqy59cn6Yn2139uf7W/2905qW3NfXIu7B9/AJt02ZI=</latexit>

Excluded terms Simulation error None 0.418 f2, f3, f4 0.448 c3, f2, f3, f4 0.457 d2, f2, f3, f4 0.625

<latexit sha1_base64="Sv4jCfbzP6N4Ty5AjGmtgXZQGg=">ADbnicbZJLb9NAEIA3Do8SXglIHKgQCy1VDyiy05RWnCpQJS6gQklbKY6i9XqcrLpeW7vriMjkxi/kxm/gwk9g/KAFl5GsHc98M7MzO0EqhbGu+6PltK9dv3Fz7Vbn9p279+53ew9OTJpDiOeyESfBcyAFApGVlgJZ6kGFgcSToPzt4X/dAHaiER9tsUJjGbKREJziyapr3WNz+AmVC5ZRiyGj+b20mHovgclAUt1Kz6vaAyfQq51856vSRQ+/cJmFEFLkY1NYtig9FjGSREKWiea+n6VaF5ctQpE+ZAoQNztD719PGuokM1oOngZTXfwG25WyLCJ8NLdxHb3GlhYIg3s1WD3EvNBhRfN1f2ztLh9/un98SFNImrnQM1lU3ESgjQUtcKxYFKElQMPRjWYFLgVC5DLfp1QsgBkUeR1kXLV+VMTxz7tbrh9txR6VfFqZYPUcjTtfvfDhGcxvhGXzJix56Z2kjNtBcd8HT8zkDJ+zmYwRlWxGMwkL9dlRV+gJaQRvkmUKEtL698ROYuNWcYBkjGzc9P0Fcb/+caZjfYnuVBpZkHxqlCUSWoTWuweDYXGocglKoxrgXelfM4047g4poND8JotX1VOBn1vpz/4ONg4eFOPY42sk+dkm3hkjxyQd+SIjAhv/XR6zmNn3fnVftR+0n5aoU6rjnlI/pH29m8S0vyo</latexit>
slide-18
SLIDE 18

DTU Compute 28 March 2019

Take home messages

  • Flexible and easier way to include the system knowledge
  • Continuous-time
  • Stochastic
  • Explicit estimation of process uncertainty
  • Proper handling of measurement uncertainty
  • Suitable for control

18

slide-19
SLIDE 19

DTU Compute 28 March 2019 19