GPYTORCH : BLACKBOX MATRIX- MATRIX GAUSSIAN PROCESS INFERENCE WITH - - PowerPoint PPT Presentation

gpytorch blackbox matrix matrix gaussian process
SMART_READER_LITE
LIVE PREVIEW

GPYTORCH : BLACKBOX MATRIX- MATRIX GAUSSIAN PROCESS INFERENCE WITH - - PowerPoint PPT Presentation

GPYTORCH : BLACKBOX MATRIX- MATRIX GAUSSIAN PROCESS INFERENCE WITH GPU ACCELERATION Jacob R. Gardner, Geoff Pleiss , David Bindel, Kilian Q. Weinberger, Andrew Gordon Wilson DEEP LEARNING & RAPID PROTOTYPING 1. GPU acceleration 2. Modular


slide-1
SLIDE 1

GPYTORCH: BLACKBOX MATRIX- MATRIX GAUSSIAN PROCESS INFERENCE WITH GPU ACCELERATION

Jacob R. Gardner, Geoff Pleiss, David Bindel, Kilian Q. Weinberger, Andrew Gordon Wilson

slide-2
SLIDE 2
  • 1. GPU acceleration
  • 2. Modular design
  • 3. Open source software

DEEP LEARNING & RAPID PROTOTYPING

slide-3
SLIDE 3
  • 1. GPU acceleration
  • 2. Modular design
  • 3. Open source software

DEEP LEARNING & RAPID PROTOTYPING

( )( )

W X

slide-4
SLIDE 4
  • 1. GPU acceleration
  • 2. Modular design
  • 3. Open source software

DEEP LEARNING & RAPID PROTOTYPING

( )( )

W X

model.add_module( nn.Linear(64, 128) )

slide-5
SLIDE 5
  • 1. GPU acceleration
  • 2. Modular design
  • 3. Open source software

DEEP LEARNING & RAPID PROTOTYPING

( )( )

W X

model.add_module( nn.Linear(64, 128) )

slide-6
SLIDE 6
  • 1. GPU acceleration?
  • 2. Modular design?

GAUSSIAN PROCESSES (GPS) & RAPID PROTOTPYING?

slide-7
SLIDE 7
  • 1. GPU acceleration?
  • 2. Modular design?

GAUSSIAN PROCESSES (GPS) & RAPID PROTOTPYING?

log det(K)

<latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit>

K−1y

<latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit>

data covariance matrix

slide-8
SLIDE 8
  • 1. GPU acceleration?
  • 2. Modular design?

GAUSSIAN PROCESSES (GPS) & RAPID PROTOTPYING?

log det(K)

<latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit>

K−1y

<latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit>

data covariance matrix

  • K + σ2I

−1

<latexit sha1_base64="KTpHShygAczDPitKoTr04o/zuhw=">AC3icbVDJSgNBEO2JW4zbqEcvTYIQEcNMEPQY9KJ4iWAWyExCT6dn0qRnobtGCEPuXvwVLx4U8eoPePNv7CwHjT4oeLxXRVU9LxFcgWV9Gbml5ZXVtfx6YWNza3vH3N1rqjiVlDVoLGLZ9ohigkesARwEayeSkdATrOUNLyd+65JxePoDkYJc0MSRNznlICWembREcyHMr7Bx9hRPAhJt4qvsSN5MICjbnZij3tmyapYU+C/xJ6TEpqj3jM/nX5M05BFQAVRqmNbCbgZkcCpYOCkyqWEDokAetoGpGQKTeb/jLGh1rpYz+WuiLAU/XnREZCpUahpztDAgO16E3E/7xOCv65m/EoSYFdLbITwWGE+CwX0uGQUx0oRQyfWtmA6IJBR0fAUdgr348l/SrFZsq2LfnpZqF/M48ugAFVEZ2egM1dAVqMGougBPaEX9Go8Gs/Gm/E+a80Z85l9AvGxzef9pjh</latexit><latexit sha1_base64="KTpHShygAczDPitKoTr04o/zuhw=">AC3icbVDJSgNBEO2JW4zbqEcvTYIQEcNMEPQY9KJ4iWAWyExCT6dn0qRnobtGCEPuXvwVLx4U8eoPePNv7CwHjT4oeLxXRVU9LxFcgWV9Gbml5ZXVtfx6YWNza3vH3N1rqjiVlDVoLGLZ9ohigkesARwEayeSkdATrOUNLyd+65JxePoDkYJc0MSRNznlICWembREcyHMr7Bx9hRPAhJt4qvsSN5MICjbnZij3tmyapYU+C/xJ6TEpqj3jM/nX5M05BFQAVRqmNbCbgZkcCpYOCkyqWEDokAetoGpGQKTeb/jLGh1rpYz+WuiLAU/XnREZCpUahpztDAgO16E3E/7xOCv65m/EoSYFdLbITwWGE+CwX0uGQUx0oRQyfWtmA6IJBR0fAUdgr348l/SrFZsq2LfnpZqF/M48ugAFVEZ2egM1dAVqMGougBPaEX9Go8Gs/Gm/E+a80Z85l9AvGxzef9pjh</latexit><latexit sha1_base64="KTpHShygAczDPitKoTr04o/zuhw=">AC3icbVDJSgNBEO2JW4zbqEcvTYIQEcNMEPQY9KJ4iWAWyExCT6dn0qRnobtGCEPuXvwVLx4U8eoPePNv7CwHjT4oeLxXRVU9LxFcgWV9Gbml5ZXVtfx6YWNza3vH3N1rqjiVlDVoLGLZ9ohigkesARwEayeSkdATrOUNLyd+65JxePoDkYJc0MSRNznlICWembREcyHMr7Bx9hRPAhJt4qvsSN5MICjbnZij3tmyapYU+C/xJ6TEpqj3jM/nX5M05BFQAVRqmNbCbgZkcCpYOCkyqWEDokAetoGpGQKTeb/jLGh1rpYz+WuiLAU/XnREZCpUahpztDAgO16E3E/7xOCv65m/EoSYFdLbITwWGE+CwX0uGQUx0oRQyfWtmA6IJBR0fAUdgr348l/SrFZsq2LfnpZqF/M48ugAFVEZ2egM1dAVqMGougBPaEX9Go8Gs/Gm/E+a80Z85l9AvGxzef9pjh</latexit><latexit sha1_base64="KTpHShygAczDPitKoTr04o/zuhw=">AC3icbVDJSgNBEO2JW4zbqEcvTYIQEcNMEPQY9KJ4iWAWyExCT6dn0qRnobtGCEPuXvwVLx4U8eoPePNv7CwHjT4oeLxXRVU9LxFcgWV9Gbml5ZXVtfx6YWNza3vH3N1rqjiVlDVoLGLZ9ohigkesARwEayeSkdATrOUNLyd+65JxePoDkYJc0MSRNznlICWembREcyHMr7Bx9hRPAhJt4qvsSN5MICjbnZij3tmyapYU+C/xJ6TEpqj3jM/nX5M05BFQAVRqmNbCbgZkcCpYOCkyqWEDokAetoGpGQKTeb/jLGh1rpYz+WuiLAU/XnREZCpUahpztDAgO16E3E/7xOCv65m/EoSYFdLbITwWGE+CwX0uGQUx0oRQyfWtmA6IJBR0fAUdgr348l/SrFZsq2LfnpZqF/M48ugAFVEZ2egM1dAVqMGougBPaEX9Go8Gs/Gm/E+a80Z85l9AvGxzef9pjh</latexit>

σ2I − σ4KXUL> I + L1KXUKXUL>σ21 L1KUX

<latexit sha1_base64="gZmqYQB+23yr/bAZpqUbfZYvby0=">ACZXicbVFJSwMxGM2MW61bXfDiwWARFGmZKQU9Fr0oeqjgaKFTSybNTEMzC8k3QhnT3rz6sW/Ybq41g8C73vfe1levERwBZb1aphz8wuLS4Xl4srq2vpGaXPrXsWpMyhsYhlyOKCR4xBzgI1kokI6En2IM3uBjNH56YVDyO7mCYsE5Igoj7nBLQVLf07CoehOQxq9RyfIUr+Kuv5/i6m7WcHN/ozoU4ybErmA9HWncyJu1Pyazwx6u5Efjif6b5vTyrulslW1xoVngT0FZTStZrf04vZimoYsAiqIUm3bSqCTEQmcCpYX3VSxhNABCVhbw4iETHWycUo5PtRMD/ux1CsCPGZ/OjISKjUMPa0MCfTV39mI/G/WTsE/62Q8SlJgEZ0c5KcCQ4xHkeMel4yCGpAqOT6rpj2iSQU9McUdQj23yfPgvta1baq9m293DifxlFAe+gAHSEbnaIGukRN5CK3oyCsWlsGe/mrlj7k6kpjH1bKNfZe5/AFaHtHo=</latexit><latexit sha1_base64="gZmqYQB+23yr/bAZpqUbfZYvby0=">ACZXicbVFJSwMxGM2MW61bXfDiwWARFGmZKQU9Fr0oeqjgaKFTSybNTEMzC8k3QhnT3rz6sW/Ybq41g8C73vfe1levERwBZb1aphz8wuLS4Xl4srq2vpGaXPrXsWpMyhsYhlyOKCR4xBzgI1kokI6En2IM3uBjNH56YVDyO7mCYsE5Igoj7nBLQVLf07CoehOQxq9RyfIUr+Kuv5/i6m7WcHN/ozoU4ybErmA9HWncyJu1Pyazwx6u5Efjif6b5vTyrulslW1xoVngT0FZTStZrf04vZimoYsAiqIUm3bSqCTEQmcCpYX3VSxhNABCVhbw4iETHWycUo5PtRMD/ux1CsCPGZ/OjISKjUMPa0MCfTV39mI/G/WTsE/62Q8SlJgEZ0c5KcCQ4xHkeMel4yCGpAqOT6rpj2iSQU9McUdQj23yfPgvta1baq9m293DifxlFAe+gAHSEbnaIGukRN5CK3oyCsWlsGe/mrlj7k6kpjH1bKNfZe5/AFaHtHo=</latexit><latexit sha1_base64="gZmqYQB+23yr/bAZpqUbfZYvby0=">ACZXicbVFJSwMxGM2MW61bXfDiwWARFGmZKQU9Fr0oeqjgaKFTSybNTEMzC8k3QhnT3rz6sW/Ybq41g8C73vfe1levERwBZb1aphz8wuLS4Xl4srq2vpGaXPrXsWpMyhsYhlyOKCR4xBzgI1kokI6En2IM3uBjNH56YVDyO7mCYsE5Igoj7nBLQVLf07CoehOQxq9RyfIUr+Kuv5/i6m7WcHN/ozoU4ybErmA9HWncyJu1Pyazwx6u5Efjif6b5vTyrulslW1xoVngT0FZTStZrf04vZimoYsAiqIUm3bSqCTEQmcCpYX3VSxhNABCVhbw4iETHWycUo5PtRMD/ux1CsCPGZ/OjISKjUMPa0MCfTV39mI/G/WTsE/62Q8SlJgEZ0c5KcCQ4xHkeMel4yCGpAqOT6rpj2iSQU9McUdQj23yfPgvta1baq9m293DifxlFAe+gAHSEbnaIGukRN5CK3oyCsWlsGe/mrlj7k6kpjH1bKNfZe5/AFaHtHo=</latexit><latexit sha1_base64="gZmqYQB+23yr/bAZpqUbfZYvby0=">ACZXicbVFJSwMxGM2MW61bXfDiwWARFGmZKQU9Fr0oeqjgaKFTSybNTEMzC8k3QhnT3rz6sW/Ybq41g8C73vfe1levERwBZb1aphz8wuLS4Xl4srq2vpGaXPrXsWpMyhsYhlyOKCR4xBzgI1kokI6En2IM3uBjNH56YVDyO7mCYsE5Igoj7nBLQVLf07CoehOQxq9RyfIUr+Kuv5/i6m7WcHN/ozoU4ybErmA9HWncyJu1Pyazwx6u5Efjif6b5vTyrulslW1xoVngT0FZTStZrf04vZimoYsAiqIUm3bSqCTEQmcCpYX3VSxhNABCVhbw4iETHWycUo5PtRMD/ux1CsCPGZ/OjISKjUMPa0MCfTV39mI/G/WTsE/62Q8SlJgEZ0c5KcCQ4xHkeMel4yCGpAqOT6rpj2iSQU9McUdQj23yfPgvta1baq9m293DifxlFAe+gAHSEbnaIGukRN5CK3oyCsWlsGe/mrlj7k6kpjH1bKNfZe5/AFaHtHo=</latexit>
slide-9
SLIDE 9

BLACKBOX MATRIX- MATRIX (BBMM)INFERENCE

slide-10
SLIDE 10

BLACKBOX MATRIX- MATRIX (BBMM)INFERENCE

log det(K)

<latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit>

K−1y

<latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit>

(Modified) batch conjugate gradients

( )( )

K ·

data covariance matrix

slide-11
SLIDE 11

BLACKBOX MATRIX- MATRIX (BBMM)INFERENCE

log det(K)

<latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit>

K−1y

<latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit>

(Modified) batch conjugate gradients

( )( )

K · Matrix-matrix multiplication w/ K

slide-12
SLIDE 12

BLACKBOX MATRIX- MATRIX (BBMM)INFERENCE

log det(K)

<latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit><latexit sha1_base64="fGkQsLQdY9OIe/yBzWzgFWPy0=">AB/HicbVDLSgNBEJz1GeNrNUcvg0GIl7Argh6DXgQvEcwDkhBmJ51kyOzsMtMrhiX+ihcPinj1Q7z5N06SPWhiQUNR1U13VxBLYdDzvp2V1bX1jc3cVn57Z3dv3z04rJso0RxqPJKRbgbMgBQKaihQjPWwMJAQiMYXU/9xgNoIyJ1j+MYOiEbKNEXnKGVum6hLaMBbSM8YtoDnNDS7WnXLXplbwa6TPyMFEmGatf9avcinoSgkEtmTMv3YuykTKPgEib5dmIgZnzEBtCyVLEQTCedHT+hJ1bp0X6kbSmkM/X3RMpCY8ZhYDtDhkOz6E3F/7xWgv3LTipUnCAoPl/UTyTFiE6ToD2hgaMcW8K4FvZWyodM42r7wNwV98eZnUz8q+V/bvzouVqyOHDkix6REfHJBKuSGVEmNcDImz+SVvDlPzovz7nzMW1ecbKZA/sD5/AHXgJQ5</latexit>

K−1y

<latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit><latexit sha1_base64="jyPGRDI4av08loOa7WKxnwt7irc=">AB73icbVBNS8NAEJ34WetX1aOXxSJ4sSQi6LHoRfBSwX5AG8tmO2mXbjZxdyOU0D/hxYMiXv073vw3btsctPXBwO9GWbmBYng2rjut7O0vLK6tl7YKG5ube/slvb2GzpOFcM6i0WsWgHVKLjEuFGYCtRSKNAYDMYXk/85hMqzWN5b0YJ+hHtSx5yRo2VWrcP2ak3JqNuqexW3CnIvFyUoYctW7pq9OLWRqhNExQrduemxg/o8pwJnBc7KQaE8qGtI9tSyWNUPvZ9N4xObZKj4SxsiUNmaq/JzIaT2KAtsZUTPQ895E/M9rpya89DMuk9SgZLNFYSqIicnkedLjCpkRI0soU9zeStiAKsqMjahoQ/DmX14kjbOK51a8u/Ny9SqPowCHcAQn4MEFVOEGalAHBgKe4RXenEfnxXl3PmatS04+cwB/4Hz+ACpzj2I=</latexit>

(Modified) batch conjugate gradients

( )( )

K ·

( )( )

K ·

( )( )

·

( )( )

·

Matrix-matrix multiplication w/ K

  • Std. GP

Scalable GP Multi-output GP K K

O(n3) O(n2)

slide-13
SLIDE 13

GPyTorch

GPYTORCH A BBMM LIBRARY

slide-14
SLIDE 14

GPyTorch

GPYTORCH A BBMM LIBRARY

slide-15
SLIDE 15

GPyTorch

GPYTORCH A BBMM LIBRARY

slide-16
SLIDE 16

GPyTorch

1. GPU acceleration 2. Modular design 3. Open source

GPS WITH BBMM INFERENCE

Poster #13 http://gpytorch.ai