Learning Adaptive Quantum State Tomography with Neural Networks - - PowerPoint PPT Presentation

learning adaptive quantum state tomography with neural
SMART_READER_LITE
LIVE PREVIEW

Learning Adaptive Quantum State Tomography with Neural Networks - - PowerPoint PPT Presentation

Learning Adaptive Quantum State Tomography with Neural Networks & Difg fgerentiable Programming Stanislav Fort Stanford University (prev. Google Research) sfort1@stanford.edu stanford.edu/~sfort1/ @stanislavfort Primarily based on arXiv


slide-1
SLIDE 1

Learning Adaptive Quantum State Tomography with Neural Networks & Difg fgerentiable Programming

Stanislav Fort

Stanford University (prev. Google Research) sfort1@stanford.edu stanford.edu/~sfort1/ @stanislavfort

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Primarily based on arXiv 1812.06693

slide-2
SLIDE 2

Primarily based on arXiv 1812.06693, in review

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

slide-3
SLIDE 3

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Primarily based on arXiv 1812.06693, in review

slide-4
SLIDE 4

AI, ML, DL & differentiable programming

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

  • Artificial intelligence:

The science of making machines smart

  • Machine learning:

Machines getting smart from data

  • Deep learning:

Machines getting smart from data using deep neural networks as functional approximators

  • Differentiable programming:

Taking partial derivatives through programs, not restricted to deep neural networks as functions

slide-5
SLIDE 5

AI, ML, DL & differentiable programming

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

  • Artificial intelligence:

The science of making machines smart

  • Machine learning:

Machines getting smart from data

  • Deep learning:

Machines getting smart from data using deep neural networks as functional approximators

  • Differentiable programming:

Taking partial derivatives through programs, not restricted to deep neural networks as functions

slide-6
SLIDE 6

AI, ML, DL & differentiable programming

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

  • Artificial intelligence:

The science of making machines smart

  • Machine learning:

Machines getting smart from data

  • Deep learning:

Machines getting smart from data using deep neural networks as functional approximators

  • Differentiable programming:

Taking partial derivatives through programs, not restricted to deep neural networks as functions

slide-7
SLIDE 7

AI, ML, DL & differentiable programming

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

  • Artificial intelligence:

The science of making machines smart

  • Machine learning:

Machines getting smart from data

  • Deep learning:

Machines getting smart from data using deep neural networks as functional approximators

  • Differentiable programming:

Taking partial derivatives through programs, not restricted to deep neural networks as functions

slide-8
SLIDE 8

Differentiable programming

Heat equation example

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

∂ ∂ temperature field

Bridging ML & scientific computing

slide-9
SLIDE 9

Differentiable programming

Quantum games example

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

∂ ∂ quantum game strategy

slide-10
SLIDE 10

Writing down a solution vs learning a solution

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

f( )= “tortoise”

Bubble sort (explicit) Image classification (learned) Translation (much better when learned)

slide-11
SLIDE 11

Writing down a solution vs learning a solution

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Even solving symbolic math

slide-12
SLIDE 12

Machine learning

Learning to get faster (& better) heuristics

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

slide-13
SLIDE 13

Machine learning

Learning to get faster (& better) heuristics

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

slide-14
SLIDE 14

Network & data structure

How to induce the correct learning prior?

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

slide-15
SLIDE 15

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

slide-16
SLIDE 16

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-17
SLIDE 17

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-18
SLIDE 18

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-19
SLIDE 19

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-20
SLIDE 20

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-21
SLIDE 21

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

?

slide-22
SLIDE 22

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

slide-23
SLIDE 23

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

?

slide-24
SLIDE 24

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

?

( A d a p t i v i t y )

slide-25
SLIDE 25

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

?

slide-26
SLIDE 26

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

? ? ? ?

?

?

slide-27
SLIDE 27

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

? ? ? ?

?

? ? ? ?

?

?

slide-28
SLIDE 28

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

? ? ? ?

?

? ? ? ?

?

? ? ? ?

?

?

N

slide-29
SLIDE 29

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

? ? ? ?

?

? ? ? ?

?

?

? ? ? ? ?

N

slide-30
SLIDE 30

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

Pure states first

? ? ?

?

? ? ? ?

?

? ? ? ?

?

?

? ? ? ? ?

N

slide-31
SLIDE 31

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Quantum state tomography

What is difficult?

? ? ?

?

? ? ? ?

?

? ? ? ?

?

?

? ? ? ? ?

N

slide-32
SLIDE 32

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Pure states → density matrices

Density matrices Pure states

slide-33
SLIDE 33

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

What do we care about?

1) How precisely can you reconstruct the unknown state, given N copies of the unknown state? 2) How much compute does it take?

slide-34
SLIDE 34

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Regular Quantum State Tomography

slide-35
SLIDE 35

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Regular Quantum State Tomography

Stage 1: Take measurements

slide-36
SLIDE 36

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Regular Quantum State Tomography

Stage 2: Process them

slide-37
SLIDE 37

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Regular Quantum State Tomography

Problem: Measurements expensive

slide-38
SLIDE 38

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Ferenc Huszár, Neil M. T. Houlsby. Adaptive Bayesian Quantum Tomography, arXiv 1107.0895

Stage 1: Take measurements up to t

slide-39
SLIDE 39

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Ferenc Huszár, Neil M. T. Houlsby. Adaptive Bayesian Quantum Tomography, arXiv 1107.0895

Stage 2: Determine the next POVM

slide-40
SLIDE 40

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Particle bank maintaining and update

slide-41
SLIDE 41

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Particle bank maintaining and update

slide-42
SLIDE 42

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Particle bank resampling

slide-43
SLIDE 43

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Adaptive Quantum State Tomography

Problem: Computationally expensive

slide-44
SLIDE 44

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST)

Our approach

Yihui Quek*, Stanislav Fort*, Hui Khoon Ng. Adaptive Quantum State Tomography with Neural Networks, arXiv 1812.06693

Advantages:

  • Parametrized state ansatz is not

required

  • Exponential computational speedup
  • Learned directly from simulated data
  • Can retrain within hours
  • Any POVM types
  • Different noise models
  • Learned distance measure, update rule

etc.

slide-45
SLIDE 45

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work

slide-46
SLIDE 46

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work

Train: Differentiable quantum simulator provides measurement results

slide-47
SLIDE 47

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Custom recurrent architecture - off the shelf doesn’t work

Train: Differentiable quantum simulator provides measurement results Test: Experimenter provides measurement results

slide-48
SLIDE 48

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-49
SLIDE 49

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-50
SLIDE 50

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-51
SLIDE 51

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-52
SLIDE 52

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-53
SLIDE 53

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens Veil of ignorance = gradient stop

slide-54
SLIDE 54

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-55
SLIDE 55

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-56
SLIDE 56

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-57
SLIDE 57

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-58
SLIDE 58

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-59
SLIDE 59

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-60
SLIDE 60

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-61
SLIDE 61

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-62
SLIDE 62

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-63
SLIDE 63

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Inside the RNN cell - where the magic happens

slide-64
SLIDE 64

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Different paradigm from ABQT

  • No explicit Bayesian interpretation - weights are just

weights

  • Automatically learned NN similarity metric for

resampling and weight updates

  • Resampling is fast
  • End-to-end training minimizing arbitrary human

choices

slide-65
SLIDE 65

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) How is it trained? 2 notions of “time” Inference step

slide-66
SLIDE 66

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) How is it trained? 2 notions of “time” Backprop step

slide-67
SLIDE 67

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Numerical experiments - what can be varied? 1) Single-qubit POVM type: 2 (basis POVM), 3, 4 (SIC), and 6 (Pauli) legs per qubit subspace

slide-68
SLIDE 68

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Numerical experiments - what can be varied? 1) Single-qubit POVM type: 2 (basis POVM), 3, 4 (SIC), and 6 (Pauli) legs per qubit subspace 2) POVM Adaptivity: Adaptive or random measurements? What are the benefits? 3) 3) Reconstruction algorithm: Standard QST, ABQT, or

  • ur NA-QST
slide-69
SLIDE 69

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

slide-70
SLIDE 70

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

Number of measurements

slide-71
SLIDE 71

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

Reconstruction error

slide-72
SLIDE 72

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

NA-QST is: 1) Equal in reconstruction accuracy

slide-73
SLIDE 73

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

NA-QST is: 1) Equal in reconstruction accuracy 2) Orders of magnitude faster!

slide-74
SLIDE 74

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Reconstruction accuracy and time to compute

NA-QST is: 1) Equal in reconstruction accuracy 2) Orders of magnitude faster! 3) Time complexity scales better

slide-75
SLIDE 75

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) Time complexity scaling: polynomial to logarithmic

NA-QST: logarithmic time scaling ABQT: polynomial time scaling

slide-76
SLIDE 76

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Neural Adaptive Quantum State Tomography (NA-QST) When does adaptivity help?

Conclusions:

  • 2 legs (basis):

Adaptivity helps a lot

  • 3 legs:

Adaptive helps slightly

  • 4 legs and above

(informationally complete): Adaptivity does not make any difference

slide-77
SLIDE 77

Stanislav Fort | Adaptive Quantum State Tomography with NNs and differentiable programming | 19 February 2020 | Stanford, USA

Takeaways and thank you!

We designed, implemented, and tested an end-to-end trainable, deep learning powered algorithm called Neural Adaptive Quantum State Tomography (NA-QST) NA-QST is: 1) Fast to train (hours on a laptop) 2) Very fast to run (poly → log) 3) Accurate in reconstruction (~SOTA) 4) Flexible (noise, different POVMs etc) Future: Retraining for downstream products involving the density matrix Primarily based on arXiv 1812.06693