Optimizing Image Acquisition Getting the most out of your microscope - - PowerPoint PPT Presentation

optimizing image acquisition
SMART_READER_LITE
LIVE PREVIEW

Optimizing Image Acquisition Getting the most out of your microscope - - PowerPoint PPT Presentation

Optimizing Image Acquisition Getting the most out of your microscope and detectors and the math you need to do it John Rubinstein Molecular Structure and Function Program The Hospital for Sick Children Research Institute Departments of


slide-1
SLIDE 1

Optimizing Image Acquisition

Getting the most out of your microscope and detectors and the math you need to do it

John Rubinstein Molecular Structure and Function Program The Hospital for Sick Children Research Institute Departments of Biochemistry and Medical Biophysics The University of Toronto

slide-2
SLIDE 2

Outline

  • Image optimization
  • Compare F20 to Titan Krios
  • Mysterious optimization for DDDs
  • Math for DDDs
  • Exposure weighting
  • Introduce problem of frame alignment
  • Refresher: waves and Fourier transforms
  • Padding and truncating in Fourier Space
  • Fourier shift theorem
  • Cross correlation functions
  • Applications of FFTs:
  • Downsampling images
  • (matrix multiplication review)
  • Aligning whole frames
  • Shifting frames
  • Aligning individual particles
slide-3
SLIDE 3

Getting good images

slide-4
SLIDE 4

The NRAMM website…

http://nramm.scripps.edu/2012-workshop-lectures/

slide-5
SLIDE 5

Use your microscope appropriately…

Tecnai F20 Titan Krios Parallel Use C2 aperture and lens setting that minimizes beam divergence 3rd Condensor Lens Avoiding Lens Hystersis Use over-focused diffraction for search mode Constant power lenses Stage Side Entry Cryoholder Cryo-autoloader Voltage 200 kV 300 kV

slide-6
SLIDE 6

F20/Titan Krios cost analysis

”I think my time is worth ~£20/hr”

  • Richard Henderson

(2001)

£20/hr in 2001 ≃ £29/hr in 2014 (£1 ≃ USD$1.68) ≃ $49/hr in 2014

Titan Krios/DDD: USD $5M Tecnai F20/DDD: USD $2M —————————— Difference: USD $3M

62,000 hours of Richard’s time “Official” work week = 35 h (34 years with Richard)

“Machines don’t make discoveries, people do.”

  • Lewis Kay
slide-7
SLIDE 7

Mysterious additional optimization with some microscopes

Acknowledgments: Tim Grant (JFRC) Alexis Rohou (JFRC) Niko Grigorieff (JFRC) Jianhua Zhao (Toronto) Samir Benlekbir (Toronto)

slide-8
SLIDE 8

Thallous chloride crystal - 25 kx magnification setting

d=3.842 Å

slide-9
SLIDE 9

FT of thallous chloride crystal image

slide-10
SLIDE 10

Average of many thallous chloride FTs

slide-11
SLIDE 11

1545 1550 1555 1560 1565 1570 1575 1580 1585

  • 200
  • 150
  • 100
  • 50

50 100 150 200 ’anisotropy3.txt’ f1(x) f2(x)

angle (°) radius (pixels)

radius(θ) = r1 + r2 + cos (2 · (θ − θoff)) (r1 − r2) 2

r1=1577 pixels r2=1547 pixels 𝜮off=1.3°

Fitting of measured radius to an ellipse

slide-12
SLIDE 12

FT of thallous chloride crystal image

slide-13
SLIDE 13

Corrected FT(sinc interpolations)

slide-14
SLIDE 14

Thallous chloride crystal

slide-15
SLIDE 15

Corrected thallous chloride crystal

slide-16
SLIDE 16

Average of many corrected thallous chloride FTs

slide-17
SLIDE 17

Anisotropic magnification affects CTF estimation

  • Anisotropic magnification

appear different (worse) at low magnification

DF1 DF2

  • Will look like objective lens

astigmatism in power spectra

slide-18
SLIDE 18

Easy way to check for anisotropic magnification (Jianhua Zhao)

Defocus 1 (Å) Defocus 2 (Å)

Original CTF parameters

10000 15000 20000 25000 30000 35000 10000 15000 20000 25000 30000 35000

slide-19
SLIDE 19

CTF parameters after anisotropy correction

10000 15000 20000 25000 30000 35000 10000 15000 20000 25000 30000 35000

Defocus 1 (Å) Defocus 2 (Å)

Easy way to check for anisotropic magnification (Jianhua Zhao)

slide-20
SLIDE 20

Is the problem widespread? (Yifan Cheng/Jianhua Zhao)

TRPv1 CTF parameters

10000 15000 20000 25000 30000 35000 10000 15000 20000 25000 30000 35000

Defocus 1 (Å) Defocus 2 (Å)

slide-21
SLIDE 21

Math for DDDs

slide-22
SLIDE 22

Signal to Noise ratio in averages and frames A B

Average of 30 frames: 30 e-/Å2 Individual frame 1 e-/Å2

slide-23
SLIDE 23

3 Å 8 Å 16 Å 27 Å 1.0 0.5 10 20 30 40 50 50 Å 80 Å

Baker, Smith, Bueler, and Rubinstein (2010), J. Struct. Biol., 169, 431-7.

Relative signal-to-noise ratio Exposure (e-/Å2)

Baker and Rubinstein (2010), Method Enzymol 481, 373-90.

Exposure weighting

Hayward and Glaeser (1979).Ultramicroscopy 4, 201-10.

slide-24
SLIDE 24

Exposure weighting

the first few frames could be used to build high-resolution models. An even more sophisticated approach would be to use the optimal exposures measured here to calculate weighted averages of frames in order to maximize the SNR at each spatial frequency.

The resolution dependence of optimal exposures in liquid nitrogen temperature electron cryomicroscopy of catalase crystals

Journal of Structural Biology 169 (2010) 431–437

Publication Conditions Conclusion Veesler et al. (2013) JSB 184, 193-202 200 kV, 20.6 e-/Å2, ~4-6 Å, groups of frames small effect Scheres (2014) ELife 3:e03665. Estimate B-factor for each frame effect Wang et al. (2014) Nat Comm 5:5808 Baker et al. 2010 measured values + 30 % effect

Baker et al.

slide-25
SLIDE 25

Unaligned movie Aligned movie

Frame 1 2 3 4

Drift of movie frames

Sources of movement:

  • Specimen stage drift
  • Long exposures necessary for Gatan K2 summit in counting mode (>5 sec)
  • Side entry cryoholders may have drift rates of ~1 Å/s
  • Beam-induced movement
  • May cause shift of whole frame
  • May not be uniform within an image
  • Harder problem to solve
slide-26
SLIDE 26

Waves and FFTs

slide-27
SLIDE 27

Representing waves a vectors

phase (Φ) wavelength (λ) amplitude (|F|)

  • Wavelength
  • Amplitude
  • Phase

Real Imaginary a b

φ |F|

For waves of a specified wavelength

F=a+bi

i = √ −1

slide-28
SLIDE 28

The FT represents functions in terms of waves

Function wave 27 wave 28 wave 29 = … + + + + …

+ + + ... = ... +

FT frequency

F=a+bi F=a+bi F=a+bi

slide-29
SLIDE 29

Shifting waves causes a phase change

slide-30
SLIDE 30

Phase change of Fourier components from shifting

Shifting in real space causes phase changes in Fourier space

+ + + ... = ... + + + + ... = ... +

slide-31
SLIDE 31

Resolution encoded by different pixels in a FFT

1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å ∞ Å

  • 1 8 Å
  • 1 4 Å
  • 1

2 Å

  • 1

2.6 Å

  • 1

Real image Fourier transform

The FFT of an N pixel line image will have N/2+1 complex pixels

(1 Å)*8/0 (1 Å)*8/1 (1 Å)*8/2 (1 Å)*8/3 (1 Å)*8/4

t resolution(kx) = pixelsize · FTsize radius

slide-32
SLIDE 32

Manipulating FTs: truncating in Fourier space

1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å ∞ Å

  • 1 8 Å
  • 1 4 Å
  • 1

2 Å

  • 1

2.6 Å

  • 1

Real image Fourier transform

∞ Å

  • 1 8 Å
  • 1 4 Å
  • 1

2 Å

  • 1

2.6 Å

  • 1

Fourier transform

removed values {

2 Å 2 Å 2 Å 2 Å

Real image

Truncating in Fourier space leads to downsampling in Real space

(now corresponds to 4 pixel image)

The FFT of an N pixel line image will have N/2+1 complex pixels

slide-33
SLIDE 33

t resolution(kx) = pixelsize · FTsize radius

Manipulating FTs: padding in Fourier space

Padding in Fourier space leads to interpolation in Real space

1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å 1 Å ∞ Å

  • 1 8 Å
  • 1 4 Å
  • 1

2 Å

  • 1

2.6 Å

  • 1

Real image Fourier transform

0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å 0.5 Å

Real image

interpolated values { The FFT of an N pixel line image will have N/2+1 complex pixels

∞ Å

  • 1 8 Å
  • 1 4 Å
  • 1

2 Å

  • 1

2.6 Å

  • 1

1 Å

  • 1

1.6 Å

  • 1

1.3 Å

  • 1

1.1 Å

  • 1

Fourier transform

padding 0s {

(now corresponds to 16 pixel image)

slide-34
SLIDE 34

1 2 3 4 5 6 1 2 3 4 5 6

Two dimension Fourier transforms

  • The FT of real functions (e.g. images) are Hermitian: for every point (a+bi)

there is a corresponding point (a-bi)

  • For an N ⨉ N pixel image, Fourier transform is N/2+1 ⨉ N
  • The positive Nyquist and negative Nyquist values are the same
  • 3
  • 1
  • 2
  • 3

1 2 3 1 2

  • 1

3

  • 2

a

a+bi a-bi c c

slide-35
SLIDE 35

Two dimension Fourier transforms

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

a+bi a+bi a+bi

slide-36
SLIDE 36

1 2 3 4 1 2 3 4 5 6

  • 2

1 2 3

  • 1

1 2 3/-3

FT position (kx) FT position (ky)

Phase change in 2D FFT upon shifting and image

a+bi Fshifted = Funshifted(cos + i sin ) = kx(j) · ∆x2⇡ N + ky(j) · ∆y 2⇡ N where ∆x and ∆y are the x and y shifts, respectively. N is the extent in pixels in both the x and y direction of the N × N image. kx(j) and ky(j) are the distance of the Fourier component from the origin in the kx and ky directions, respectively.

Real Imaginary a b

φ | F |

F

slide-37
SLIDE 37

Applying knowledge of FFTs to DDD images

slide-38
SLIDE 38

Sometimes you may want to downsample your images

Ruskin, Yu, and Grigorieff (2013). JSB 184, 385-93.

slide-39
SLIDE 39

Downsampling in Fourier space

1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 1 2 3 4 5 6

FT-1 FT

extract central region put in new array

slide-40
SLIDE 40

Cross correlation functions

1 2 3 4 5 6 1 2 3 4 5 6

Image 1

1 2 3 4 5 6 1 2 3 4 5 6

Image 2

1 2 3 4 1 2 3 4 5 6
  • 2
1 2 3
  • 1
1 2 3/-3 FT position (kx) FT position (ky)

FT FT

1 2 3 4 1 2 3 4 5 6
  • 2
1 2 3
  • 1
1 2 3/-3 FT position (kx) FT position (ky)

a+bi

×

take complex conjugate

1 2 3 4 1 2 3 4 5 6
  • 2
1 2 3
  • 1
1 2 3/-3 FT position (kx) FT position (ky)

a-bi

=

1 2 3 4 1 2 3 4 5 6
  • 2
1 2 3
  • 1
1 2 3/-3 FT position (kx) FT position (ky)

FT-1

1 2 3 4 5 6 1 2 3 4 5 6

Cross-correlation function

  • 2
  • 1
1 2 3/-3
  • 1
1 2 3/-3
slide-41
SLIDE 41

Aligning frames Motioncorr

Li … Cheng (2013). Nat Methods 10, 584-90.

slide-42
SLIDE 42

(A, B etc. represent matrices): AB ≠ BA ABCD=A(B(CD))

a11 a12 a13 a21 a22 a23 a31 a32 a33 x y z

=

c1 c2 c3

·

where c1=a11x+a12y+a13z

c2=a21x+a22y+a23z c3=a31x+a32y+a33z

Matrix multiplication review

slide-43
SLIDE 43

Unaligned movie Aligned movie

Frame 1 2 3 4

  • Define Frame 1 as “unshifted” (0,0)
  • Calculate vectors (xshift,yshift) that bring two frames into register
  • Can use cross correlation to estimate 6 unique vectors for 4 frame movie:

Frame 1 vs Frame 2 Frame 1 vs Frame 3 Frame 1 vs Frame 4 Frame 2 vs Frame 3 Frame 2 vs Frame 4 Frame 3 vs Frame 4

The least squares method for aligning frames

Li … Cheng (2013). Nat Methods 10, 584-90.

Can calculate (Z/2) ⨉ (Z-1) cross-correlation functions for a movie with Z frames (e.g. 30 frame movie yields 435 CCFs)

slide-44
SLIDE 44

= ·

tNM means true shift vector between frames N and M mNM means measured shift vector (by cross correlation) between frames N and M

t12 t23 t34 m12 1 0 0 m14 m13 1 1 0 m23 m24 m34

m12≃1·t12+0·t23+0·t34 m13≃1·t12+1·t23+0·t34

1 1 1

m14≃1·t12+1·t23+1·t34

1 1 1 1 0 0

m23≃0·t12+1·t23+0·t34 m24≃0·t12+1·t23+1·t34 m34≃0·t12+0·t23+1·t34

The least squares method for aligning frames

Li…Cheng, Nature Methods

Once matrices are filled in standard linear algebra can be used to find values that best fit the data for t12, t23, t34

slide-45
SLIDE 45

Improvements to the least-squares approach (I)

  • Subpixel accuracy for cross correlation peaks

(padding in Fourier space leads to interpolation in Real space)

1 2 3 4 5 6 1 2 3 4 5 6 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12

FT-1

1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12

FT

w/ 0s pad

slide-46
SLIDE 46
  • Minimum interval between frames

(cross correlation functions for subsequent frames might have maxima too close to the origin to be reliable)

= ·

t12 t23 t34 m12 m14 m13 m23 m24 m34 t45 m15 m25 m35 m45 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Improvements to the least-squares approach (II)

slide-47
SLIDE 47

= ·

mNM means measured shift vector (by cross correlation) between frames N and M cNM means calculated shift vector between frames N and M

t12 t23 t34 m12 1 0 0 m14 m13 1 1 0 m23 m24 m34

c12=1·t12+0·t23+0·t34 c13=1·t12+1·t23+0·t34

1 1 1

c14=1·t12+1·t23+1·t34

1

c23=0·t12+1·t23+0·t34

1 1

c24=0·t12+1·t23+1·t34

1 0 0

c34=0·t12+0·t23+1·t34 Residual12=|c12-m12| Residual13=|c13-m13| Residual14=|c14-m14| Residual23=|c23-m23| Residual24=|c24-m24| Residual34=|c34-m34|

Improvements to the least-squares approach (III)

  • Throw away equations with high residuals
slide-48
SLIDE 48

FT

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

Shifting images in Fourier space

1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12

Frame Δx Δy 1 2

  • 1.2

2.3 3

  • 1.5

3.2 4

  • 1.6

4.5 5

  • 1.7

5.1 6

  • 1.8

5.9 …

= kx(j) · ∆x2⇡ N + ky(j) · ∆y 2⇡ N = (3)(−1.2)2⇡ 12 + (4)(2.3)2⇡ 12 (a0 + b0i) = (a + bi)(cos + i sin )

F

slide-49
SLIDE 49

Aligning individual particles alignparts_lmbfgs

Rubinstein and Brubaker (2014). arXiv 1409.6789

slide-50
SLIDE 50

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

Global optimization for aligning individual particles

Rubinstein and Brubaker (2014). arXiv 1409.6789

Fourier transform of individual particle movie Z frames J Fourier components (Fjz) Fjz

z=1 … Z

a+bi

FTs of frames

slide-51
SLIDE 51

Fourier transform 1

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

(a1 + b1i)(a2 − b2i) = a1a2 + b1b2 + (a2b1 − a1b2)i

We only need to consider the real part of F1jF*2j because for every term:

(a1 − b1i)(a2 + b2i) = a1a2 + b1b2 − (a2b1 − a1b2)i

There is a corresponding term:

CC12 = Re

J

X

j=1

F1jF ∗

2j

Correlation of Fourier transforms

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

Fourier transform 1

F1j F2j

slide-52
SLIDE 52

Global optimization for aligning individual particles

Rubinstein and Brubaker (2014). arXiv 1409.6789

Find an objective function that, when maximized, maximizes the sum of the correlations of each shifted frame with the sum of the shifted frames. Equivalently: find an objective function that, when minimized, maximizes the sum of the correlation of each shifted frame with the sum of the shifted frames.

slide-53
SLIDE 53

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5 1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

z=1 … Z

FTs of shifted frames

1 2 3 4 5 6

  • 1
  • 2
  • 3
  • 4
  • 5

6/-6 1 2 3 4 5

Sum of FTs

Fjz(cos jz + i sin jz) FjzSjz Sjz = (cos jz + i sin jz) O(Θ) = −Re

Z

X

z=1 J

X

j=1

" F*

jzS* jz Z

X

z0=1

Fjz0Sjz0 #

Overall objective function:

Rubinstein and Brubaker (2014). arXiv 1409.6789

a+bi

Global optimization for aligning individual particles

Z

X

z=1

FjzSjz

a+bi

slide-54
SLIDE 54

Optimization of functions of many variables

  • ptimum

(minimum)

  • The function we are trying to optimize has 2 variables (x-shift

and y-shift) for every frame (30 frame movie has 60 variables)

θa O(θ)

slide-55
SLIDE 55

Too bad I can’t calculate the first derivative

  • f the objective

function

  • JLR

Marcus Brubaker

(first of many important contributions)

Yes you can

  • MAB

Oh, and you should always check

  • MAB

F(x) − F(x + ✏) ✏ ≈ @F(x) @x

slide-56
SLIDE 56

Optimization of functions of many variables

  • ptimum

(minimum)

  • The function we are trying to optimize has 2 variables for

every frame (x-shift and y-shift)

O(𝚺) 𝞊O(𝚺)/𝞊𝚺a

6 ∂O(Θ) ∂xa = Re

J

X

j=1

2πikx(j) N " FjaSja

Z

X

z=1

F*

jzS* jz F* jaS* ja Z

X

z=1

FjzSjz # ∂O(Θ) ∂ya = Re

J

X

j=1

2πiky(j) N " FjaSja

Z

X

z=1

F*

jzS* jz F* jaS* ja Z

X

z=1

FjzSjz #

θa O(θ)

  • Conjugate gradients
  • Broyden-Fletcher-Goldfarb-Shanno
slide-57
SLIDE 57

alignparts_lmbfgs.f90

500 1000 1500 2500 3500 2000 3000 position (x-direction) 500 1000 1500 2500 3500 2000 3000 position (y-direction)

Rubinstein and Brubaker (2014). arXiv 1409.6789 Trajectories x5

500 550 600 650 700 750 2700 2750 2850 2950 2800 2900 3100 3200 3300 3350 3250 3150 550 600 650 750 700

slide-58
SLIDE 58

Improvement #1: disfavour unlikely trajectories

frame x-shift

1 2 3 4 5

slide-59
SLIDE 59

frame x-shift

z-2 z-1 z penalty=𝞵[(x(z)-x(z-1))-(x(z-1)-x(z-2))]2

  • bserved slope=(x(z)-x(z-1))

expected slope=(x(z-1)-x(z-2)) ∂Osmooth(𝜮)/∂𝜮a=∂O(𝜮)/∂𝜮a+∂P(𝜮)/∂𝜮a

Rubinstein and Brubaker (2014). arXiv 1409.6789

Second order smoothing

Osmooth(𝜮)=O(𝜮)+P(𝜮)

slide-60
SLIDE 60

Derivatives of penalty function

@P(Θ) @xa = 8 > > > > > > < > > > > > > : 2 (xa − 2xa+1 + xa+2) , a = 1, 2 (−2xa1 + 5xa − 4xa+1 + xa+2) , a = 2, 2 (xa2 − 4xa1 + 6xa − 4xa+1 + xa+2) , a ∈ [3, Z − 2] , 2 (xa2 − 4xa1 + 5xa − 2xa+1) , a = Z − 1, 2 (xa2 − 2xa1 + xa) , a = Z. @P(Θ) @ya = 8 > > > > > > < > > > > > > : 2 (ya − 2ya+1 + ya+2) , a = 1, 2 (−2ya1 + 5ya − 4ya+1 + ya+2) , a = 2, 2 (ya2 − 4ya1 + 6ya − 4ya+1 + ya+2) , a ∈ [3, Z − 2] , 2 (ya2 − 4ya1 + 5ya − 2ya+1) , a = Z − 1, 2 (ya2 − 2ya1 + ya) , a = Z.

Rubinstein and Brubaker (2014). arXiv 1409.6789

slide-61
SLIDE 61

Second order smoothing

λ=5×105 λ=1×1010 λ=0 2700 2750 2850 2950 2800 2900 500 550 600 650 700 750 position (x-direction) position (y-direction) λ=5×105 λ=1×1010 λ=0 3100 3200 3300 3350 3250 3150 550 600 650 750 700 position (x-direction) position (y-direction)

slide-62
SLIDE 62

Improvement 2: Enforce local correlation

500 1000 1500 2500 3500 2000 3000 position (x-direction) 500 1000 1500 2500 3500 2000 3000 position (y-direction)

~ tnz

0 =

PM

m=1 wnm~

tmz PM

m=1 wnm

wmn = exp ✓−d2

mn

2σ2 ◆

Trajectories x5

slide-63
SLIDE 63

Local averaging

2700 2750 2850 2950 2800 2900 500 550 600 650 700 750 σ=0 σ=500 σ=5000 position (x-direction) position (y-direction) 550 600 650 750 700 3100 3200 3300 3350 3250 3150 σ=0 σ=500 σ=5000 position (x-direction) position (y-direction)

slide-64
SLIDE 64

Local averaging and second order smoothing

500 1000 1500 2500 3500 2000 3000 position (x-direction) 500 1000 1500 2500 3500 2000 3000 position (y-direction)

500 550 600 650 700 750 2700 2750 2850 2950 2800 2900 3100 3200 3300 3350 3250 3150 550 600 650 750 700

Rubinstein and Brubaker (2014). arXiv 1409.6789 Trajectories x5

slide-65
SLIDE 65

Comparison of drift correction methods

Approach Correlation Smoothing Advantages/ Disadvantage Least squares (Motioncorr) Noisy images to noisy images Over-determined problem (fitted trajectory, local correlation possible) Over-determined/ low signal-to- noise in comparisons Polishing (Relion) Noisy images to map projections Linear fit, rolling averages, enforce local correlation Map projection v. high SNR/map projection may not match image Non-global iterative Noisy images to sums of noisy images Fitted trajectory, enforce local correlation Sum of images high SNR/No built in regularization Global optimization (Alignparts_lmbfgs) Noisy images to sums of noisy images

Penalize changes in trajectory, enforce local correlation

Non-linear trajectories/Map projections have higher SNR

slide-66
SLIDE 66

Putting it all together (Michael Latham, Samir Benlekbir)

  • Thermoplasma acidophilum 20S proteasome (Kay lab)
  • 1 grid frozen on a FEI Vitrobot in ethane/propane
  • FEI F20 at 200 kV, Gatan 626 side entry cryoholder
  • 30 µm C2 aperture
  • Gatan K2 Summit in super-resolution mode
  • movies captured at 5 e-/pix/sec
  • 1.45 Å/pixel
  • 30 frames, 15 seconds, 1 e-/Å2/frame
  • 60 Movies (short afternoon session)
  • downsampled by Fourier truncation (Alexis Rohou)
  • local movement corrected with alignparts_lmbfgs.f90
  • exposure weighting with alignparts_lmbfgs.f90
  • magnification anisotropy correction in particles and CTF parameters
  • 13,974 particles with D7 symmetry
slide-67
SLIDE 67

Putting it all together (Michael Latham, Samir Benlekbir)

3.8 Å resolution

slide-68
SLIDE 68

Apples to Oranges Comparisons

NRAMM (F20/K2)

Campbell et al. JSB (2014) Particle Polishing, 21,818 Particles Relion 4.2 Å

UCSF (Polara/K2)

Li et al. Nature Methods (2013) Motioncorr 126,729 Particles Frealign 3.3 Å

SickKids (F20/K2)

Latham, Benlekbir, Unpublished Alignparts_lmbfgs, 13,974 Particles Relion 3.8 Å

  • a

d

slide-69
SLIDE 69

Prospects

What we could use:

  • Improved detectors (higher DQE at high resolution)
  • Improved algorithms for conformational separation
  • Improved spatial coherence
  • Improved single particle motion correction
  • Improved specimen preparation (prevent motion)

With the existing instruments and algorithms:

  • Atomic resolution structures of homogenous specimens
  • Sub-nanometer resolution structures of heterogeneous

specimens

  • Fewer blobs, fewer incorrect structures

Microscopes:

  • 300 kV could be better than 200 kV:
  • Better DDD response
  • Less Ewald sphere curvature
  • Less charging effects
  • (Titan/JEOL 3200) more parallel beam
  • 300 kV not currently needed for most projects
slide-70
SLIDE 70

Acknowledgements:

Current members: Samir Benlekbir Stephanie Bueler Michael Latham (Kay Lab) Mohammad Mazhab Jafari Jason Koo (Howell Lab) Martin Smith Jianhua Zhao Dan Schep Anna Zhou Past members: Lindsay Baker Shawn Keating Wilson Lau Chelsea Marr Nawaz Pirani Jana Tuhman Toronto Collaborators Lewis Kay (Toronto) Marcus Brubaker (TTI) Niko Grigorieff (JFRC) Alexis Rohou (JFRC) Tim Grant (JFRC) Yifan Cheng (UCSF)

slide-71
SLIDE 71

alignparts_lmbfgs for β-galactosidase (Sjors Scheres)

Rubinstein and Brubaker (2014). arXiv 1409.6789 500 1000 1500 2000 2500 3000 3500 4000 500 1000 1500 2000 2500 3000 3500 4000 5 10 15 20 25