Emission tomography and Bayesian inverse problems
Peter Green
University of Bristol and UTS, Sydney
Bernoulli Lecture 12 July 2012, Istanbul
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 1 / 70
Emission tomography and Bayesian inverse problems Peter Green - - PowerPoint PPT Presentation
Emission tomography and Bayesian inverse problems Peter Green University of Bristol and UTS, Sydney Bernoulli Lecture 12 July 2012, Istanbul Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 1 / 70 Outline The
University of Bristol and UTS, Sydney
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 1 / 70
1
2
3
4
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 2 / 70
The Bernoullis Family
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 3 / 70
The Bernoullis Family
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 4 / 70
The Bernoullis Family
Jacob: Ars Conjectandi – Law
e Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 5 / 70
The Bernoullis Family
Johann: Calculus & li i & application to physical problems Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 5 / 70
The Bernoullis Family
Daniel: fluid mechanics, St , Petersburg paradox Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 5 / 70
The Bernoullis Family
Hesse: The Glass Bead Game Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 5 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 6 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 7 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 8 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 9 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 10 / 70
The Bernoullis Inverse problems
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 10 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 11 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 11 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 12 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 12 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 13 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 13 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 14 / 70
Inverse problems from a Bayesian perspective Basic formulation
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 14 / 70
Inverse problems from a Bayesian perspective Applications
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 15 / 70
Inverse problems from a Bayesian perspective Applications
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 16 / 70
Inverse problems from a Bayesian perspective Applications
Overlay of the Hubble optical image first with the raw Chandra data and second with the posterior mean reconstruction, highlighting black holes. van Dyk
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 17 / 70
Inverse problems from a Bayesian perspective Applications
Josiane Zerubia, Xavier Descombes, C. Lacoste, M. Ortner, R. Stoica
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 18 / 70
Inverse problems from a Bayesian perspective Applications
Posterior mean for advection field field superimposed
salinity concentrations (left) compared (left) compared to interpolated data McKeague, Nicholls, Speer and Herbei, J. Marine Research, 2005
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 19 / 70
Inverse problems from a Bayesian perspective Theory
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 20 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 21 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 22 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 22 / 70
Single-photon emission computed tomography Principles
50 Journal of the American Statistical Association, March 1997
x,y,z
3
Figure 1. Gamma Camera and Photon Interactions. (1) A photon rejected by the collimator; (2) a direct count; (3) a scattered undetected count; (4) an absorbed photon; (5) a scattered detected count; (6) an undetected count.
Thog
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 23 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 24 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 24 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 24 / 70
Single-photon emission computed tomography Principles
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 24 / 70
Single-photon emission computed tomography Modelling
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 25 / 70
Single-photon emission computed tomography Modelling
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 26 / 70
Single-photon emission computed tomography Modelling
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 26 / 70
Single-photon emission computed tomography Modelling
10 20 30 40 50 60 10 20 30 40 50 angle detector Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 27 / 70
Single-photon emission computed tomography Modelling
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 28 / 70
Single-photon emission computed tomography Modelling
200 300 400 500 −3 −2 −1 1 log10(eigenvalues)
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 29 / 70
Single-photon emission computed tomography Reconstruction
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 30 / 70
Single-photon emission computed tomography Reconstruction
approx mle Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 31 / 70
Single-photon emission computed tomography Reconstruction
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 32 / 70
Single-photon emission computed tomography Reconstruction
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 33 / 70
Single-photon emission computed tomography Current practice
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 34 / 70
Single-photon emission computed tomography Current practice
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 34 / 70
Single-photon emission computed tomography Current practice
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 34 / 70
Single-photon emission computed tomography Current practice
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 35 / 70
Single-photon emission computed tomography Current practice
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 36 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 37 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 37 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 37 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 38 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 38 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 38 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 39 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 39 / 70
Concentration and approximation of posterior Framework
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 39 / 70
Concentration and approximation of posterior Framework
p
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 40 / 70
Concentration and approximation of posterior Framework
p
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 40 / 70
Concentration and approximation of posterior Framework
B) = exp(−1/(2γ2)(x − x0)TB(x − x0))
B) subject to x ∈ X.
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 41 / 70
Concentration and approximation of posterior Framework
B) = exp(−1/(2γ2)(x − x0)TB(x − x0))
B) subject to x ∈ X.
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 41 / 70
Concentration and approximation of posterior Framework
B) = exp(−1/(2γ2)(x − x0)TB(x − x0))
B) subject to x ∈ X.
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 41 / 70
Concentration and approximation of posterior Framework
B) subject to x ∈ X.
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 42 / 70
Concentration and approximation of posterior Framework
B) subject to x ∈ X.
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 42 / 70
Concentration and approximation of posterior Framework
B) subject to x ∈ X.
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 42 / 70
Concentration and approximation of posterior Geometry
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 43 / 70
Concentration and approximation of posterior Geometry
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 43 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 44 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 44 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 45 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 45 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 46 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 47 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 47 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 48 / 70
Concentration and approximation of posterior Geometry
B
j = 0
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 49 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 50 / 70
Concentration and approximation of posterior Geometry
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 50 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 51 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 52 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 52 / 70
Concentration and approximation of posterior Concentration of posterior
t µt.
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 53 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 54 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 54 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 54 / 70
Concentration and approximation of posterior Concentration of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 55 / 70
Concentration and approximation of posterior Concentration of posterior
B
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 56 / 70
Concentration and approximation of posterior Approximation of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 57 / 70
Concentration and approximation of posterior Approximation of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 57 / 70
Concentration and approximation of posterior Approximation of posterior
B
j = 0}. When we scale x − x⋆ to get a non-degenerate
2 ⊕ W+ 3
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 58 / 70
Concentration and approximation of posterior Approximation of posterior
2 ⊕ W+ 3
2
3
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 59 / 70
Concentration and approximation of posterior Approximation of posterior
3 arises from the positivity constraints on x⋆ being active
2 arises with an irregular likelihood (zero Poisson counts)
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 60 / 70
Concentration and approximation of posterior Approximation of posterior
x3 x2 x1
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 61 / 70
Concentration and approximation of posterior Approximation of posterior
1, x⋆ 2 > 0, x⋆ 3 = 0.
x3 x2 X* x1
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 61 / 70
Concentration and approximation of posterior Approximation of posterior
1, x⋆ 2 > 0, x⋆ 3 = 0.
x3 x2 x1
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 61 / 70
Concentration and approximation of posterior Approximation of posterior
1, x⋆ 2 > 0, x⋆ 3 = 0.
x3 x2 W3
+
W1 W0 x1
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 61 / 70
Concentration and approximation of posterior Approximation of posterior
k ) for each k,
00 ) × N(0, B−1 11 ) × Exp(a2) × Exp(a3)
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 62 / 70
Concentration and approximation of posterior Approximation of posterior
k ) for each k,
00 ) × N(0, B−1 11 ) × Exp(a2) × Exp(a3)
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 62 / 70
Concentration and approximation of posterior Approximation of posterior
0 ∇2fyexact(x⋆)V0,
2 ∇fyexact(x⋆),
1 BV1,
3 ζ,
00 lim σ→0[1/σV T 0 ∇fy(ω)(x⋆) + σ/γ2V T 0 B(x⋆ − x0)].
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 63 / 70
Concentration and approximation of posterior Approximation of posterior
j = 0 but not both;
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 64 / 70
Concentration and approximation of posterior Approximation of posterior
P
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 65 / 70
Concentration and approximation of posterior Approximation of posterior
P
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 65 / 70
Concentration and approximation of posterior Approximation of posterior
2 and W+ 3
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 66 / 70
Concentration and approximation of posterior Approximation of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 67 / 70
Concentration and approximation of posterior Approximation of posterior
54 Journal of the American Statistical Association, March 1997 Table 2. Brain Phantom Major MCMC Run: Estimates of Posterior Means, Integrated Auto-Correlation Times, and Standard Errors (SE's)
Parameter Mean
T(f)
M ;(f)/N SE High 188.29 12.392 38 .01377 1.6785 Medium 93.524 8.1245 25 .00903 .8502 Low 41.905 12.653 38 .01406 1.4670 3.6189 x 10-3 6.0526 19 .00673 2.2004 x 10-4 3 2.3384 x 10-2 11.003 34 .01223 9.6926 x 10-5
fully Bayesian posterior mean is not as aesthetically pleasing as the posterior mode from the OSL using the fixed "best" prior parameters. The former is slightly noisier and has RMSE value of 6.3670, compared to 5.7003 from the fixed parameter posterior
fully Bayesian reconstruction is substantially less than the least possible
by ML/EM (8.2179). The MCMC run took 940.3 seconds
10/41 worksta- tion, compared to 30.0 seconds for OSL. Therefore, the comparative computational cheapness
when "good" fixed values
parameters are available discour- ages the use of MCMC to obtain reconstructions. However, in reality the variety
imaged and range
counts recorded may mean that these are not available. Us- ing other parameter values, the OSL algorithm invariably produced grossly oversmoothed
Thus the automation and quality
re- construction is admirable. Furthermore, the fully Bayesian method also allows
to go beyond mere reconstruction, because functionals
the body space can be easily obtained as a by-product
the MCMC. For instance, fully Bayesian posterior pixelwise modes could be obtained. These may be useful for examin- ing a specific region
The OSL fixed-parameter solution would not be capable
as it is a mode for the whole body space. Fully Bayesian posterior medians also
a a
.
CL~~~~~~~~
0.
5 10 15 20 25 30 5 10 15 20 25 30 pixel pixel
(a) (b)
0-
a
LO
a LO
Cu
C
..z.
*.....
0.0
5 10 15 20 25 30 5 10 15 20 25 30 pixel pixel
(c) (d)
Figure
Phantom: (a) Row 25 Truth and Posterior Mean
(
phantom;
(b) Row 25 Truth and Credibility Bounds (---, 90% bounds;
(---, 95%
bounds);
(c) Row 16 Truth
and Posterior Mean
( , Phantom;
(d) Row 16 Truth and Credibility Bounds
(---,
90% bounds; ---, 95% bounds).
can be easily obtained; here the reconstruction composed
was found to be very similar in ap- pearance to the posterior mean. Bayesian interval estimators are also easily obtained. Here I report pixelwise quantiles; however, Besag et al. (1995)
the construction
multaneous bounds for the whole vector
5 graphs two transects
phantom that cross distinct re- gions
The posterior mean and 90% and 95% pix- elwise credibility bounds are superimposed
It can be seen that the posterior mean faithfully reproduces the general truth shape, the major departure being overes- timation
activity region. However, the credibility bounds fully bracket the truth. In general, there may be situations where the credibility bounds do not give full information about the truth. For instance, the ability to successfully reconstruct small area hot spots and edges will be affected by low count/noisy data sets, the sampling bin widths, the reconstruction discretization used, and the
accuracy of the {ats} weight modeling.
We can also use output from the MCMC to get posterior density estimates
parameters. The density es- timates do not have pathological worth but do give insight into appropriate prior parameter values that could, for in- stance, be used to gain fixed-parameter OSL posterior mode reconstructions.
3.2 Real Data
The data relate to a horizontal slice through a brain and comprise 119,405 photon counts recorded by a system
64 detectors at 64 angles. The filtered back-projection re- construction provided by the Bristol Royal Infirmary is on a 64 x 64 grid
Figure 6a displays the cen- tral 48 x 48 pixels. The presence
radial artifacts is a well-documented deficiency
back-projection. Figures 6b and 6c show ML/EM reconstructions after 50 and 100 iterations. These reconstructions define the out- line of the brain better, but they are noisier. Figure 6d dis- plays the OSL solution using the prior parameter values chosen for the simulated data and reveals a clear isotope pattern that comprises several well-defined
ures 6e and 6f present the final realization from the fully Bayesian MCMC run and the resulting estimate
pos- terior mean. The fully Bayesian posterior mean is similar to the OSL fixed-parameter solution but is not as smooth and suggests greater contrast between several regions. Fig- ure 7 displays the posterior mean and credibility bands
a cross-section; the widths
bounds are not constant indicating the varying confidence in parts
solution.
4. DISCUSSION
The work presented here has demonstrated the ability to
representative Bayesian reconstructions
data without the need for prior parameter selections. The process is thus fully automated and can be applied with no supervision. The reconstructions are of comparable qual- ity to OSL ones when "good" fixed prior parameter val- ues are used and better when inappropriate values are used.
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 68 / 70
Concentration and approximation of posterior Approximation of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 69 / 70
Concentration and approximation of posterior Approximation of posterior
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 69 / 70
Peter Green (Bristol/UTS) Bayesian inverse problems Istanbul, July 2012 70 / 70