Semiclassical Sampling and Linear Inverse Problems
Plamen Stefanov
Sampling meets Microlocal Analysis
IAS 2019
Semiclassical Sampling and Linear Inverse Problems Sampling meets - - PowerPoint PPT Presentation
Semiclassical Sampling and Linear Inverse Problems Sampling meets Microlocal Analysis Plamen Stefanov IAS 2019 The classical Shannon sampling theorem says that if has a Fourier supported in the box , (i.e., it
Plamen Stefanov
IAS 2019
The classical Shannon sampling theorem says that if ππ¦ has a Fourier transform π supported in the box πΆ, πΆ (i.e., it is bandβlimited), then ππ¦ is uniquely and stably determined by its samples π π‘π , π β π if the sampling rate π‘ satisfies 0 π‘ π/πΆ. More precisely, π π¦ π π‘π π π π‘ π¦ π‘π
, π π¦ sincπ¦
π π‘ π π‘π
. The proof is simple. Think of π as the inverse FT of π . Then the samples ππ‘π are the Fourier coefficients of π , more precisely of its periodic extension over the lattice πΆπ.
Graph of sinc The red curve is the function reconstructed, indistinguishable from the
reconstruction has a global character. Here π‘ 0.95 β Nyquist.
In the frequency domain, things look like this: Nyquist condition satisfied (no aliasing). Since πΆ, πΆ β π/π‘, π/π‘, π π‘ π π‘ 3π π‘ 3π π‘ π
π
; then the samples are its Fourier coefficients: π
Multiply that extension by π /,/ π to get π back: π π π /,/ π π‘ π π‘π π.
π , π in a convolution, which is the sinc function. If we have oversampling (suppπ strictly in πΆ, πΆ), we can choose πΜ smooth, hence π will be in the Schwartz class unlike the sinc function. πΆ πΆ
Aliasing: If the Nyquist condition is not satisfied: πΆ πΆ 3πΆ 3πΆ π
The 2πΆβperiodic extension has overlapping segments. If we restrict back to πΆ, πΆ, we get π truncated plus other stuff, i.e., we get π modulo 2πΆ. Its inverse FT is not π anymore. This creates aliasing. Frequencies get shifted. If we have a smooth πΜ instead of π,, we get an FIO, actually (in the sense below).
Oversampled
Undersampled
|π | The FT of the undersampled π β± β± Aliasing in π: The original consist of two patterns: one higher frequency than the other. First, we sample and reconstruct properly. Next, we undersample the higher frequency pattern but still sample properly the lower frequency one. The reconstruction changes the direction and the frequency of the undersampled pattern. The Fourier transforms demonstrate the shifting (folding) of the frequencies.
We are interested in sampling the data g π΅π with π΅ linear, π given, π ? We assume that π΅ is an FIO, which is true very often: in integral geometry, thermoβ acoustic tomography, etc. (i) Sampling π©π: Having an estimate of supp π (the smallest detail of π), how dense should we sample π΅π? (ii) Resolution limit on π, given the sampling rate of π©π. (iii) Aliasing: if we undersample π΅π, what kind of aliasing we get for π? (iv) Averaged measurements/antiβaliasing: if we blur the data (either because the detectors are not points and average already or because we want to avoid aliasing), what do we get for π? To answer (i), one may say β estimate supp π΅π knowing supp π and apply the sampling theorem, we are done. The problem is that this is not
We look at the problem as an asymptotic one. The βsmallest detailβ is a small parameter tending to 0. Rescale π to π/β (i.e., π π/β) with 0 β βͺ 1. This makes it a semiβclassical problem! If π πΆ/β, then for the rescaled π we have π πΆ. We want to work in the phase space, i.e., to account for the π¦ dependence as well. So band limited now means that π
π¦ has a compact WF π .
(v) Semiβclassical sampling. How to sample π
π¦ with a compact WF π ?
This brings us to the first problem we need to study:
Theorem (semiβclassical sampling): Let π
β π· Ξ© with WF π β Ξ© πΆ, πΆ . Then for π‘ π/πΆ,
π
π¦
π π‘βπ π π π‘β π¦ π‘βπ
βπ
ππ― β , where π is a product of sinc functions. Parsevalβs equality holds, too, up to π β . Just a rescaled classical version, with error estimates. The condition on WF π is a condition on β±π modulo π β . The step size is π‘β with π‘ π/πΆ. As above, if WF π β Ξ© πΆ, πΆ (oversampling), π can be made rapidly decreasing. We call the projection Ξ£π of WF π onto π the frequency set of π. (v) Semiβclassical sampling
πΆ πΆ πΆ π‘β πβ πΆ π π
The Fourier domain πΆ Ξ£π (v) Semiβclassical sampling
πΆ/2 π The sampling lattice The Fourier domain The lattice could be rectangular πΆ/2 πΆ π
Ξ£π πΆ/2 (v) Semiβclassical sampling π‘β πβ πΆ
πΆ πΆ πΆ π
The Fourier domain The previous sampling lattice (rescaled by 2) works for Ξ£π supported like
generated by the vectors πΆ/2,0 and 0, πΆ. Then πΜ has to be supported there. βπΆ/2 πΆ/2 Ξ£π (v) Semiβclassical sampling π π‘β 2πβ πΆ
One can use linear transformations. If shifts of Ξ£π under the translations π β¦ π 2ππβ do not intersect, where det π 0, then we can sample over the lattice π¦ π‘βππ, π β π with π‘ 1. This is a periodic but not a rectangular lattice (a parallelogram one). One can reduce the number of samples by taking some partition of unity π and in each one, sampling according to Ξ£ππ. This gets us closer to the important question of nonβuniform sampling. In the classical case, there is a well cited (780 google scholar citations) paper by LANDAU in Acta, saying, among the rest, that if we can sample uniquely and πβ stably some π over a possibly nonβuniform set of points then the density of that set must have a Weyl type of lower bound proportional to the Lebesgue measure of supp π . This links sampling to spectral theory. (v) Semiβclassical sampling
We have the following microlocal analog of this result.
πβπΊ be a compact set. If π π· π β π
π¦ β
for every π
with WF π β πΏ, then
π β 2πβ VolπΏ1 π β . The main novelty here, besides the semiβclassical setting, is that we relate the number of points needed to the phase volume of π
, i.e., to
Vol WF π instead of Volsupp π (multiplied by Volsupp π ). The proof uses the spectral asymptotics (DIMASSI & SJΓSTRAND) for the smoothened version of the semiclassical Ξ¨DO ππ¦, π. In the uniform cases above, we have equality. (v) Semiβclassical sampling
(i) Sampling FIOs In other words, we know an a priori bound of the smallest detail π has. How to sample π΅π? We need to fit WF π΅π in the smallest product Ξ©β² πΏ with πΏ a box or a parallelogram or a domain satisfying the tiling property w.r.t. some lattice. Then we sample on the reciprocal one. Now, if π΅ is a semiβclassical FIO or if WF π΅π was the classical WF set, then WF π΅π is related by WF π by the canonical relation π· of π΅. It turns out that, aside from the zero section, this is also true in this case WF π΅π β 0 β π· β WF π β 0. Then the sampling of π΅π is determined by the geometry of C β Ξ© π πΆ . (i) How to sample π΅π when π΅ is an FIO and WF π β Ξ© π πΆ (for example)?
(ii) Resolution limit on π, given the sampling rate of π©π. (ii) Let us say we sample π΅π at same (limited) rate. This is what is done in
The way this is asked, it depends on whether π΅ is invertible, microlocally or not, in the first place. Let us say we sample π΅π on Ξ©β² at a rate π‘β. Then if WF π β C β Ξ© πΆβ², πΆβ² we captured all βdetailβ of π΅π and did not lose any resolution about π is π΅ is microlocally invertible in the first place. If π΅ is elliptic, then we can actually recover all the detail of π. If the above inclusion fails, there is aliasing. Note that the set on the right is not necessarily a product. This means resolution changing with location and direction.
(iii) Aliasing (iii) Let us say that π΅π is undersampled. How would that affect π? From now on, we assume a reconstruction with πΜπ smooth (so it is a s.c. symbol); then π β π―. An inspection of the reconstruction formula says that instead of π
, we get
π»π
π»π
, with π» a semiβclassical FIO with a canonical relation π βΆ π¦, π β¦ π¦, π 2ππ/π‘ (and amplitude πΜπ‘π/π when the phase is π π¦ π§ β π 2πππ β π§/π‘). The aliasing leaves π¦ in place but shifts the frequencies around (and changes their directions) as we saw above.
(iii) Aliasing This characterizes aliasing as an hβFIO. The question however is what does aliasing of π΅π do to π (not π΅π)? Let us say that π΅ is elliptic and associated to a local diffeo. Then aliasing of the data gives us the following reconstruction π΅π»π΅π
result is a sum of hβFIOs with canonical relations π· β π β π·. π are frequency shifts but the composition is not, in general! We can expect shifts in the π¦ variable as well!
(iv) Averaged measurements (iv) What if we sample π β π΅π
with ππ¦ πππ¦/π?
Letβs say that π΅ is associated with a local diffeo π·. The operator π β¦ π β π is an hβΞ¨DO with a principal symbol π . Then by Egorovβs theorem, π β π΅π
π΅ππ π β π ,
where π is an hβΞ¨DO with a principal symbol π β π·. Depending on π , this could blur π, so we are back to the problem (i) but we recover a blurred version ππ
.
This works if π changes from a sampling point to another; then the samples became samples of π π΅π
with π an hβPDO. We can still apply Egorovβs
theorem. Finally, we can solve the inverse problem within the inverse problem: choose π so that π becomes what we want, say convolution with a fixed kernel.
Example: The Radon transform in βparallel geometryβ We present some applications. Let β be the weighted Radon transform in 2D βπ π, π π π¦, π π π¦ ππ.
β
Write π π cos π, sin π. It is well known that β is an FIO with canonical relation π· π· βͺ π·, where π· π¦, π arg π
Each π· is a diffeo, with inverse π¦, π π·
π, π, π
, πΜ given by π¦ ππ π π /πΜπ π , π πΜ π π .
Radon transform: (i) Sampling Sampling β (with π 1) was studied by BRACEWELL, RATTEY & LINDGREN and NATTERER. The proofs are not complete because they require twoβparameter asymptotics of Bessel functions. The results are actually asymptotic even though they are not stated as such. We will prove them for the weighted β. Assume WF π β π¦ π, π πΆ. Take π· of that and project it to the π , πΜ
This is an elementary calculation knowing π·. It is the same set obtained by the authors above. Ξ£βπ
The smallest bounding box is ππΆ, ππΆ πΆ, πΆ. This determines relative sampling rates (before multiplying by β) π‘ π ππΆ , π‘ π πΆ To get a more efficient sampling set, notice that the plane can be tiled by translations by ππΆ, πΆ and 0,2πΆ . Thus we can sample on the parallelogram grid π‘βππ with any π‘ 1 and π π ππΆ 2 1 π . Those are 4/π times the phase volume x2. Ideally, it would be equal to it. The sampling points are 8/π times twice the phase volume of π (since π· is a double cover, βtwiceβ is the right target). Radon transform: (i) Sampling
Remember, Ξ£ βπ is just a projection of WF βπ . We can do better than
superimpose WFβπ (the projection) on it over each point. π π We see that the cone shape of Ξ£βπ above is the union of all those cones, and it is also what happens at π 0. If we sum up (integrate) the areas of those βconesβ, we get the sharp sampling count = 2x that for π. To get close to that, we need to split the rectangle into small horizontal strips and sample differently in each one of them. Radon transform: (i) Sampling
Radon transform: (ii) Resolution Let π‘ and π‘ be fixed. How would that affect π? From π·, we have π¦ β π π/π‘, π π/π‘. The first one tells us that π‘_π does not restrict resolution much in the center (π¦ 0) or when π β₯ π¦. On the other hand, π‘ restricts resolution uniformly (which is consistent with the intertwining property of π
and Ξ).
Undersampled in π and reconstructed Undersampled in π and reconstructed uniform blur plus nonβlocal artifacts best resolution Circular lines well
Radon transform: (iii) Aliasing There were a lot of artifacts in those images due to aliasing of the data. As we discovered, the reconstructed image is an hβFIO of the original (a sum of such). Assume we undersample angularly. The canonical relation on the data in this case is π βΆ π, π β¦ πΜ, π 2ππ/π‘. No aliasing corresponds to π 0; and typically, in addition, we will see π 1 only. This affects π as a sum of hβFIOs with canonical relations π¦, π β¦ π·
β π β π· π¦, π
π¦ β π¦ 2ππ π‘ π π , π when the projection of π¦ to π is in π/π‘ , π/π‘. So we see that π¦ shifts along π but π does not! This is in some sense the opposite to what happens in classical aliasing.
reconstruction βπ undersampled (aliased) βπ In other words, the data βπ is aliased as usual: the effect is local and the frequencies are shifted. The reconstructed π is affected differently: the frequencies are preserved but the phantom is shifted! and of the aliased βπ. The Fourier transform of βπ The frequencies of βπ shift left and right. Radon transform: (iii) Aliasing π π
Radon transform: (iii) Aliasing Assume we undersample in the π variable . A similar computations shows that both π¦ and π shift.
reconstruction βπ βπ undersampled in π The higher frequency pattern disappears! It actually shifts out of the computational domain.
Radon transform: (iii) Averaged data Blur the data: π βπ with π an hβΞ¨DO with a compact support and principal symbol π π¦, π . Egorovβs thm: π is blurred by π π¦, π
If π is a convolution, i.e., π ππ π | π πΜ|, then π π¦, π π π π π π¦ β π . The blur is uniform iff π 0, i.e., we average w.r.t. π only. Well known. If π 0, the blur is position and direction dependent.
βπ averaged in π βπ averaged in π
Example: The Radon transform in βfanβbeam geometryβ Lines parameterized by initial point πππ½
angle πΎ with the radial ray. This is diffeomorphic to the parallel geometry case. One can compute π· π· βͺ π· as before. Assume as before WF π β π¦ π, π πΆ. Then Ξ£ βπ for all such π can be computed as before. There is a new twist here: π· π¦, π may be aliased, π· π¦, π may be not! π βπ |βπ |
Fanβbeam geometry: (i) Sampling Ξ£βπ Example: π Computed |βπ | The double rectangle above determines the sampling requirements on a rectangular grid: π‘ π ππΆ , π‘ π 2ππΆ . This is π the parallel case (on a rectangular grid), and 8 more than the Weyl optimum. We can tile the plane with translations by ππΆ, 0 and 0,2ππΆ as we showed
Fanβbeam geometry: (i) Sampling A better representation of WFβπ: The figure we got earlier is the βworst scenario caseβ: the union of all those. The greatest sampling requirements are near πΎ 0. One can sample over small parallel strips with different steps. This would bring us asymptotically close to the Weyl minimum. βπ with WF βπ |, at a few points. Ξ£βπ
π½ πΎ
Fanβbeam geometry: (ii) Resolution Assume we sample βπ with relative rates π‘ and π‘. What does this imply for π? We need to understand π· π½, πΎ β 0,2π
The red bars represent the frequency cutoff caused by π‘. The black circles correspond to π‘. The frequencies in the intersection of the circles are the nonβaliased ones. The reason: π· is 2βtoβ1. As a result: there is more resolution in the data, if extracted properly! The diagram is rotationally symmetric.
Fanβbeam geometry: (iii) Aliasing If the sampling rates π‘ and π‘ are not small enough, aliasing occurs a
and π changes magnitude but not direction.
Fanβbeam geometry: (iv) averaged data Blur the data: π βπ with π an hβΞ¨DO with a compact support and principal symbol π π¦, π . Egorovβs thm: π is blurred by π π¦, π
If π is a convolution, i.e., π ππ π | π πΜ|, then π π¦, π 1 2 π π π¦ β π π π¦ β π π π π¦ β π 1 2 π π π¦ β π π π¦ β π π π π¦ β π . The levels sets are as in the resolution analysis. Unlike in the parallel geometry case, those terms are different! They blur differently and then the results are added.
Fanβbeam geometry: (iv) averaged data (a) original (b) π with βπ averaged in Ξ± (c) π with βπ averaged in πΎ (b) Radial blur. Corresponds to the red bars. (c) Sum of two blurs. Corresponds to the circles. (d) Source restricted to the right semiβcircle. We get better resolution near the source (direction dependent). Corresponds to one of the circles
The resolution diagram (d) π with partial βπ averaged in πΎ
Fanβbeam geometry: (iv) averaged data To understand better the effect we see in (c) above, here is another test function: a 5 5 array of almost deltaβlike Gaussians. Reconstructed π with βπ averaged in πΎ, i.e., data: π πΎ β βπ A magnified crop A density plot of the computed symbol at 0.88π, 0 π π¦, π 1 2 π π¦ β π π π π¦ β π 1 2 π π¦ β π π π π¦ β π
Fanβbeam geometry: antiβaliasing Bluring βπ can be used to avoid aliasing.
π with βπ undersampled in πΎ π with βπ blurred in πΎ, then sampled A lot of aliasing artifacts spreading everywhere The antiβaliasing removes most of the artifacts but softens the image a bit more.
Thermoβacoustic Tomography Model: π£ π π¦ Ξu 0 in π π, π£| π π¦ , π£| 0, where π£π’, π¦ is the sound pressure, π π¦ is the sound speed equal to 1
Ξ© π’ π We measure Ξπ π£| , . There is no actual boundary, the waves propagate to the whole space. Clearly, Ξ is a classical FIO. Another studied model is when there are Neumann b.c. and the waves reflect. Ξ is still a classical FIO. π£π’, π¦
Thermoβacoustic Tomography Canonical relation π· π· βͺ π·. π·π¦, π π·π¦, π For every π’, π¦ β 0, π πΞ©, the range of the possible π· π¦, π (when π πΆ) is the characteristic cone projected there. Their union gives Ξ£Ξπ, which is the cone above. Here, π max π because we have π 1 if we use the metric πππ¦ on πβΞ© but we have π πΆ with π Euclidean (as determined by the sampling rate). The induced metric on πΞ© would results in another constant π but when πΞ© is piecewise flat, π 1. π¦ π Ξ£Ξπ
Thermoβacoustic Tomography It turns out that the geometry plays no role! Only max π and the shape
π Fast region inside, no caustics (before reflections). Much higher frequencies, needs finer sampling. Slow region inside, caustics. Waves focus
requirements. Compute Ξπin the model with reflections. The r.h.s. shown. π’ π¦ π’ π¦