TEMPO: Fast Mask Topography Effect Modeling with Deep Learning Wei - - PowerPoint PPT Presentation

tempo fast mask topography effect modeling with deep
SMART_READER_LITE
LIVE PREVIEW

TEMPO: Fast Mask Topography Effect Modeling with Deep Learning Wei - - PowerPoint PPT Presentation

TEMPO: Fast Mask Topography Effect Modeling with Deep Learning Wei Ye 1 , Mohamed Baker Alawieh 1 , Yuki Watanabe 2 , Shigeki Nojima 2 , Yibo Lin 3 , David Z. Pan 1 1 ECE Department, University of Texas at Austin 2 Kioxia Corporation 3 CS


slide-1
SLIDE 1

Wei Ye1, Mohamed Baker Alawieh1, Yuki Watanabe2, Shigeki Nojima2, Yibo Lin3, David Z. Pan1

1ECE Department, University of Texas at Austin 2Kioxia Corporation

3CS Department, Peking University

TEMPO: Fast Mask Topography Effect Modeling with Deep Learning

slide-2
SLIDE 2

⧫ Moore’s law brings increasing manufacturing cost and challenges ⧫ Need to make sure design is manufacturable with high yield

Bottleneck in IC Manufacturing: Lithography

2

Light source Lens Photomask Projection lens Wafer

What you see (at design) ≠ what you get (at fab)

Wafer Design target

slide-3
SLIDE 3

Mask Topography Effects in Advanced Lithography

Near-field Aerial image Near-field Aerial image Source Condenser Mask Lens Pupils Resist Substrate

Thin mask approximation (Kirchhoff) Thick mask approximation

Pupils

3

slide-4
SLIDE 4

Aerial Image Generation

4

Resist Pattern Mask Layout Aerial Image Slicing Threshold

Optical model Resist model Post processing

h = 0 nm h = 10 nm h = 60 nm h = 70 nm . . . h = 110 nm h = 120 nm . . .

x y Intensity

Optical model (thin/thick mask)

2D aerial image at certain resist height

slide-5
SLIDE 5

Image-to-Image Translation Problems

Computer Vision & Machine Learning Computer Graphics & Computational Photography

Semantic labeling [Long et al. 15’] Boundary detection [Xie and Tu. 15’] Image colorization [Zhang et al. 16’] Super-resolution [Johnson et al. 16’]

[“On Image-to-Image Translation”, Jun-Yan Zhu]

slide-6
SLIDE 6

Image-to-Image Translation In Lithography

These applications are all single-domain transfer

6

ILT Engine Generator

GAN-OPC [Yang+, DAC’18]

. .

Mask pattern Aerial image Threshold Resist pattern Optical model Resist model Contour processing LithoGAN

Encoder Decoder Generator Discriminator Real Input Fake Diff Fake/Real

GAN-SRAF [Alawieh+, DAC’19] LithoGAN [Ye+, DAC’19]

slide-7
SLIDE 7

Cast as Multi-Domain Image-to-Image Translation

⧫ Facial image translation (facial attributes/expressions)

› Bidirectional translation: original domain ⇔ target domain

⧫ Single mask pattern to multiple resist heights

› Unidirectional translation: original domain ⇒ target domain

Input . . . h = 0 nm h = 10 nm h = 20 nm h = 90 nm h = 100 nm h = 110 nm h = 120 nm

7

slide-8
SLIDE 8

Multi-Domain Image-to-Image Translation

T1

<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>

T1

<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>

T2

<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>

T2

<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>

Tm

<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>

Tm

<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>

Ti

<latexit sha1_base64="RGY3D1jZgdJQcGWGlGkDWHCORWM=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpF262YTdjVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJIJr47rfTmFjc2t7p7hb2ts/ODwqH5+0dZwqhi0Wi1h1A6pRcIktw43AbqKQRoHATjC5m/udJ1Sax7Jpgn6ER1JHnJGjZUemwM+KFfcqrsAWSdeTiqQozEof/WHMUsjlIYJqnXPcxPjZ1QZzgTOSv1UY0LZhI6wZ6mkEWo/W5w6IxdWGZIwVrakIQv190RGI62nUWA7I2rGetWbi/95vdSEN37GZIalGy5KEwFMTGZ/02GXCEzYmoJZYrbWwkbU0WZsemUbAje6svrpH1V9WrV2kOtUr/N4yjCGZzDJXhwDXW4hwa0gMEInuEV3hzhvDjvzseyteDkM6fwB87nDyv+jbs=</latexit>

Ti

<latexit sha1_base64="RGY3D1jZgdJQcGWGlGkDWHCORWM=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpF262YTdjVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJIJr47rfTmFjc2t7p7hb2ts/ODwqH5+0dZwqhi0Wi1h1A6pRcIktw43AbqKQRoHATjC5m/udJ1Sax7Jpgn6ER1JHnJGjZUemwM+KFfcqrsAWSdeTiqQozEof/WHMUsjlIYJqnXPcxPjZ1QZzgTOSv1UY0LZhI6wZ6mkEWo/W5w6IxdWGZIwVrakIQv190RGI62nUWA7I2rGetWbi/95vdSEN37GZIalGy5KEwFMTGZ/02GXCEzYmoJZYrbWwkbU0WZsemUbAje6svrpH1V9WrV2kOtUr/N4yjCGZzDJXhwDXW4hwa0gMEInuEV3hzhvDjvzseyteDkM6fwB87nDyv+jbs=</latexit>

Source domain Target domain 1 Target domain 2 Target domain i Target domain m Encoders Decoders Source domain Target domain 1 Target domain 2 Target domain i Target domain m i Target domain label Encoder Decoder

⧫ #Models scales up with #domains ⧫ Models are independent ⧫ Exploit the high correlation between

different domains Simple model Ideal model

8

slide-9
SLIDE 9

Multi-Domain Image Translation

⧫ ComboGAN [Anoosheh+, arXiv’17]

T1

<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>

S

<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>

S

<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>

T1

<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>

T2

<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>

T2

<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>

Tm

<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>

Tm

<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>

Cycle loss GAN loss

Generators Discriminators

Ti

<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>

S

<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>

S

<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>

Ti

<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>

S

<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>

Ti

<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>

Inference Joint training for the m different 2- domain transfer models, i ∈ {1,2,...,m}

9

slide-10
SLIDE 10

Multi-Domain Image Translation

⧫ StarGAN [Choi+, CVPR’18]

1 1

Reconstructed image Fake image Input image Target domain Fake image Source domain Fake image Real / Fake Domain classification

Original-to-target domain Target-to-original domain Fooling the discriminator

Concat Concat 10

slide-11
SLIDE 11

Special Properties about Aerial Image Generation

⧫ Target-to-source domain transfer is difficult

› Mask shape has sharp edges › Model is not guaranteed to generate polygon shapes › Sharp edges can complicate gradient propagation

Source domain Target domain

11

slide-12
SLIDE 12

Special Properties about Aerial Image Generation

⧫ Similarity between target domains

› Intensity values at same (x, y) location change smoothly across target domains › Latent space carries the most critical information

A B

X (um) Z (um)

A B

12

slide-13
SLIDE 13

Generator Design

Encoder Decoder Latent space Target domain i 1 Target domain

i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Concat

Source domain Encoder Decoder Latent space Target domain i

Label

+

<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>

i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Source domain Concat

13

G1 G2

slide-14
SLIDE 14

Discriminator Design

Real/Fake? Discriminator Concat 1

i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Label i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Real/Fake? Discriminator Concat

14

Ordinal encoding: single channel to denote all the domains The !-th domain: "#$%&"#'(

)

* ! + ,-./ D1 D2

slide-15
SLIDE 15

TEMPO

Encoder Decoder Label Real/Fake? Label Latent space Source domain Discriminator +

<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>

Target domain i

i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Concat Concat 15

⧫ Combination of G2 and

D2

⧫ Compact ⧫ Information sharing ⧫ Lower risk of overfitting

slide-16
SLIDE 16

Can We Further Improve Accuracy?

⧫ Thin mask simulation can provide

guidance

⧫ Thin mask simulation is relatively

fast

500 1000 1500 0.00 0.02 0.04 0.06 0.08 0.10 0.12 Intensity Thin Thick Encoder Decoder Latent space Target domain i (thick mask) Label i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Real/Fake? Discriminator Concat Aerial image (thin mask)

Label

+

<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>

i

<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>

Source domain Concat Concat

16

slide-17
SLIDE 17

TEMPO Overall Flow

17

Mask pattern Thin mask model ∼Hours Aerial image (thin mask) CGAN ∼Minutes Aerial image (thick mask) Mask pattern CGAN ∼Minutes Aerial image (thick mask) Mask pattern Rigorous thick mask model ∼Days Aerial image (thick mask)

Scheme 2 Scheme 1 Rigorous Simulation

TEMPO

Runtime for 1000 mask clips

slide-18
SLIDE 18

Experimental Setup

⧫ Python 2.7 + Tensorflow 1.4.1 ⧫ GPU: Nvidia TITAN Xp ⧫ SRAF, OPC: Mentor Graphics Calibre ⧫ Aerial image by rigorous simulation: Synopsys S-Litho ⧫ 966 mask clips at 10nm node

› Different types of contact arrays [Lin+, TCAD’18] › 75% for training, 25% for test

18

slide-19
SLIDE 19

Experimental Results

⧫ Across-height information sharing benefits performance ⧫ Latent space encoding in generator gives better accuracy ⧫ Ordinal encoding in discriminator further improves accuracy

19

10 20 30 40 50 60 70 80 90 100 110 120 Height (nm) 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 NRMSE (10−2) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) 20 40 60 80 100 120 140 160 180 200 220 240 Height (nm) 2 4 6 8 10 12 14 RMSE (10−4) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) 10 20 30 40 50 60 70 80 90 100 110 120 Height (nm) 2 4 6 8 10 12 14 RMSE (10−4) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) Different generators Different discriminators

Apply different models in Scheme 2

slide-20
SLIDE 20

Experimental Results

20

Bottom Middle Top Golden Scheme 1 Diff Scheme 2 Diff Input

slide-21
SLIDE 21

Experimental Results

21

Bottom Middle Top Golden Scheme 1 Diff Scheme 2 Diff Input

slide-22
SLIDE 22

CD Error and Runtime Comparison

22 1 2 3 4 CD error in the X direction (nm) 50 100 Count Baseline (Scheme 1) TEMPO (Scheme 1) Baseline (Scheme 2) TEMPO (Scheme 2) 1 2 3 4 CD error in the Y direction (nm) 50 100 Count

900 1000 1100 1200 Sim. ML Rigorous Scheme 1 Scheme 2 50 Minutes

1X 44X 1170X

Baseline: the individual model approach

slide-23
SLIDE 23

Conclusion

⧫ TEMPO: framework for 3D aerial image generation considering

mask topography effects

⧫ One-fits-all CGAN model

› Novel target domain encoding › Compact › Superior accuracy: leveraging across-domain information sharing

⧫ Two schemes provide trade-offs between accuracy and efficiency

23

slide-24
SLIDE 24

Thank you!