Wei Ye1, Mohamed Baker Alawieh1, Yuki Watanabe2, Shigeki Nojima2, Yibo Lin3, David Z. Pan1
1ECE Department, University of Texas at Austin 2Kioxia Corporation
3CS Department, Peking University
TEMPO: Fast Mask Topography Effect Modeling with Deep Learning Wei - - PowerPoint PPT Presentation
TEMPO: Fast Mask Topography Effect Modeling with Deep Learning Wei Ye 1 , Mohamed Baker Alawieh 1 , Yuki Watanabe 2 , Shigeki Nojima 2 , Yibo Lin 3 , David Z. Pan 1 1 ECE Department, University of Texas at Austin 2 Kioxia Corporation 3 CS
1ECE Department, University of Texas at Austin 2Kioxia Corporation
3CS Department, Peking University
2
Light source Lens Photomask Projection lens Wafer
Wafer Design target
3
4
[“On Image-to-Image Translation”, Jun-Yan Zhu]
6
ILT Engine Generator
Mask pattern Aerial image Threshold Resist pattern Optical model Resist model Contour processing LithoGAN
Input . . . h = 0 nm h = 10 nm h = 20 nm h = 90 nm h = 100 nm h = 110 nm h = 120 nm
7
T1
<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>T1
<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>T2
<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>T2
<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>Tm
<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>Tm
<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>Ti
<latexit sha1_base64="RGY3D1jZgdJQcGWGlGkDWHCORWM=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpF262YTdjVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJIJr47rfTmFjc2t7p7hb2ts/ODwqH5+0dZwqhi0Wi1h1A6pRcIktw43AbqKQRoHATjC5m/udJ1Sax7Jpgn6ER1JHnJGjZUemwM+KFfcqrsAWSdeTiqQozEof/WHMUsjlIYJqnXPcxPjZ1QZzgTOSv1UY0LZhI6wZ6mkEWo/W5w6IxdWGZIwVrakIQv190RGI62nUWA7I2rGetWbi/95vdSEN37GZIalGy5KEwFMTGZ/02GXCEzYmoJZYrbWwkbU0WZsemUbAje6svrpH1V9WrV2kOtUr/N4yjCGZzDJXhwDXW4hwa0gMEInuEV3hzhvDjvzseyteDkM6fwB87nDyv+jbs=</latexit>Ti
<latexit sha1_base64="RGY3D1jZgdJQcGWGlGkDWHCORWM=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpF262YTdjVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJIJr47rfTmFjc2t7p7hb2ts/ODwqH5+0dZwqhi0Wi1h1A6pRcIktw43AbqKQRoHATjC5m/udJ1Sax7Jpgn6ER1JHnJGjZUemwM+KFfcqrsAWSdeTiqQozEof/WHMUsjlIYJqnXPcxPjZ1QZzgTOSv1UY0LZhI6wZ6mkEWo/W5w6IxdWGZIwVrakIQv190RGI62nUWA7I2rGetWbi/95vdSEN37GZIalGy5KEwFMTGZ/02GXCEzYmoJZYrbWwkbU0WZsemUbAje6svrpH1V9WrV2kOtUr/N4yjCGZzDJXhwDXW4hwa0gMEInuEV3hzhvDjvzseyteDkM6fwB87nDyv+jbs=</latexit>Source domain Target domain 1 Target domain 2 Target domain i Target domain m Encoders Decoders Source domain Target domain 1 Target domain 2 Target domain i Target domain m i Target domain label Encoder Decoder
8
T1
<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>S
<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>S
<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>T1
<latexit sha1_base64="rdI1VPpmf7sfroM+JomejvJLTug=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48V+wVtKJvtpl262YTdiVBCf4IXD4p49Rd589+4bXPQ1gcDj/dmJkXJFIYdN1vp7CxubW9U9wt7e0fHB6Vj0/aJk414y0Wy1h3A2q4FIq3UKDk3URzGgWSd4LJ3dzvPHFtRKyaOE24H9GREqFgFK302Bx4g3LFrboLkHXi5aQCORqD8ld/GLM04gqZpMb0PDdBP6MaBZN8VuqnhieUTeiI9yxVNOLGzxanzsiFVYkjLUthWSh/p7IaGTMNApsZ0RxbFa9ufif10sxvPEzoZIUuWLRWEqCcZk/jcZCs0ZyqklGlhbyVsTDVlaNMp2RC81ZfXSfuq6tWqtYdapX6bx1GEMziHS/DgGupwDw1oAYMRPMrvDnSeXHenY9la8HJZ07hD5zPH9cPjYM=</latexit>T2
<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>T2
<latexit sha1_base64="JGwn3HCr1rEwiyxU5H7FGr7jg=">AB6nicbVBNS8NAEJ3Ur1q/qh69LBbBU0lKQY9FLx4rtrXQhrLZbtqlm03YnQgl9Cd48aCIV3+RN/+N2zYHbX0w8Hhvhpl5QSKFQdf9dgobm1vbO8Xd0t7+weFR+fikY+JUM95msYx1N6CGS6F4GwVK3k0p1Eg+WMwuZ37j09cGxGrFk4T7kd0pEQoGEUrPbQGtUG54lbdBcg68XJSgRzNQfmrP4xZGnGFTFJjep6boJ9RjYJPiv1U8MTyiZ0xHuWKhpx42eLU2fkwipDEsbalkKyUH9PZDQyZhoFtjOiODar3lz8z+ulGF7mVBJilyx5aIwlQRjMv+bDIXmDOXUEsq0sLcSNqaMrTplGwI3urL6RTq3r1av2+Xmnc5HEU4QzO4RI8uIG3ET2sBgBM/wCm+OdF6cd+dj2Vpw8plT+APn8wfYk42E</latexit>Tm
<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>Tm
<latexit sha1_base64="/vU8h/lX1rESZaAHqitk6dwHbs=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k1lOVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDZz6N0w=</latexit>Cycle loss GAN loss
Generators Discriminators
Ti
<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>S
<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>S
<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>Ti
<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>S
<latexit sha1_base64="K8De1i+87C6WdepdLygVvzuCw=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2lpoQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgpr6xubW8Xt0s7u3v5B+fCoreNUMWyxWMSqE1CNgktsGW4EdhKFNAoEPgTjm5n/8IRK81jem0mCfkSHkoecUWOl5l2/XHGr7hxklXg5qUCORr/81RvELI1QGiao1l3PTYyfUWU4Ezgt9VKNCWVjOsSupZJGqP1sfuiUnFlQMJY2ZKGzNXfExmNtJ5Ege2MqBnpZW8m/ud1UxNe+RmXSWpQsWiMBXExGT2NRlwhcyIiSWUKW5vJWxEFWXGZlOyIXjL6+S9kXVq1VrzVqlfp3HUYQTOIVz8OAS6nALDWgBA4RneIU359F5cd6dj0VrwclnjuEPnM8fsGuM3g=</latexit>Ti
<latexit sha1_base64="1PoRSywEJEqnTaNqOUAhVHfnT6c=">AB63icbVBNS8NAEJ34WetX1aOXxSJ4KokU9Fj04rFCv6ANZbOdtEt3N2F3I5TQv+DFgyJe/UPe/DcmbQ7a+mDg8d4M/OCWHBjXfb2djc2t7ZLe2V9w8Oj4rJ6cdEyWaYZtFItK9gBoUXGHbciuwF2ukMhDYDab3ud9Qm14pFp2FqMv6VjxkDNqc6k15OVhperW3AXIOvEKUoUCzWHlazCKWCJRWSaoMX3Pja2fUm05EzgvDxKDMWVTOsZ+RhWVaPx0ceucXGbKiISRzkpZslB/T6RUGjOTQdYpqZ2YVS8X/P6iQ1v/ZSrOLGo2HJRmAhiI5I/TkZcI7NilhHKNM9uJWxCNWU2iycPwVt9eZ10rmtevVZ/rFcbd0UcJTiHC7gCD26gAQ/QhDYwmMAzvMKbI50X5935WLZuOMXMGfyB8/kDYSqNzw=</latexit>9
1 1
Reconstructed image Fake image Input image Target domain Fake image Source domain Fake image Real / Fake Domain classification
Original-to-target domain Target-to-original domain Fooling the discriminator
Concat Concat 10
11
X (um) Z (um)
12
Encoder Decoder Latent space Target domain i 1 Target domain
Source domain Encoder Decoder Latent space Target domain i
Label
+
<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>Source domain Concat
13
Real/Fake? Discriminator Concat 1
Label i
<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>Real/Fake? Discriminator Concat
14
Encoder Decoder Label Real/Fake? Label Latent space Source domain Discriminator +
<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>Target domain i
Concat Concat 15
500 1000 1500 0.00 0.02 0.04 0.06 0.08 0.10 0.12 Intensity Thin Thick Encoder Decoder Latent space Target domain i (thick mask) Label i
<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>Real/Fake? Discriminator Concat Aerial image (thin mask)
Label
+
<latexit sha1_base64="bj7BoGDdlh4ITPA9ScsCIRuXew=">AB7XicbVBNSwMxEJ3Ur1q/qh69BIsgCGVXBT0WvXisYD+gXUo2zbax2WRJskJZ+h+8eFDEq/Hm/GtN2Dtj4YeLw3w8y8MBHcWM/7RoWV1bX1jeJmaWt7Z3evH/QNCrVlDWoEkq3Q2KY4JI1LeCtRPNSBwK1gpHt1O/9cS04Uo+2HCgpgMJI84JdZJzW4YZWeTXrniVb0Z8DLxc1KBHPVe+avbVzSNmbRUEGM6vpfYICPacirYpNRNDUsIHZEB6zgqScxMkM2uneATp/RxpLQrafFM/T2RkdiYcRy6zpjYoVn0puJ/Xie10XWQcZmklk6XxSlAluFp6/jPteMWjF2hFDN3a2YDokm1LqASi4Ef/HlZdI8r/oX1fP7y0rtJo+jCEdwDKfgwxXU4A7q0AKj/AMr/CGFHpB7+hj3lpA+cwh/AH6/AFjro8B</latexit>i
<latexit sha1_base64="x8J7LamRs6RPHauvrsNeV18aTJE=">AB6HicbVBNS8NAEJ3Ur1q/qh69LBbBU0mkoMeiF48t2A9oQ9lsJ+3azSbsboQS+gu8eFDEqz/Jm/GbZuDtj4YeLw3w8y8IBFcG9f9dgobm1vbO8Xd0t7+weFR+fikreNUMWyxWMSqG1CNgktsGW4EdhOFNAoEdoLJ3dzvPKHSPJYPZpqgH9GR5CFn1FipyQflilt1FyDrxMtJBXI0BuWv/jBmaYTSMEG17nluYvyMKsOZwFmpn2pMKJvQEfYslTRC7WeLQ2fkwipDEsbKljRkof6eyGik9TQKbGdEzVivenPxP6+XmvDGz7hMUoOSLReFqSAmJvOvyZArZEZMLaFMcXsrYWOqKDM2m5INwVt9eZ20r6perVpr1ir12zyOIpzBOVyCB9dQh3toQAsYIDzDK7w5j86L8+58LFsLTj5zCn/gfP4A0cOM9A=</latexit>Source domain Concat Concat
16
17
Mask pattern Thin mask model ∼Hours Aerial image (thin mask) CGAN ∼Minutes Aerial image (thick mask) Mask pattern CGAN ∼Minutes Aerial image (thick mask) Mask pattern Rigorous thick mask model ∼Days Aerial image (thick mask)
18
19
10 20 30 40 50 60 70 80 90 100 110 120 Height (nm) 0.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 NRMSE (10−2) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) 20 40 60 80 100 120 140 160 180 200 220 240 Height (nm) 2 4 6 8 10 12 14 RMSE (10−4) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) 10 20 30 40 50 60 70 80 90 100 110 120 Height (nm) 2 4 6 8 10 12 14 RMSE (10−4) Individual G1+D1 G2+D1 G1+D2 G2+D2 (TEMPO) Different generators Different discriminators
20
Bottom Middle Top Golden Scheme 1 Diff Scheme 2 Diff Input
21
Bottom Middle Top Golden Scheme 1 Diff Scheme 2 Diff Input
22 1 2 3 4 CD error in the X direction (nm) 50 100 Count Baseline (Scheme 1) TEMPO (Scheme 1) Baseline (Scheme 2) TEMPO (Scheme 2) 1 2 3 4 CD error in the Y direction (nm) 50 100 Count
Baseline: the individual model approach
23