machine learning to remove pileup at the lhc
play

(Machine) Learning to Remove Pileup at the LHC BSM/LHC/DM Journal - PowerPoint PPT Presentation

(Machine) Learning to Remove Pileup at the LHC BSM/LHC/DM Journal Club Eric M. Metodiev Center for Theoretical Physics, Massachusetts Institute of Technology Based on: Patrick T. Komiske, EMM, Benjamin Nachman, Matthew D. Schwartz,


  1. (Machine) Learning to Remove Pileup at the LHC BSM/LHC/DM Journal Club Eric M. Metodiev Center for Theoretical Physics, Massachusetts Institute of Technology Based on: Patrick T. Komiske, EMM, Benjamin Nachman, Matthew D. Schwartz, arXiv:1707.08600 September 8, 2017 Eric M. Metodiev (MIT) PUMML September 8, 2017 1 / 25

  2. Overview Pileup Jet Images Pileup Mitigation with Machine Learning (PUMML) Performance and Robustness What is being learned? Eric M. Metodiev (MIT) PUMML September 8, 2017 2 / 25

  3. Pileup Eric M. Metodiev (MIT) PUMML September 8, 2017 3 / 25

  4. Pileup Pileup problem in context Presently: ∼ 20 pileup vertices per bunch crossing Run 3: ∼ 80 pileup vertices per bunch crossing HL-LHC: ∼ 200 pileup vertices per bunch crossing Eric M. Metodiev (MIT) PUMML September 8, 2017 4 / 25

  5. Pileup Pileup p T is roughly uniform in pseudorapidity and azimuth. Charged particles with p T > 500 MeV can be ID’d as pileup from tracking. The problem is thus to predict the neutral leading vertex (LV) p T . Eric M. Metodiev (MIT) PUMML September 8, 2017 5 / 25

  6. Mitigation Approaches Pileup Per Particle Identification (PUPPI) Bertolini, Harris, Low, and Tran, arXiv:1407.6013 Correct particle/calorimeter energies based on surrounding charged pileup distribution. SoftKiller Cacciari, Salam, Soyez, arXiv:1407.0408 Dynamically determined transverse momentum cut. Jet Cleansing Krohn, Low, Schwartz, Wang, arXiv:1309.4777 Rescaling subjet four-momenta using charged leading vertex/pileup information. Used default parameters to give sense of performance. Eric M. Metodiev (MIT) PUMML September 8, 2017 6 / 25

  7. Machine Learning? How to input the information? The spirit is to organize all of our available local information. Have information on whether charged particles are pileup or not. Need low-level inputs. What sort of architecture? Use tools from modern machine learning. Don’t necessarily have to go “deep” What sort of loss function? Eric M. Metodiev (MIT) PUMML September 8, 2017 7 / 25

  8. Jet Images Treat the detector as a camera and energy deposits as pixel intensities. Cogan, Kagan, Strauss, Schwartzman. arXiv:1407.5675 Make use of the extensively developed computer vision technology, such as convolutional neural nets. de Oliviera, Kagan, Mackey, Nachman, Schwartzman. arXiv:1511.05190 Translated Translated Eric M. Metodiev (MIT) PUMML September 8, 2017 8 / 25

  9. Modern ML in HEP An overview of recent machine learning applications with jet images. Classification W vs QCD jets. (de Oliviera, Kagan, Mackey, Nachman, Schwartzman. arXiv:1511.05190 ) Top vs QCD jets. (Kasieczka, Plehn, Russell, Schell. arXiv:1701.08784 ) Quark vs Gluon jets. (Komiske, EMM, Schwartz. arXiv:1612.01551 ) And more... Generation Generative model. (de Oliveira, Paganini, Nachman. arXiv:1701.05927 ) Regression This work. Eric M. Metodiev (MIT) PUMML September 8, 2017 9 / 25

  10. Our Model Inputs: three-channel RGB “pileup image” red = p T of all neutrals green = p T of charged PU blue = p T of charged LV Output: neutral image output = p T of neutral LV Eric M. Metodiev (MIT) PUMML September 8, 2017 10 / 25

  11. Our Study Process Leading vertex: 500GeV scalar to dijets with Pythia8 R = 0 . 4 anti- k T jets in | η | < 2 with p T > 100 GeV. Pileup: NPU=140 Poissonian of soft QCD events overlaid. Image parameters: Charged jet image pixel resolution: ∆ η × ∆ φ = 0 . 025 × 0 . 025 Neutral jet image pixel resolution: ∆ η × ∆ φ = 0 . 1 × 0 . 1 Jet image size 0 . 9 × 0 . 9 Leading vertex/pileup information for charged particles with p T > 500 MeV Eric M. Metodiev (MIT) PUMML September 8, 2017 11 / 25

  12. Architecture What sort of neural network layers should we use? Dense: Units connected to every input pixel with different weights Locally connected: Units connected to local input patches with different weights Convolutional: Units connected to local input patches with weight sharing Eric M. Metodiev (MIT) PUMML September 8, 2017 12 / 25

  13. Architecture Architecture: Two convolutional layers 6 × 6 filter sizes 10 filters per layer Only 4711 parameters Architecture is local : Pileup removal of a pixel depends only on the information in a window around it Can apply the trained model at the event-level, jet level, or on any specified region Eric M. Metodiev (MIT) PUMML September 8, 2017 13 / 25

  14. PUMML Framework Eric M. Metodiev (MIT) PUMML September 8, 2017 14 / 25

  15. Subtracted Jets An example event with pileup and subtracted with each method. Loss function: Should we treat all p T errors equally or penalize hard/soft errors more? � 2 � p (pred) � � + ¯ p T ℓ = log , p (true) + ¯ p T with ¯ p → 0 favoring soft pixels and ¯ p → ∞ favors all p T equally. Eric M. Metodiev (MIT) PUMML September 8, 2017 15 / 25

  16. Subtracted Observables Distributions before and after subtraction of jet p T and dijet mass Eric M. Metodiev (MIT) PUMML September 8, 2017 16 / 25

  17. Subtracted Observables Distributions before and after subtraction of jet mass and N 95 . Eric M. Metodiev (MIT) PUMML September 8, 2017 17 / 25

  18. Subtracted Observables Distributions before and after subtraction of two energy correlation functions. Eric M. Metodiev (MIT) PUMML September 8, 2017 18 / 25

  19. Model Robustness 1.00 1.00 0.98 0.98 Jet Mass Correlation Coefficient Jet Mass Correlation Coefficient 0.96 0.96 0.94 0.94 0.92 0.90 0.92 PUMML, m φ = 200 GeV 0.88 PUMML trained on NPU=20 PUMML, m φ = 2000 GeV 0.90 PUMML trained on NPU=140 0.86 PUPPI PUPPI 0.88 SoftKiller SoftKiller 0.84 0 25 50 75 100 125 150 175 300 400 500 600 700 800 900 NPU m φ (GeV) Study robustness to pileup by Study robustness to the process training and testing with by training and testing with different NPU. different m φ . Eric M. Metodiev (MIT) PUMML September 8, 2017 19 / 25

  20. What is being learned? Train a single 12 × 12 filter and inspect it. Pixel-wise, PUMML learns: p N,LV T, PUMML ≈ p N,tot − βp C,PU T T This is of the same parametric form as Linear Cleansing! p N,LV T, Linear Cleansing = p N,tot γ 0 ) p C,PU + (1 − 1 T T ¯ Eric M. Metodiev (MIT) PUMML September 8, 2017 20 / 25

  21. What is being learned? p N,LV T, PUMML ≈ p N,tot − βp C,PU T T Robust as NPU → 0 despite training on � NPU � =140. Can we understand PUMML’s β ? It depends on your loss function: → β ∗ = � p N,PU � ℓ = |� p N,LV T, True � − � p N,LV T T, Pred �| − � p C,PU � T → β ∗ = � p N,PU p C,PU � ℓ = � ( p N,LV T, True − p N,LV T, Pred ) 2 � − T T . � ( p C,PU ) 2 � T Thinking about what PUMML learned suggested including charged/neutral PU correlations in the subtractor. This perspective could extend Jet Cleansing in interesting ways. Eric M. Metodiev (MIT) PUMML September 8, 2017 21 / 25

  22. What is being learned? PUMML Parameter Space 2.0 PUPPI 1.5 Number of Layers 1.0 0.5 Linear Cleansing Non - Linear Cleansing 0.0 0 5 10 15 20 Number of Filters Eric M. Metodiev (MIT) PUMML September 8, 2017 22 / 25

  23. Learning from Data Training from simulation risks mis-modelling issues Prefer to train on data rather than simulation Data overlay approach using minimum bias and zero-bias events already used by experimental groups in other contexts. Promising for training PUMML directly with data for the relevant application. Eric M. Metodiev (MIT) PUMML September 8, 2017 23 / 25

  24. Concluding Remarks We have developed an ML framework that successfully organizes all of the availabe local information to directly learn to mitigate pileup. Can use tools from modern machine learning without going “deep”. Thinking about what the machine is learning may teach us something. Pileup mitigation can be a good proving ground for modern machine learning techniques in high energy physics. Eric M. Metodiev (MIT) PUMML September 8, 2017 24 / 25

  25. The End Thank You! Eric M. Metodiev (MIT) PUMML September 8, 2017 25 / 25

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend