production grant DUNE UK DAQ workshop, Oxford, 2019.10.17 1 Oct - - PowerPoint PPT Presentation

Oct 2019 SJM Peeters | UK Production Grant: Overview 1

Overview

• f the

DUNE UK DAQ production grant

DUNE UK DAQ workshop, Oxford, 2019.10.17

DAQ consortium view

Oct 2019 SJM Peeters | UK Production Grant: Overview 2

Consortium lead Technical lead Resources coordination SW/FW coordination Integration & support coordination

Facility WG Upstream DAQ WG Dataflow WG Data Selection WG Control Configuration Monitoring WG Data Monitoring WG Physics Performance WG

• J. Brooke
• K. Hennessy
• G. Lehmann

Miotto

• A. Thea
• D. Newbold
• R. Sipos
• K. Biery
• P. Rodrigues
• G. Barr
• G. Karagiorgi

TBD

• J. Klein
• S. Peeters
• A. Habig
• B. King

TBD

DUNE/LBNF management DAQ institutes

• reps. board
• F. Filthaut

UK DAQ production project view

2.0 Project Management 2.1 Front End Trigger and Data Buffering module Giles Barr Simon Peeters (project managers) David Cussans (project engineer) Jim Brooke 2.2 Back End Dataflow and Triggering Phil Rodrigues 2.3 Timing System David Cussans 2.4 Facility and Operations Tim Durkin 2.5 Simulation and performance Simon Peeters 2.6 ProtoDUNE data taking and System Test Karol Hennessey

Oct 2019 SJM Peeters | UK Production Grant: Overview 3

See PPRP project proposal

(7 yrs, starting 2019.10.1)

Largest WP by far, with sub-WPs

Nine UK Institutes (DAQ) PIs

• Birmingham: Alan Watson
• Bristol: Jim Brooke
• Edinburgh: Franz Muheim
• IC: Morgan Wascko
• Liverpool: Karol Hennessy
• Oxford: Giles Barr
• Sussex: Simon Peeters
• RAL: Claire Shepherd-Themistocleous
• UCL: Ryan Nichol

Oct 2019 SJM Peeters | UK Production Grant: Overview 4

UK DAQ production project view

Oct 2019 SJM Peeters | UK Production Grant: Overview 5

(Summary from: DUNE UK PMP)

D: deliverable IM: international milestone M: milestone

UK DAQ group will need to appear twice per year in front of OsC to:

• update on

progress re M/D/IM

• if needed, request

change to milestones, spending profile

Consortium view

Oct 2019 SJM Peeters | UK Production Grant: Overview 6

Oct 2019 SJM Peeters | UK Production Grant: Overview 7

Milestones and Deliverables Task Name Start

D2.1-1 Schematic and layout of prototype 2 complete Mon 06/01/20 D2.1-2 Main production tender out Mon 14/02/22 D2.1-3 Main production out Mon 28/03/22 IM1 Upstream DAQ Architecture Technology Decision Tue 23/06/20 IM2 Start of ProtoDUNE SP-II Installation Tue 16/03/21 IM3 DAQ hardware and firmware EDR Tue 15/02/22 M2.1-4 Small production for test-stands complete Mon 30/03/20 M2.1-5 Final prototype testing complete Wed 09/11/20 M2.1-6 Mods for production complete Mon 14/02/22 M2.1-7 Mods for production tested Mon 14/02/22 M2.1-8 Installation complete Mon 30/01/23 M2.1-9 Main production tender docs started Mon 04/01/21 M2.1-10 Long-lead time components for main production ordered Mon 15/03/21 M2.1-11 Main production tender finished Mon 28/03/22 M2.1-12 Main PBM production completed Mon 10/10/22

2.1.1 PBM Hardware

Babak Abi Jim Brooke

2.1 Front End Trigger and Data Buffering Module

Oxford: Abi, Wastie, Hastings UCL: Kilani IMP: EE1 (RAL)

Oct 2019 SJM Peeters | UK Production Grant: Overview 8

2.1.2 PBM Board test QC system

Jim Brooke

Milestones and Deliverables Task Name Start

D2.1-4 PBM Test and repair facility setup complete Fri 21/04/23 M2.1-1 PBM QC for ProtoDUNE II mini-production of PBMs Mon 21/12/20 M2.1-2 PBM QC for main production prepared Mon 14/03/22 M2.1-3 PBM QC for main production completed Mon 16/01/23

Jim Brooke

2.1 Front End Trigger and Data Buffering Module

Birmingham: Watson, Staley UCL: Kilani IMP: EE1 (Bristol)

Oct 2019 SJM Peeters | UK Production Grant: Overview 9

2.1.3 Firmware

David Cussans

Milestones and Deliverables Task Name Start

D2.1-5 ProtoDUNE FW integration test with PBM/FELIX Mon 30/03/20 IM3 Final integration test Mon 26/09/22 M2.1-13 Define final input protocol with WIB/FELIX Mon 02/03/20 M2.1-14 Define final output protocol for trigger and event streams with FELIX Mon 02/03/20 M2.1-15 ProtoDUNE FW integration test with dev board Mon 16/12/19 M2.1-16 Storage/SSD structure prototyped Mon 16/03/20 M2.1-17 Define monitoting protocols and destinations Mon 24/02/20 M2.1-19 Storage/SSD functions completed Mon 19/04/21 M2.1-20 FW integrated pre-PBM mini-production Mon 09/11/20 M2.1-21 FW integrated for finalPBM tests pre-prod Mon 25/10/21 M2.1-23 FW integrated for PBM QC & initial SURF install Mon 26/09/22 M2.1-27 Hit finding & compr. iteration in framework Mon 18/11/19 M2.1-29 Pre-LAr-fill release of FW/cSW ready Mon 05/06/23 M2.1-30 Post-Lar-fill (noise & monitor tuneup) complete Fri 28/02/25 M2.1-31 Hit finding & compr. operating on ProtoDUNE data Mon 24/02/20 M2.1-32 FW framework and modules in ProtoDUNE repository and release management Mon 25/11/19

Jim Brooke

2.1 Front End Trigger and Data Buffering Module

Birmingham: Watson, Bracinik, Gonella Bristol: Cussans, vice-Newbold, BRI-ENG Imperial: EE1 UCL: Motuk Oxford: Wastie RAL: RAL-PDRA1

Oct 2019 SJM Peeters | UK Production Grant: Overview 10

2.1.4 Control Software

RAL PDRA

Milestones and Deliverables Task Name Start

D2.1-6 Integration between PBFW/cSW and run control at SURF Fri 17/05/24 M2.1-18 cSW accesses all low-level functions Thu 24/12/20 M2.1-22 Integration between PBFW/cSW and VST run control in UK/CERN Sat 20/11/21 M2.1-24 Configuration and monitoring features prototyped Sun 23/05/21 M2.1-25 cSW spins through run state machine Sat 14/01/23 M2.1-26 Configuration and monitoring features complete Sat 19/03/22 M2.1-28 Integration of FW/cSW with backend complete Fri 20/10/23

Jim Brooke

2.1 Front End Trigger and Data Buffering Module

Bristol: Rademacker, Kothekar Birmingham: S. Hillier RAL: RAL-PDRA1, Sussex: SUS-PDRA1 UCL: L. Cremonesi

Oct 2019 SJM Peeters | UK Production Grant: Overview 11

Jim Brooke

2.1.5 Photodetector interface

Miquel Nebot (tbc)

Milestones and Deliverables Task Name Start

M2.1-32 Photon detector interface to DAQ defined Sun 28/06/20 M2.1-33 Photon detector readout prototype tested Fri 18/02/22 M2.1-34 Photon detector readout interface installed Wed 11/10/23

2.1 Front End Trigger and Data Buffering Module

Edinburgh: Muheim, Nebot UCL: Campanelli

Oct 2019 SJM Peeters | UK Production Grant: Overview 12

Phil Rodrigues

2.2 Back End Dataflow and Triggering

Milestones and Deliverables Task Name Start

D2.2-1 Trigger farm chain full VST Mon 20/09/21 D2.2-3 Computing equipment received/OS-installed Fri 14/04/23 D2.2-4 Computers for cavern 2 delivered to SURF Tue 01/04/25 IM4 Cavern 1 ready for TPC installation Wed 31/05/23 IM5 Cavern 1 HW test & ship complete Fri 30/06/23 M2.2-1 Dataflow and trigger techniques finalised Mon 02/12/19 M2.2-2 Global trigger design complete Mon 02/03/20 M2.2-3 Level 2 trigger prototype dataflow Mon 27/04/20 M2.2-4 Global trigger prorotype in VST Thu 27/08/20 M2.2-5 Trigger farm fan-in production test Mon 25/01/21 M2.2-6 Level 2 trigger prototype full algorithm Mon 22/03/21 M2.2-7 Event builder/L2 production test Mon 17/01/22 M2.2-8 Computing equipment specs defined Fri 16/09/22 M2.2-9 Comupting procurement/tender docs completed Thu 15/12/22 M2.2-10 Final Global trigger ready for SURF (12/22) Thu 15/12/22 M2.2-11 Computers delivered to SURF Tue 13/06/23 M2.2-12 Computing procurement setup for cavern 2 Thu 03/10/24 M2.2-13 Computers for cavern 2 arrive/OS-install Fri 31/01/25

Oxford: Barr, Rodrigues IC: Tapper, IMP-PDRA2/EE RAL: RAL-PDRA2 Sussex: Lasorak

2.3 Timing System

Oct 2019 SJM Peeters | UK Production Grant: Overview 13

David Cussans

Milestones and Deliverables Task Name Start

D2.3-1 Working GPS receiver in CUC-DC Tue 16/01/24 D2.3-2 Timing system master crate for SP cavern 1 Mon 17/10/22 D2.3-3 Timing system master crate for SP cavern 2 Mon 17/10/22 M2.3-1 Confirm uTCA as form factor for SP timing Tue 01/10/19 M2.3-2 Initial uTCA board timing design based on pDUNE complete Thu 28/05/20 M2.3-3 First timing prorotype SP HW made and tested Sat 23/01/21 M2.3-4 Timing FW changes (new endpoint) planned Tue 23/02/21 M2.3-5 Second timing prototype SP HW made and tested Mon 20/09/21 M2.3-6 Design of GPS/GLONASS complete Wed 18/05/22 M2.3-7 Production timing SP hardware completed (7/22) Sun 17/07/22 M2.3-8 Procure GPS/fibre transceiver equipment Tue 09/08/22 M2.3-9 Timing FW changes (new endpoint) completed Fri 03/06/22 M2.3-10 Integration of timing with cavern 1 RC complete Thu 01/02/24 M2.3-11 Integration of timing with cavern 2 RC complete Mon 03/02/25 M2.3-12 Support of timing systems with readouts complete Mon 27/07/26

Bristol: Cussans, Stoyan Stoynev, Kothekar

2.4 Facility and Operations

Oct 2019 SJM Peeters | UK Production Grant: Overview 14

Tim Durkin

Milestones and Deliverables Task Name Start

D2.4-1 Test partition at SURF operational Fri 19/01/24 D2.4-2 Cavern 1 main partition at SURF operational (1/24) Fri 19/01/24 D2.4-3 Cavern 1 main partition 90% complete Fri 01/08/25 D2.4-4 Test partition for cavern 2 at SURF operational Thu 27/03/25 D2.4-5 Cavern 2 main partition at SURF operational (3/25) Thu 27/03/25 D2.4-6 Cavern 2 main partition 90% complete Thu 02/07/26 D2.4-7 Backend commissioned (9/26) Fri 25/09/26 IM6 Cavern 1 system commission start Mon 22/01/24 IM7 Cavern 1 ready for operation Mon 04/08/25 IM8 Cavern 2 system commissioning start Mon 15/12/25 IM9 Cavern 2 ready for operation Fri 03/07/26 M2.4-1 Review installation plan, constraints, interfaces Fri 28/02/20 M2.4-2 Review DAQ plant, cable trays, racks Fri 26/02/21 M2.4-3 Procurement plan UK supplier eqpt, (e.g. racks) Fri 10/09/21 M2.4-4 Timing installation planning finalised Fri 10/09/21 M2.4-5 Install timing GPS antennae + fibre complete Fri 21/07/23 M2.4-6 GPS to CUC connection completed Fri 13/10/23 M2.4-7 Installation of timing cavern 1 complete (7/24) Fri 05/07/24 M2.4-8 Installation of cavern 1 timing in CUC complete Fri 05/07/24 M2.4-9 Installation of timing cavern 2 complete (9/24) Thu 11/09/25 M2.4-10 Installation of cavern 2 timing in CUC complete Thu 11/09/25 M2.4-11 Commissioning of cavern 1 timing complete Fri 29/08/25 M2.4-12 Commissioning of cavern 2 timing complete Thu 27/08/26 M2.4-13 PBMs installed in computers, not underground yet Fri 13/10/23 M2.4-14 Computers installed cavern 1 Fri 02/08/24 M2.4-15 Global trigger for cavern 1 in main partition Fri 10/05/24 M2.4-16 Global trigger receives/uses Fermilab spill info Fri 27/09/24 M2.4-17 Level 2 trigger active in cavern1 (9/24) Fri 27/09/24 M2.4-18 Computers installed cavern 2 Fri 11/04/25 M2.4-19 Global trigger for cavern 2 in main partition Thu 17/07/25 M2.4-20 Level 2 trigger active in cavern 2 (12/25) Thu 04/12/25

Activities are planned for the installation of:

• ptical cable (T. Durkin)
• PBMs (Hastings, Wastie, UCL-

PDRA)

• computers (Rodrigues, SUS-PDRA1)
• timing system (Kothekar, Cussans)

Commissioning will be lead by Cussans.

2.5 Simulation and Performance

Oct 2019 SJM Peeters | UK Production Grant: Overview 15

Simon Peeters

Milestones and Deliverables Task Name Start

M2.5-1 Initial DAQ SimFramework complete Fri 01/11/19 M2.5-2 DAQ SimFramework with protoDUNE data complete Wed 01/07/20 M2.5-3 DAQ SimFramework for protoDUNE II complete Wed 03/03/21 M2.5-4 DAQ SimFramework for as-built DUNE cavern 1 complete Thu 01/08/24 M2.5-5 DAQ SimFramework for as-built DUNE cavern 2 complete Fri 01/08/25

Milestones and Deliverables Task Name Start

M2.5-6 Initial DAQ monitoring framework complete Mon 02/12/19 M2.5-7 DAQ monitoring for protoDUNE complete Wed 01/07/20 M2.5-8 DAQ monitoring framework for protoDUNE II complete Tue 02/03/21 M2.5-9 DAQ monitoring for DUNE construction complete (8/24) Thu 01/08/24 M2.5-10 DAQ monitoring for production data taking cavern 1 complete Fri 01/08/25 M2.5-11 DAQ monitoring for production data taking cavern 2 complete Tue 01/12/26

Milestones and Deliverables Task Name Start

M2.5-12 Physics performance framework complete Wed 29/04/20 M2.5-13 Physics performance for lowE physics complete Wed 01/07/20 M2.5-14 Physics performance for EDR complete Wed 01/12/21 M2.5-15 L2 prototype framework Mon 01/03/21 M2.5-16 Physics performance study for L2 trigger complete Thu 02/12/21 M2.5-17 Physics performance study for as-built cavern 1 detector complete Thu 01/08/24 M2.5-18 L2 trigger implemenattion for DUNE construction and commissioning complete (8/24) Thu 01/08/24

Birmingham: Sergi Edinburgh: Nebot, Gambetta IC: IMP-PDRA1 Sussex: Hartnell, Lasorak, Peeters, SUS-PDRA1 UCL: Nichol, Cremonesi

2.5 ProtoDUNE Data Taking and System Test

Oct 2019 SJM Peeters | UK Production Grant: Overview 16

Milestones and Deliverables Task Name Start

D2.6-2 protoDUNE I completed with PBM & FELIX FW & SW (4/20) Tue 31/03/20 D2.6-3 protoDUNE II ready for beam run with PBM readout (3/21) Tue 16/03/21 D2.6-4 protoDUNE II beam run completed with PBM readout (10/21) Tue 26/10/21 M2.6-1 Completion of DAQ tests before 2019 ProtoDUNE shutdown Tue 17/12/19 M2.6-5 Completion of DAQ development at CERN/ProtoDUNE facility (10/23) Tue 26/09/23

Karol Hennessey All in packages 2.1, 2.2 and 2.3

Summary

• A lot has happened since writing the grant and now
• Not reflected yet:

Goal of the workshop is to address some of this

• Man power available
• International milestones
• Renaming / rethinking of some of the deliverables

Oct 2019 SJM Peeters | UK Production Grant: Overview 17