EB Front-End card upgrade Alexander Singovski, University of - PowerPoint PPT Presentation

EB Front-End card upgrade Alexander Singovski, University of Minnesota A.Singovski, Aug 29/30 2017 FNAL Technical Review - Barrel Calorimeter 1

Legacy ECAL On-detector electronics • 5x5 crystals readout granularity: Trigger Tower • Multi-gain (3 gains) amplifier and 12 bit ADC per crystal • Very-Front-End (VFE) card for 5 crystals readout • Five VFE cards are connected to one Front-End (FE) card • FE card receive Level1 trigger from CMS central trigger system • FE card contain data buffers, trigger primitives logics, clock and control logics • FE card contain two Giga Optical Link transmitters, 800Mbps each FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 2

Legacy Front End card Optical transmitters 0.8Gbps (GOL) Level 1 trigger Data flow: Per crystal : Per VFE card : Per Trigger Tower : • • • Pre-amp 3 ranges 5 VFE cards 5 crystals • • • 12 bit ADC 2.8Gbps @ 40 MHz 14Gbps @ 40 MHz • 14 bit data @ 40 MHz sampling • 560 Mbps data flow FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 3

Upgrade FE card overview New Front End card will be a relatively simple interface between new fancy Very • Frond End and very smart Off-detector electronics Spike tagging VFE & Off-detector • Functionality improvements 30ps time resolution VFE & Off-detector • either in VFE or Off-detector Crystal – based trigger Off-detector • FE tasks • Deliver high precision clock to VFE • <30ps time resolution  clock jitter ~5ps • Provide VFE components initialization and control • I2C bus • 5 VFE – 5 channels per VFE – 1-3 active nodes per channel: TIA, ADC, DTU  up to 60 I2C • nodes Receive data from VFE via high speed e-links • Transmit data off-detector via 10Gbps optical links • FE design • Based on the components of the CERN GBT and Versatile link projects • First prototypes with GBTx and VL TrxandTTx, final – with lpGBT and VL+ 4T1Rx • FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 4

Upgrade Front End card. Extended VFE performance Optical transmitters Fast 4.8Gbps (GBTx) link - x8 with compression . - x15 without compression . or . 10.24Gbps (lpGBT) Fast link - x4 with compression . - x7 without compression . . Fast Level 1 trigger link Per Trigger Tower : Per VFE card : Per crystal : • • • 5 crystals 5 VFE cards Pre-amp 2 ranges • • • 10.4Gbps @ 160 MHz 52Gbps @ 160 MHz 12 bit ADC • • • 5.4Gbps @ 160Mhz @ 27Gbps @ 160Mhz @ 13 bit data @ 160 MHz • compression compression 2080 Mbps data flow • 1080 Mbps with data compression FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 5

Upgrade optical data link: CERN GBT project FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 6

GBT extension for phase 2: lpGBT Double link speed and rad. tolerance FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 7

Upgrade FE development strategy 1. Prototype 0: FE demonstrator • Optimized for legacy VFE card • One GBTx @ one Versatile_Link data transmitter per VFE • VFE – FE data link: 5 x 14bit @ 40MHz • Test of the different clock distribution schemes 2. Prototype 1: GBTx - based FE • Can work with legacy and upgrade VFE @ (40 – 160) MHz • One GBTx @ one Versatile_Link transmitter per VFE • VFE – FE data: e-links @ (40 – 320) Mbps • Precision clock distribution 3. Prototype 2: lpGBT – based FE • Optimized for upgrade VFE @ 160MHz • Four lpGBT @ 4T1Rx VL+ • VFE-FE data: e-links @ (320 – 1280) Mbps • Optimal precision clock distribution FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 8

FE Demonstrator Legacy VFE card VFE- FE adapter card NEW FE card Multimode Off-detector: optical CTP7 cable GBT AD41240 MGPA GBTx AD41240 GBT MGPA FPGA GBTx AD41240 MGPA GBT AD41240 MGPA GBTx AD41240 MGPA GBT 5x14 single GBTx Gbit ended LVDS Eithernet outputs, 40MHz GBT 5x10 configurable GBTx differential serial inputs, up to 320MHz FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 9

FE Demonstrator status Lessons learned • Reference clock to GBTx • Resynch clock for stable operation • Power delivery to GBTx chips • >3W per GTBx chip, more power layers required • I2C operation • Special attention of GBTx – GBT-SCA connection and BGT- Current design SCA configuration 1. External ref. clock to TRx channel • Clock to VFE cards Resync clock to Tx channels  TRx and two Tx channels work • All clocks from ONE source, 2. I2C via external electrical interface avoid PLL in the clock distribution chain FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 10

FE development plans  Current version: “educated FE demonstrator”, Q4 2017  1 VTRx & 1 VTTx VL module,  Can receive data from 3 legacy VFE  Will be used during October beam tests to get large spikes data sample  Next: “smart” GBTx – based EF card, Q2 2018  1 VTRx & 2VTTx VL modules,  Will receive data from 5 legacy or upgrade VFE  Clock to VFE from one source  I2C via optical down-link  “Realistic” lpGBT – based FE card Q1 2019  V4T1Rx+ VL+ optical module  Optimal clock to VFE distribution FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 11

FE production plans  Preproduction series Q4 2019  100 FE cards produced  Sufficient for one Super Module  Full functional test, SM37 2020  Spare Super Module 37 equipped with upgrade on-detector electronics  Power and thermal in the lab  Beam test at CERN  Production 2022-2023 FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 12

lpGBT – based design, VFE-FE interface 1. ADC-DTU specs: With data compression:  1.08 Gb/s for: 12 bit ADC + 1 bit apmli range @ 160mHz sampling  2. T ower structure: 25 towers per FE, 27 Gb/s total data rate  lpGBT: Fec5 @ 10.24 Gb/s, user data rate 8.96 Gb/s  27 ÷ 8.96 = 3.0134  4 lpGBT needed to cover the full rate  3. lpGBT specs: e-links 320 / 640 / 1280 Data rate Mb/s  4 Needed / 2 / 1 per ADC (x 25 ADC per TT)  25 Needed / 12(13) / 6(7) per lpGBT(x4 lpGBT per FE)  Available 28 / 14 / 7 e-links per lpGBT chip  FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 13

VFE – FE interface Interleave samples from  ADC Each of four ADC-DTU  e-link to the different lpGBT Each lpGBT will have one  link from each of 25 ADC- DTU In case of the optical  channel loss, no dead channels  only ¼ of samples  are lost FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 14

ECAL Barrel cooling system  Legacy cooling system  Power dissipation – 2.5W per channel  Cooling system capacity – 3W per channel  Legacy Trigger Tower  2.5W per channel  62.5W per Tower  Major power consumption by VFE cards  FE card contribution – 2.5W  Max temperature of the FE card chips 37C  Upgrade Tower  Maximum cooling capacity 75W /tower  Expected FE power dissipation 3.5W  Expected VFE power dissipation – less or equal to the legacy one   Sufficient cooling capacity for the Upgrade FE card FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 15

FE development: components availability  GTB components:  GBT-SCA o available now  lpGBT o first submission September-October 2017 o first samples for evaluation June 2018 o first samples for users end-2018 o preproduction 2019 o mass production 2020  VL+ components  VTRx+ o On-site assembly available now o Industrial assembly 2018-2019  V4T1Rx+ (ECAL flavor) o On-site assembly end-2017 o Industrial assembly 2019 FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 16

VL+ components ECAL version FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 17

Components radiation and B-field tolerance  All GBT and VL+ components will be certified to CMS Tracker level  10 times more severe than ECAL requirements  Fully assembled Prototype 2 board will be certified by ECAL group: full functionality test at:  Neutron irradiation to 10^14 neutrons /cm^2  Gamma irradiation 10KGy  Proton/Pion irradiation to 10^13 particles / cm^2 – SEU  Climatic chamber for ageing – conditions to be defined  2-4 Tl magnetic field FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 18

Production tests / burn in High reliability of the legacy on-detector electronics validates the testing procedure used during CMS electronics production in 2004- 2008, which will be followed during upgrade  Industrial production and assembly of all FE boards  Visual inspection and electrical test by Producer  Full functional acceptance test. Tests stands at  CERN  One or two labs outside CERN  Burning-in of ALL FE boards  Conditions to be defined  One used in 2006-2008 – 48 hours at 60C  Full functional test after burning-in FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 19

Backup slides FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017 20