EB Front-End card upgrade Alexander Singovski, University of - - PowerPoint PPT Presentation

▶
eb front end card upgrade
SMART_READER_LITE
LIVE PREVIEW

EB Front-End card upgrade Alexander Singovski, University of - - PowerPoint PPT Presentation

Oct 19, 2023 371 likes •609 views

EB Front-End card upgrade Alexander Singovski, University of Minnesota A.Singovski, Aug 29/30 2017 FNAL Technical Review - Barrel Calorimeter 1 Legacy ECAL On-detector electronics 5x5 crystals readout granularity: Trigger Tower

slide-1
SLIDE 1

EB Front-End card upgrade

Alexander Singovski, University of Minnesota

1

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-2
SLIDE 2

2

Legacy ECAL On-detector electronics

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

  • 5x5 crystals readout granularity: Trigger Tower
  • Multi-gain (3 gains) amplifier and 12 bit ADC per crystal
  • Very-Front-End (VFE) card for 5 crystals readout
  • Five VFE cards are connected to one Front-End (FE) card
  • FE card receive Level1 trigger from CMS central trigger system
  • FE card contain data buffers, trigger primitives logics, clock and control logics
  • FE card contain two Giga Optical Link transmitters, 800Mbps each
slide-3
SLIDE 3

3

Legacy Front End card

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Per crystal:

  • Pre-amp 3 ranges
  • 12 bit ADC
  • 14 bit data @ 40 MHz
  • 560 Mbps data flow

Per VFE card:

  • 5 crystals
  • 2.8Gbps @ 40 MHz

sampling Per Trigger Tower:

  • 5 VFE cards
  • 14Gbps @ 40 MHz

Optical transmitters 0.8Gbps (GOL) Level 1 trigger

Data flow:

slide-4
SLIDE 4
  • New Front End card will be a relatively simple interface between new fancy

Very Frond End and very smart Off-detector electronics

  • Spike tagging

VFE & Off-detector

  • 30ps time resolution

VFE & Off-detector

  • Crystal – based trigger

Off-detector

  • FE tasks
  • Deliver high precision clock to VFE
  • <30ps time resolution  clock jitter ~5ps
  • Provide

VFE components initialization and control

  • I2C bus
  • 5 VFE – 5 channels per VFE – 1-3 active nodes per channel: TIA, ADC, DTU  up to 60 I2C

nodes

  • Receive data from

VFE via high speed e-links

  • Transmit data off-detector via 10Gbps optical links
  • FE design
  • Based on the components of the CERN GBT and

Versatile link projects

  • First prototypes with GBTx and

VL TrxandTTx, final – with lpGBT and VL+ 4T1Rx

4

Upgrade FE card overview

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Functionality improvements either in VFE or Off-detector

slide-5
SLIDE 5

5

Upgrade Front End card. Extended VFE performance

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Per crystal:

  • Pre-amp 2 ranges
  • 12 bit ADC
  • 13 bit data @ 160 MHz
  • 2080 Mbps data flow
  • 1080 Mbps with data

compression Per VFE card:

  • 5 crystals
  • 10.4Gbps @ 160 MHz
  • 5.4Gbps @ 160Mhz @

compression Per Trigger Tower:

  • 5 VFE cards
  • 52Gbps @ 160 MHz
  • 27Gbps @ 160Mhz @

compression Level 1 trigger

Fast link

. . . . . .

Fast link Fast link

Optical transmitters

4.8Gbps (GBTx)

  • x8 with compression
  • x15 without compression
  • r

10.24Gbps (lpGBT)

  • x4 with compression
  • x7 without compression
slide-6
SLIDE 6

6

Upgrade optical data link: CERN GBT project

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-7
SLIDE 7

7

GBT extension for phase 2: lpGBT

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Double link speed and rad. tolerance

slide-8
SLIDE 8
  • 1. Prototype 0: FE demonstrator
  • Optimized for legacy VFE card
  • One GBTx @ one Versatile_Link data transmitter per VFE
  • VFE – FE data link: 5 x 14bit @ 40MHz
  • Test of the different clock distribution schemes
  • 2. Prototype 1: GBTx - based FE
  • Can work with legacy and upgrade VFE @ (40 – 160) MHz
  • One GBTx @ one Versatile_Link transmitter per VFE
  • VFE – FE data: e-links @ (40 – 320) Mbps
  • Precision clock distribution
  • 3. Prototype 2: lpGBT – based FE
  • Optimized for upgrade VFE @ 160MHz
  • Four lpGBT @ 4T1Rx VL+
  • VFE-FE data: e-links @ (320 – 1280) Mbps
  • Optimal precision clock distribution

8

Upgrade FE development strategy

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-9
SLIDE 9

9

FE Demonstrator

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Legacy VFE card NEW FE card

AD41240

MGPA

AD41240

MGPA

AD41240

MGPA

AD41240

MGPA

AD41240

MGPA

VFE- FE adapter card Off-detector: CTP7

GBTx GBTx GBTx GBTx GBTx

GBT GBT GBT GBT GBT

Multimode

  • ptical

cable Gbit Eithernet

FPGA

5x14 single ended LVDS

  • utputs, 40MHz

5x10 configurable differential serial inputs, up to 320MHz

slide-10
SLIDE 10

10

FE Demonstrator status

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Current design

  • 1. External ref. clock to TRx channel

Resync clock to Tx channels TRx and two Tx channels work

  • 2. I2C via external electrical interface

Lessons learned

  • Reference clock to GBTx
  • Resynch clock for stable
  • peration
  • Power delivery to GBTx chips
  • >3W per GTBx chip, more

power layers required

  • I2C operation
  • Special attention of GBTx –

GBT-SCA connection and BGT- SCA configuration

  • Clock to VFE cards
  • All clocks from ONE source,

avoid PLL in the clock distribution chain

slide-11
SLIDE 11
  • Current version: “educated FE demonstrator”,

Q4 2017

  • 1 VTRx & 1 VTTx VL module,
  • Can receive data from 3 legacy VFE
  • Will be used during October beam tests to get large spikes data

sample

  • Next: “smart” GBTx – based EF card,

Q2 2018

  • 1 VTRx & 2VTTx VL modules,
  • Will receive data from 5 legacy or upgrade VFE
  • Clock to VFE from one source
  • I2C via optical down-link
  • “Realistic” lpGBT – based FE card

Q1 2019

  • V4T1Rx+ VL+ optical module
  • Optimal clock to VFE distribution

11

FE development plans

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-12
SLIDE 12
  • Preproduction series

Q4 2019

  • 100 FE cards produced
  • Sufficient for one Super Module
  • Full functional test, SM37

2020

  • Spare Super Module 37 equipped with upgrade on-detector

electronics

  • Power and thermal in the lab
  • Beam test at CERN
  • Production

2022-2023

12

FE production plans

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-13
SLIDE 13

13

lpGBT – based design, VFE-FE interface

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

  • 1. ADC-DTU specs:

With data compression:

1.08 Gb/s for: 12 bit ADC + 1 bit apmli range @ 160mHz sampling

  • 2. T
  • wer structure:

25 towers per FE, 27 Gb/s total data rate

lpGBT: Fec5 @ 10.24 Gb/s, user data rate 8.96 Gb/s

27 ÷ 8.96 = 3.0134  4 lpGBT needed to cover the full rate

  • 3. lpGBT specs:

e-links

Data rate

320 / 640 / 1280

Mb/s

Needed

4

/ 2 / 1 per ADC (x 25 ADC per TT)

Needed

25

/ 12(13) / 6(7) per lpGBT(x4 lpGBT per FE)

Available 28 / 14 / 7 e-links per lpGBT chip

slide-14
SLIDE 14

14

VFE – FE interface

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

  • Interleave samples from

ADC

  • Each of four ADC-DTU

e-link to the different lpGBT

  • Each lpGBT will have one

link from each of 25 ADC- DTU

  • In case of the optical

channel loss,

  • no dead channels
  • nly ¼ of samples

are lost

slide-15
SLIDE 15
  • Legacy cooling system
  • Power dissipation – 2.5W per channel
  • Cooling system capacity – 3W per channel
  • Legacy Trigger Tower
  • 2.5W per channel  62.5W per Tower
  • Major power consumption by VFE cards
  • FE card contribution – 2.5W
  • Max temperature of the FE card chips 37C
  • Upgrade Tower
  • Maximum cooling capacity 75W /tower
  • Expected FE power dissipation 3.5W
  • Expected VFE power dissipation – less or equal to the legacy
  • ne
  •  Sufficient cooling capacity for the Upgrade FE card

15

ECAL Barrel cooling system

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-16
SLIDE 16
  • GTB components:
  • GBT-SCA
  • available now
  • lpGBT
  • first submission

September-October 2017

  • first samples for evaluation

June 2018

  • first samples for users

end-2018

  • preproduction

2019

  • mass production

2020

  • VL+ components
  • VTRx+
  • On-site assembly

available now

  • Industrial assembly

2018-2019

  • V4T1Rx+ (ECAL flavor)
  • On-site assembly

end-2017

  • Industrial assembly

2019

16

FE development: components availability

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-17
SLIDE 17

17

VL+ components

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

ECAL version

slide-18
SLIDE 18
  • All GBT and VL+ components will be certified to

CMS Tracker level

  • 10 times more severe than ECAL requirements
  • Fully assembled Prototype 2 board will be certified

by ECAL group: full functionality test at:

  • Neutron irradiation to 10^14 neutrons /cm^2
  • Gamma irradiation 10KGy
  • Proton/Pion irradiation to 10^13 particles / cm^2 – SEU
  • Climatic chamber for ageing – conditions to be defined
  • 2-4 Tl magnetic field

18

Components radiation and B-field tolerance

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-19
SLIDE 19

High reliability of the legacy on-detector electronics validates the testing procedure used during CMS electronics production in 2004- 2008, which will be followed during upgrade

  • Industrial production and assembly of all FE boards
  • Visual inspection and electrical test by Producer
  • Full functional acceptance test. Tests stands at
  • CERN
  • One or two labs outside CERN
  • Burning-in of ALL FE boards
  • Conditions to be defined
  • One used in 2006-2008 – 48 hours at 60C
  • Full functional test after burning-in

19

Production tests / burn in

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-20
SLIDE 20

Backup slides

20

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-21
SLIDE 21
  • One receiver and five transmitters configuration

21

FE demonstrator: fast link

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

slide-22
SLIDE 22
  • One receiver and five transmitters configuration

22

FE demonstrator: fast link, naïve design

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Local 40MHz system clock Local 40MHz system clock On-detector Off-detector

slide-23
SLIDE 23

23

GBT – SerDes: Architecture

FNAL Technical Review - Barrel Calorimeter A.Singovski, Aug 29/30 2017

Full custom

Serial input

DES Clock Generator

Clock reference

SER

Serial
  • ut

Switch Switch

120

FEC Decoder FEC Encoder De-scrambler Header decoder Scrambler Header encoder Parallel Out/ BERT Parallel In/ PRBS Control Logic Phase Shifter Switch Switch

120

Switch Switch

120 120 120 120 120 txDataValid dIn [29:0]

Full custom

txClock40 txClock160 rxDataValid dOut [29:0] rxClock40 rxClock160

PROMPT

I2C JTAG AUX[n:0] RX: 40 MHz & 160 MHz TX: 40 MHz & 160 MHz Data path Clocks Control bus Data path Clocks Control bus RST rxRdy txRdy ClkOut3 ClkOut2 ClkOut1 ClkOut0 120 120 120 120 120 120 120

Frame Aligner

120

To GBTx in Transmitter mode

  • At least one GBTx on FE card should be in Transceiver mode
  • Resync clock as the system clock for the Transmitters