Multichannel SIPM readout system for MPD Cosmic Ray

Multichannel SIPM readout system for MPD Cosmic Ray Detector based on Micro. TCA platform with embedded sub-ns WR synchronization G. Kasprowicz (WUT)

Outline 1. NICA collider & Cosmic Ray Detector – Goals 2. SIPM AFE 3. SIPM readout chain based on Open Source HW 4. Conclusion 2

NICA - Nuclotron Ion Collider f. Acility BM@N - Baryonic Matter at Nuclotron MPD - Multi-Purpose Detector MCORD - MPD Cosmic Ray Detector

1. NICA complex Heavy Ions Ion sourse (KRION-6 T) Heavy Ion Linac (HILac) Booster Nuclotron BM@N (Detector) MPD (Detector) M. Bielewicz, 29. XI. 2018 LHEP Division Light Ions Ion source and Linac LU-20 Nuclotron BM@N (Detector) MPD (Detector) seminar 4

1. NICA complex • FD Forward detec • Superconductor solenoid (SC Coil) • inner detector (IT) • straw-tube tracker (ECT) • Time-projection chamber (TPC) • Time-of-flight system (TOF) • Electromagnetic calorimeter (EMC - ECal) • Zero degree calorimeter (ZDC). H /nica. jinr. ru/video/general_compressed. mp 4 M. Bielewicz, 29. XI. 2018 LHEP Division 5 seminar

Cosmic Ray Detector – Goals PRIMARY PARTICLE GROUND LEVEL Cosmic ray air shower created by a 1 Te. V proton hitting the atmosphere 20 km above the Earth. The shower was simulated using the AIRES package. M. Bielewicz, 29. XI. 2018 LHEP Division seminar 6

Cosmic Ray Detector – Goals examples from other experiments ALICE Exp. ACORDE 55 m underground thr. 16 Ge. V 2010 -2013 y ALEPH Exp. DELPHI Exp. 140 m under. (thr. 70 Ge. V) (1997 -99 y) 100 m under. (thr. 52 Ge. V) (99 -2000 y) M. Bielewicz, 29. XI. 2018 LHEP Division seminar 7

Cosmic Ray Detector – Goals a) Trigger (for testing or calibration) - testing before completion of MPD (testing of TOF, ECAL modules and TPC) - calibration before experimental session a) Veto (normal mode track and time window recognition) Mainly for TPC and e. CAL ___________________ Additionally c) Astrophysics (muon shower and bundles) - unique for horizontal events Working in cooperation with TPC DECOR exp. 2002 -2003 y (near horizontal observation (60 -90 deg. angular range) - 1 -10 Pe. V primary particle) M. Bielewicz, 29. XI. 2018 LHEP Division seminar 8

Design, modeling variants MCORD at MPD scheme One surface on full circumference + additional surface on the top ver. 1 M. Bielewicz, 29. XI. 2018 LHEP Division seminar 9

Scintillators Scintilators and modules M. Bielewicz, 29. XI. 2018 LHEP Division seminar 10

Scintillators readout Legend: S (violet) – plastic scintillator, (blue) – Si. PM, P (red) – power supply with temperature compensation circuit, T (brown) – temperature sensor, A (green) – amplifier, D (yellow) – Micro. TCA system with ADC boards, C (orange) – Analog Front End Module. With or without fiber? M. Bielewicz, 29. XI. 2018 LHEP Division seminar 11

MTCA based modular muon trigger (signal flow only) system MTCA crate AFE Assembly (ASSY) AFE Scintillator + Si. PM AFE FMC FMC AMC FPGA FMC carrier Micro. TCA Carrier Hub 12 x (MCH Tongue 3) Xilinx FPGA on board AMC FPGA FMC carrier Main MCH Another sub-trigger system (AFE + FMC + AMC +MCH) 10/40 G Ethernet Muon trigger out Triggers @ SYNC 10 G Ethernet / Aurora

Micro. TCA (MTCA) and OHWR Analog Front-End module FPGA mezzanine card (FMC) AMC FMC carrier board Standard MTCA crate (14 U) (cable fi 1, 5 cm 24 channels +8) (additional cable for 5 V and 70 V power) MTCA Carrier Hub ● Crate number depends on channel count and sampling speed At 250 MS/s: 192 channels / crate For several MTCAs one main MCH At 125 MS/s: 384 channels / crate concentrates data from slave MCHs (16 cables) to generate final muon trigger At 80 MS/s: 576 channels / crate At 50 MS/s: 768 channels / crate 13 ●

Si. PD readout chain – Analog Front End LDO connector calibration Line driver 5 V DC Line driver OTA + shaper + calibrator u. PC + CAN driver 16 x AFE ASSY OTA + Shaper + calibrator 5 V DC u. PC + CAN driver Temp sensor Si. PM Scintillator Si. PM calibration 60 V DC LDO Temp sensor 60 V DC AFE ASSY connector 16 x connector Unique ID Passive signal hub & power splitter CAN/ PWR VHDCI connector PTC fuses Status LEDs connector MTCA processing system Rack CAN / Ethernet 5 V & 60 V supply

Analog Front End configuration ● ● ● Dedicated AFE Assembly per two Si. PM Embedded u. PC + temperature sensor + LDO for Si. PM set point adjust CAN network connectivity with unique ID chip as CAN address Unique ID in every hub for VHDCI cabling checking and identification Hardware ID for every AFE ASSY Low cost LDO instead of expensive switching power supply. No inductors required and lowers EMI. Si. PM voltage, AFE current monitoring, latchup detection & protection for AFE Low cost shielded VHDCI cables – COTS components available as 110 m length and custom versions Local passive hub with PTC fuses for 5 V and 60 V rails, distribution of power, CAN and signals from 16 AFE ASSY to single VHDCI cable Status LEDs on AFE ASSY and hub for quick fault identification Central power supply – custom built 2 U rack box with COTS resonant 5 V SMPS, 60 V flyback SMPS, IEC outlets and fuses. CAN to Ethernet converter – standard COTS component. 15

Analog Front End configuration ● ● Dedicated AFE Assembly per 2 Si. PM Low cost HDMI cables between AFE and hub Cable length TOF measurement for each channel Calibration pulse injected to the AFE entry. 16

Analog Front End – first results with scintillators and readout chain ● ● Dedicated AFE Assembly per 2 Si. PM Low cost HDMI cables Cable length TOF measurement for each channel Calibration pulse injected to the AFE entry. 17

Data processing Latency estimation for L 1 trigger (event without parameters) ü AFE cabling 8 ns/m, with 10 m cabling latency is 80 ns ü ADC + SERDES latency: 400 ns Latency estimation for L 2 trigger (event with parameters) ü MGT latency: 500 ns ü Algorithm latency : 2 -5 us ü Formatter and transmitter latency: 1 us Estimated total latency: 3. 5 – 7. 5 us Latency estimation for L 3 trigger (between MTCA systems) ü MGT latency: 500 ns ü Fiber latency: 500 ns + 8 ns/m ü Algorithm latency : 2 -5 us ü Formatter and transmitter latency: 1 us Estimated total latency: 10 – 15 us 18

White Rabbit synchronization • WR node timing module resides on top of NAT MCH • Two WR nodes working in parallel • Each node connected to different switch • In case of link failure other node takes over • Trigger inputs (outputs) available on front panel • Dedicated WR-enabled crates available commercially from N. A. T • ~400 ps crate – crate synch • ~150 ps channel-channel match. • ~5 ps jitter • Open source design 19

Polish consortium NICA-PL Thank You for Attention M. Bielewicz, 29. XI. 2018 LHEP Division seminar 20