Photon Systems Controls and DataAcquisition Gunther Haller Particle

Photon Systems Controls and Data-Acquisition Gunther Haller Particle Physics and Astrophysics Division Photon Control and Data Systems (PCDS) Group 14 May 2008 1 14 May 2008 v 5 Photon Systems Controls & DAQ Gunther Haller haller@slac. stanford. edu

Outline LCLS versus LUSI Responsibilities PPS/HPS XTOD AMO Instrument Control and Data Acquisition NEH Infrastructure & Networking Femto-Second Laser Timing System 2 D-Detector Control and Readout 14 May 2008 Photon Systems Controls & DAQ 2 Gunther Haller haller@slac. stanford. edu

FEE and NEH/FEH Hutch Assignments ** ** Front-End Enclosure with FEE-XTOD ** AMO: LCLS PP, XPCS, CXI: LUSI ** SXR Imaging, SXR Pump-Probe, HEDS are not funded at this time 14 May 2008 Photon Systems Controls & DAQ 3 Gunther Haller haller@slac. stanford. edu

LCLS & LUSI Common photon-area Controls and DAQ System Design for LCLS and LUSI G. Haller is CAM for LCLS and LUSI Controls & DAQ, including XTOD Controls LCLS Controls & DAQ W. B. S 1. 6. 2 AMO experiment (NEH, hutch 2) All controls and DAQ Common services for all hutches Examples PPS/HPS/LSS 120 Hz beam-quality data interface Machine protection system interface Network interface Local science data online processing & cache 2 -D detector Control and DAQ for detector LUSI Control & DAQ W. B. S XPP, XCS, CXI Instruments Examples of documents released 1. 1. 523 XES-LUSI ICD (includes Controls and Data systems) 1. 1 -516 XES Photon Controls to Electron Beam Controls System ICD 1. 1. 517 XES Photon Controls to Electron Beam Controls MPS ICD 14 May 2008 Photon Systems Controls & DAQ 4 Gunther Haller haller@slac. stanford. edu

PPS and HPS FEE PPS Personnel Protection System for FEE and NEH/XRT/FEH plus Hutch Protection System HPS based on SSRL model , with some modifications Preliminary Design Review held 2 -29 -08 Final Design Review to be held July 08 Racks for NEH and FEH received PLC hardware for FEE & NEH received 14 May 2008 Photon Systems Controls & DAQ 5 Gunther Haller haller@slac. stanford. edu

XR Diagnostics in Front End Enclosure 14 May 2008 Photon Systems Controls & DAQ 6 Gunther Haller haller@slac. stanford. edu

XTOD Controls Final Design Review (FDR) of all controls except vacuum held Feb 14, 08 FDR of complete XTOD vacuum systems held March 13, 08 Review presentations http: //confluence. slac. stanford. edu/di splay/PCDS/XTOD Most instrumentation for Fall 08 delivery to SLAC are installed in racks at LLNL and are in testing Services will be available at SLAC to support commissioning (see later) 14 May 2008 Photon Systems Controls & DAQ 7 Gunther Haller haller@slac. stanford. edu

AMO Instrument Control Requirements listed in Engineering Specification Documents (ESD’s) 1. 6 -108 AMO Controls ESD, status: released 1. 6 -109 AMO DAQ ESD, status: released Interfaces specified in Interface Control Document (ICD) 1. 1 -515 XES AMO Controls ICD, status: released Held Preliminary Design Review last Month http: //confluence. slac. stanford. edu/display/PCDS/AMO-PDR Includes details what controller are used and interconnections Including identification of each component to be controlled and data to be acquired ~10 cameras ~50 stepper motors, almost all smart motors (serial port) ~ 50 channels of high-voltage bias supplies ~ 8 sets of vacuum gauges, 2 valves misc other controllers, mostly serial devices All controllers identified, example motion and vacuum next slides 14 May 2008 Photon Systems Controls & DAQ 8 Gunther Haller haller@slac. stanford. edu

AMO Instrument Motion Control E-STPR 1 J-STPR 2 H-ROTR 2 H-STPR 1 Beam stops (A 1) Beam Viewing (B 1 -B 4) Gas Jets (C 1, C 2) HFP Focus Verification(D 1 - D 4) Equipment Stand (E 1 -E 3) Detectors (F 1 -F 12) Focusing Optics (H 1, H 2) Shutter (J 1, J 2) Total Energy (K 1) STPR, Stepper motor ROTR, Rotational SHUT, Shutter Control PHUNU, Pneumatic J-SHUT 1 E-STPR 2 E-STPR 3 F-STPR 12 F-STPR 7 B-STPR 3 D-ROTR 1 D-SPTR 2 F-STPR 1 -5 C-STPR 2 F-STPR 11 B-PHNU 1 P D-STPR 3 D-STPR 4 14 May 2008 Photon Systems Controls & DAQ K-STPR 1 C-STPR 1 A-PNEU 1 9 Gunther Haller haller@slac. stanford. edu B-PHNU 4

AMO Instrument Vacuum Control(1) • Ion Pump: IONn • Turbo/Scroll: PMPn CCG 1 • Titanium Sublimation Pump: TSPn CCG 2 • Cold Cathod Gage: CCGn GVV 2 • Thermo-Parini Gage: TPGn • Hot Filament Gage: HFGn • Foreline Valve: FVVn • Gate Valve: GVVn GVV 1 ION 2 TSP 1 • Residual Gas Analyzer: RGAn CCG 8 CCG 6 GVV 5 CCG 4 CCG 3 GVV 3 FVV 4 RGA 1 RGA 2 PMP 4 TPG 1 GVV 4 CCG 5 PMP 3 FVV 8 PMP 5 P PMP 2 GVV 6 FVV 5 PMP 1 FVV 1 CCG 7 GVV 7 TPG 5, 6 PMP 6 FVV 6, 7 FVV 2 -3 14 May 2008 Photon Systems Controls & DAQ TPG 2 -3 TPG 4 10 TPG 7 FVV 9, 10 Gunther Haller haller@slac. stanford. edu

AMO Instrument Vacuum Control(2) 14 May 2008 Photon Systems Controls & DAQ 11 Gunther Haller haller@slac. stanford. edu

AMO Rack Profile (3 racks) 14 May 2008 Photon Systems Controls & DAQ 12 Gunther Haller haller@slac. stanford. edu

NEH Hutch-2 Layout AMO Cable. Trays Racks 14 May 2008 Photon Systems Controls & DAQ 13 Gunther Haller haller@slac. stanford. edu

Lab Test Setups Have racks with many controllers in the lab Incrementally add controllers and software 14 May 2008 Photon Systems Controls & DAQ 14 Gunther Haller haller@slac. stanford. edu

Infrastructure & EPICS Drivers Server Room (basement level of NEH) racks in hand, to be installed in NEH in July Used for networking, servers, on-line processing and science data storage Additional cable-trays will be installed in June Fibers from Computer Center (SCCS) and MCC to NEH Server room in hand, to be installed in June First client will be XTOD in FEE Hutch-2 AMO racks ordered, will arrive end of May, will be built up in lab over next few months EPICS drivers Only ~8 EPICS drivers remain to be written & tested Instrumentation for AMO chambers can be connected as early as 12 -08 (for instrument build-up and check-out) 14 May 2008 Photon Systems Controls & DAQ 15 Gunther Haller haller@slac. stanford. edu

AMO DAQ Instruments Diagnostic Section High Field Physics End-Station electron time-of-flight spectrometers magnetic bottle electron time-ofion spectrometers flight spectrometer time-of-flight, imaging, momentum x-ray emission spectrometers pulse energy monitor beam profile screens 14 May 2008 Photon Systems Controls & DAQ 16 Gunther Haller haller@slac. stanford. edu

Example: Digitizer Acqiris DC 282 high-speed 10 -bit c. PCI Digitizer 4 channels 2 -8 GS/s sampling rate Acquisition memory from 1024 kpoints to 1024 Mpoints Low dead time (350 ns) sequential recording with time stamps 6 U PXI/Compact. PCI standard, 64 bit, 66 MHz PCI Ported RTEMS to c. PCI CPU and wrote/tested Acqiris driver Sustained transfer rate up to 400 MB/s to host SBC 14 May 2008 Photon Systems Controls & DAQ 17 Gunther Haller haller@slac. stanford. edu

Data System Architecture AMO specific Photon Control Data Systems (PCDS) Beam Line Data L 1: Acquisition Digitizers + Cameras Timing L 0: Control L 2: Processing DAQ system primary features Trigger and readout Process and veto Monitoring Storage 14 May 2008 Photon Systems Controls & DAQ 18 Gunther Haller haller@slac. stanford. edu L 3: Data Cache

Network Security Enclave PCDS (Photon Control and Data Systems) PCDS Network Security Plan approved by SLAC network security, in process of getting DOE approval 14 May 2008 Photon Systems Controls & DAQ 19 Gunther Haller haller@slac. stanford. edu

Femto-Second Laser Timing John Byrd, et al, LBL 14 May 2008 Photon Systems Controls & DAQ 20 Gunther Haller haller@slac. stanford. edu

Stabilized Fiber Link Prototype test at SLAC with LBL system Installed 1 Km fiber in tunnel from sector 20 laser room to sector 30/MCC Also installed fiber in Klystron gallery from sector 20 laser room to MCC 14 May 2008 Photon Systems Controls & DAQ 21 Gunther Haller haller@slac. stanford. edu

First Timing Tests Jan 08 Some modification where implemented since January some of which happened to also improve operation with gallery fibers (tbd) More test planned in June, including the complete control system 14 May 2008 Photon Systems Controls & DAQ 22 Gunther Haller haller@slac. stanford. edu

LCLS 2 D-Detector Instrumentation and DAQ Pixel-Detector & ASIC by Cornell Note that additional pixel devices, e. g. BNL detector is taken care of by LUSI control and data systems SLAC Control & DAQ Test Setup Chain, see below 14 May 2008 Photon Systems Controls & DAQ 23 Gunther Haller haller@slac. stanford. edu

2 D-Detector Control and DAQ Chain Groundisolation Vacuum Fiber Cornell detector/ ASIC 14 May 2008 Photon Systems Controls & DAQ ATCA crate with SLAC DAQ Boards SLAC FPGA front-end board 24 Gunther Haller haller@slac. stanford. edu

Cornell ASIC Boards Each detector has ~36, 000 pixels Controlled and read out using custom ASIC ~36, 000 front-end amplifier circuits and analogto-digital converters Readout is 200 Mbit/sec from each ASIC, 74 kbytes times 120 Hz. ~ 9 Mbytes/sec Initially 16 x 32, 000 -pixel devices, then up to 64 x 32, 000 -pixel devices 4. 6 Gbit/sec average with > 10 Gbit/sec peak To be processed real-time 14 May 2008 Photon Systems Controls & DAQ 25 Gunther Haller haller@slac. stanford. edu

SLAC PPA Reconfigurable Cluster Element (RCE) Boards SLAC Particle and Astrophysics Research engineering group experienced in building high-rate, high-volume data and control systems with on-line science data processing Reconfigurable Cluster Element module with 2 each of following Virtex-4 FPGA 2 Power. PC processors IP cores 512 Mbyte RLDRAM 8 Gbytes/sec cpu-data memory interface 10 -G Ethernet event data interface 1 -G Ethernet control interface RTEMS operating system up to 512 Gbyte of FLASH memory Rear Transition Module Reconfigurable Cluster Element Module 1 TByte/board 14 May 2008 Photon Systems Controls & DAQ 26 Gunther Haller haller@slac. stanford. edu

Calibration & Distribution (using SLAC DAQ) 14 May 2008 Photon Systems Controls & DAQ 27 Gunther Haller haller@slac. stanford. edu

Gain (using SLAC DAQ) 14 May 2008 Photon Systems Controls & DAQ 28 Gunther Haller haller@slac. stanford. edu

Noise (using SLAC DAQ) 14 May 2008 Photon Systems Controls & DAQ 29 Gunther Haller haller@slac. stanford. edu

2 D-Detector Mechanical/Electrical Vacuum Assembly Conceptual Design (SLAC PPA Engineering) Positioning plate • Supports quadrant raft • Mounts to drive system Cam follower mounted to torque ring Hole size remotely adjustable Via PCDS Controls One Quadrant Raft Removed Pixel Detectors Cut-outs in base plate for cold straps and cables Cold strap 14 May 2008 Photon Systems Controls & DAQ 30 Gunther Haller haller@slac. stanford. edu

Quadrant Board and Electrical Interfaces Quadrant raft provides structural support and stability for the double-detector packages Feet mount on quadrant raft through holes in the quadrant boards This is also thermal path Cold strap Quadrant boards provide grounding, power, and signal interface to the PAD detector package Quadrant raft 1 flex cable per detector 1 FPGA on each quadrant board Mounting feet Double-detector package (4 per quadrant) Detector Quadrant board 2 14 May 2008 Photon Systems Controls & DAQ 31 Quadrant board 1 Gunther Haller haller@slac. stanford. edu

Summary XTOD Instrumentation to be delivered in Fall well under way, installed in racks, in testing AMO Instrument Controls and Data Acquisition Requirements and interface control documents released Preliminary design complete Test setups and software in progress Infrastructure for NEH Server Room and Hutch 2 in progress, will be in place before August 08 Includes networking Femto-second timing system tested at SLAC with 2 km (round-trip) of fiber in tunnel and in gallery Already meets performance specification (< 100 f. S) More test planned for July 08 2 D Pixel Detector control and data acquisition well advanced Already controlling and acquiring data from pixel detector prototype and custom ASIC with SLAC LCSL DAQ prototype system No technical risks, well within expertise of Photon Control and Data Systems Group (Engineers from SLAC Particle and Astro Physics Instrumentation and Control group) On schedule, on budget 14 May 2008 Photon Systems Controls & DAQ 32 Gunther Haller haller@slac. stanford. edu