UFO Buster Analysis Tool Software layout Martyna Dziadosz

UFO Buster Analysis Tool Software layout Martyna Dziadosz TE-MPE-PE | martyna. dziadosz@cern. ch 2

Presentation plan Unidentified Falling Objects problem 2) Motivations 3) UFO Buster Analysis Tool 1) • • layout diagram functionalities UFO Buster vs. UFO Buster Analysis Tool 5) Future development ideas 6) Summary 4) 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 3

Reminder: multi-directional approach to UFO problem Statistical Analysis Numbers of arc UFO events per hour Detection & Analysis 23/11/2017 | UFO Buster Analysis Tool Experimental Studies Simulation & model Martyna Dziadosz 4

Focus of this presentation is: “UFO Buster Analysis Tool status update” 23/11/2017 | UFO Buster Analysis Tool 5

Motivation Ø Reduction of UFO impact on LHC availability. Fully understanding a big UNKNOWN of UFO phenomena HOW ? ? ? 23/11/2017 | UFO Buster Analysis Tool • distribution along LHC • correlation to beam parameters • signal shape analysis Martyna Dziadosz 6

Tool requirements We want an analysis tool which is: • • Fast Easy Reliable & reproducible Enables advanced analysis 23/11/2017 | UFO Buster Analysis Tool Focus on real UFO data All in one place + manual/readme One module for frequent analyses Search for correlations • • Martyna Dziadosz 7

Structure of the UFO Buster analysis tool • • Data Extraction • access data select only real UFO events (reduce data volume) discard empty files • • Raw Data Analysis • plot UFO event signal shape group similar events Collimator Losses • • • Advanced Analysis • correlation with elastic losses (e. g. IP 3/IP 6/IP 7/IR 1/IR 5) statistic (UFO rates etc. ) correlations to beam parameters determination of UFO location 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 8

Step 1 DATA EXTRACTION Ø Access and retrieve data UFO Buster data PM data without beam dump after a beam dump REST API using Python . sdds decoding with JAVA ü standard year analysis ü analysis via locations 23/11/2017 | UFO Buster Analysis Tool ü 16 L 2 area analysis ü IR 7 & 16 L 2 correlations analysis Martyna Dziadosz 9

DATA EXTRACTION Step 1 from UFO Buster Ø Plot UFO event & compare with UFO Buster output UFO Buster Analysis Tool Losses in Gy/s UFO Buster from capture buffer Time (here in 80 µs bits) ü Plot time-resolved UFO event 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 10

DATA EXTRACTION Step 1 from PM REST API Ø plot UFO event & compare with PM Playback plots PM PLAYBACK Losses in Gy/s UFO Buster Analysis Tool Time (here in 40 µs bits) ü 6/09/2017 20: 19: 55 Plot time-resolved UFO event from PM data 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 11

DATA EXTRACTION Step 1 ü extract data from. sdds file (F 1) ü extract data from Capture. Buffer file (F 2) ü store data for the subset (F 3) of BLMs (F 4) → reduction of data volume ü access dumped data via PM REST API from UFO Buster from PM REST API ü Plot time-resolved UFO event 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 12

from UFO Buster RAW DATA ANALYSIS Step 2 Ø Analyse and group UFO events UFO Buster Losses in Gy/s Analysis Tool UFO Buster from capture buffer Time (here in 80 µs bits) ü Gaussian fitting signal shape analysis 23/11/2017 | UFO Buster Analysis Tool O N G O I N G Group events by FWHD, max, symmetry Martyna Dziadosz 13

Step 2 from PM REST API RAW DATA ANALYSIS Ø 16 L 2 BLMs normalization to the 16 L 2 BLM with the highest signal 16 L 2 BLM Losses in Gy/s 6/09/2017 20: 19: 55 Losses in Gy/s 16 L 2 BLM with highest losses Time (here in 40 µs bits) 23/11/2017 | UFO Buster Analysis Tool ü Plot UFO losses ratio/normalization Martyna Dziadosz 14

Step 2 from PM REST API RAW DATA ANALYSIS Ø 16 L 2 and IR 7 area losses correlations Losses in Gy/s 30/09/2017 4: 55: 97 16 L 2 BLM with highest losses Time (here in 40 µs bits) Losses in Gy/s IR 7 BLM with highest losses Time (here in 40 µs bits) 23/11/2017 | UFO Buster Analysis Tool ü ü Plot 16 L 2 to IR 7 losses ratio for BLMs with highest signal Plot IR 7 to 16 L 2 losses ratio for BLMs with highest signal Martyna Dziadosz 15

Step 2 from PM REST API RAW DATA ANALYSIS Ø 16 L 2 and IR 7 area losses correlations Losses in Gy/s 30/09/2017 4: 55: 97 16 L 2 BLM with highest losses Time (here in 40 µs bits) Losses in Gy/s IR 7 BLM with highest losses Time (here in 40 µs bits) 23/11/2017 | UFO Buster Analysis Tool ü ü Plot 16 L 2 to IR 7 losses ratio for BLMs with highest signal Plot IR 7 to 16 L 2 losses ratio for BLMs with highest signal Martyna Dziadosz 16

Step 2 from PM REST API RAW DATA ANALYSIS Losses ratio Ø Investigating the beam instability Time (here in 40 µs bits) 16 L 2 to IR 7 losses ratio 23/11/2017 | UFO Buster Analysis Tool ü begining of the beam instability Martyna Dziadosz 17

RAW DATA ANALYSIS Step 2 O N G O I N ü plot time-resolved UFO events from UFO Buster and PM REST API ü UFO signal shape analysis ü normalization plots for 16 L 2 area ü plot 16 L 2 to IR 7 losses ratio ü find the beginning of the beam instability G group UFO events 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 18

Step 3 COLLIMATORS LOSSES ü identify highest loss signal in IR 7 investigate within the coinciding elastic losses in collimation regions plots from all UFO event presenting a UFO like signature (to be done in IR 3, IR 6) 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 19

Step 4 STATISTICAL ANALYSIS on reduced sample size number of UFOs Ø UFO rate vs. time and location Plot of loss distribution along LHC 23/11/2017 | UFO Buster Analysis Tool Integrated losses [Gy/s] ü Location in LHC [m] Martyna Dziadosz 20

STATISTICAL ANALYSIS Step 4 ü plot of loss distribution around LHC correlations with beam parameters hot spot areas analysis (bunches, B 1/B 2 intensity, magnet current) 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 21

UFO Buster Ø access to Capture. Buffer data display - manual UFO event verification (by eye) Ø possibility to look into different BLMs, sectors, running sums (RS) Ø nice GUI Ø analysis part of the software works relatively slow vs. UFO Buster Analysis Tool Ø access to Capture. Buffer & PM data - automated verification of real UFO events - plot loss data Ø possibility to look into different BLMs, sectors, RS Ø advantages for future users - easy, user friendly - independent modules for frequent analysis -. json file to set interesting parameters - fast analysis - python scripts, that enables dedicated analysis analysi depending on needs - documented in a Git. Lab repository Ø dataset reduction Ø searching for correlation plots Ø enable fast analysis 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 22

Summary of Achievements ü ü ü data extraction & volume reduction → faster analysis BLM losses vs time → UFO event visualization statistical analysis & plots → UFO rate vs time, location or BLM name UFO distribution along LHC Functionality validation on reduce data set UFO losses signal shape analysis 23/11/2017 | UFO Buster Analysis Tool → a. o. by fitting Gaussian function Martyna Dziadosz 23

Conclusion – future needs Ø Functionality validation with big sets of data needed Ø UFO events grouping Ø Advanced, dedicated statistical analysis Ø UFO shape analysis Ø Extension to look at long straight section Ø Analysis for collimators area Ø Eventual analysis of Unidentified Lying Objects Ø Creation of user-friendly GUI 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 24

Thank you for your attention. 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 25

www. cern. ch

IR 7 BLM with highest losses 23/11/2017 | UFO Buster Analysis Tool Martyna Dziadosz 27

Questions/problems -> begining of the beam instability -> signal losses distribution shape 2/11/2017 | UFO Buster analysis tool – software status update Martyna Dziadosz 28

Storage in the UFO folder in TE-MPE-PE directory UFOBuster. Analysis. Tool Analysis. Scripts STEP 1 - Data. Extraction 2016 Python and java scripts from Git. Lab Raw. Data_thr_5 E-3 STEP 2 Raw. Data. Analysis_thr_5 E-3 STEP 3 - Collimator Losses Raw. Data_thr_1 E-4 STEP 4 Advanced. Analysis_thr_1 E-4 2015 F 4 - folder contains all the files Files fulfilling cond 1 Files fulfilling cond 2 Files fulfilling cond 3 Files fulfilling cond 4 Plots and analysis results […] ->consecutive year […]

Step 2 from PM REST API RAW DATA ANALYSIS Ø 16 L 2 and IR 7 area losses correlations 16 L 2 BLM with highest losses Might be better to plot IR 7/16 L 2 Losses ratio Losses in Gy/s 30/09/2017 4: 55: 97 Time (here in 40 µs bits) Losses in Gy/s IR 7 BLM with highest losses ü Plot 16 L 2 to IR 7 losses ratio for BLMs with highest signal Time (here in 40 µs bits) 2/11/2017 | UFO Buster analysis tool – software status update Martyna Dziadosz 30

Step 1 DATA EXTRACTION – (UFO Buster) Ø Merge only relevant info into one file F 3 & F 4 • Basic info (timestamp, fill number, machine parameters) • UFO BLM + neighbours (losses + DCUM) • Time-resolved data (capture buffer) F 4 excel file (. csv) 10/10/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 31

INPUT Condition 1 F 2 F 1 STABLE beam mode verified UFO Condition 2 F 2 for which matching F 1 exist Condition 3 F 2 losses > threshold (5 * 10 -3) Condition 4 2 consecutive points fullfill cond 3 10/10/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 32

Step 1 DATA EXTRACTION excel file (. csv) ü 10/10/2017 | Schematic overview of UFO Buster analysis tool Reduces data volume for quick analysis Martyna Dziadosz 33

F 1 F 2 find the corresponding file type 2 2 WAYS . sdds ASCII file EXTRACT - . sdds binary file 1) looking for F 2 with the same timestamp and fillnumber Fillnumber Timestamp UFO_BLM_Expert_name Dcum [] Verification. Level beam_mode Expert Name OUTPUT: 2) go to an appropriate path using fillnumber. Then look for the corresponding F 2 using naming convention DECONVERSION !!! JAVA Java objects: - String[] header (1 D matrix with BLMs - Int[][] value (2 D matrix with all BLMs names) signal losses) List of files type F 1 for which the exist the corresponding file type F 2 07/12/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 34

Step 1 DATA EXTRACTION – (PM REST API) 10/10/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 35

1. B BL 2 E BL M 20 M QI _X Q. 2 I. 1 4 L RP BL 0 L 2 5. B -RU BL BL MQ. B 1 1 I 1 N 1 M M I. 2 E 1 0_ EI Q M. 0 I. 1 7 R 3 0_M Q 4 L 0 L. B Q 5. 8. 1 M B B I 1 L BL 2 I 1 0_ M 0_ 0_ MQ BL QI. X 5 MQ M 32 FC M Q R B L BL I. 1 1. B. A 4 M 8 L 8 2 I 1 L 5 BL Q 0. M I. 31 B 1 E _M EI BL. 0 L 4. 10 Q M 7 L B 1 _M Q 1 I Q BL I. 2. B 2 10_ M 1 R E 1 M Q Q BL I. 1 2. B 0_X 2 4 R M Q L E 1 P BL I. 3 2. B 0_ 1 M 3 R E MQ 1 Q BL I. 1 6. B 0_ 2 2 M BL Q R I 1 MQ M I. 2 1. B 0_ Q M BL I. 0 8 R 7 2 I 10 Q 5 M L. B _M Q 5. 2 I B I 1 Q BL. 04 1 I 3 0_ L 0 M M BL Q 1. B _M Q I 2 M. 20 E QM 30 Q L I R BL. 09 3. B _M L Q 1 M 2 I 1 Y BL QI. . B 2 0_ 1 I M 7 10 MQ BL QI. L 7. _M M 16 B 2 QM Q R I 1 BL I. 1 3. B 0_ M 3 L 4 1 I 1 MQ Q BL I. 2. B 2 0_ M M BL Q 8 L 8 E 10 Q M I. 1. B _M Q 2 I. 3 L I 1 Q BL 04 L 1. B 0_ M 5 1 I MQ BL QI. B 2 10_ M. 32 E 3 M Q L 0 Q BL I. 1 6. B _M 7 M L 2 I Q BL QI. 8. B 10_ Y M 13 1 E M BL QI. R 4. 10 Q M 11 L B 1 _M Q 7 I 1 Q BL I. 29. B 1 0_ M R E 1 MQ BL QI. 2. B 0_ M 31 2 E MQ BL QI. L 1. 10_ M 17 B 1 M BL Q R I 1 Q M BL I. 2 7. B 0_ M 3 Q I. 0 MQ L 5 2 I 1 Q 7 R I. 2. B 2 0_ 1. 9 L E 1 MQ B 1 6 0 E 1. B 2 _M 0_ I 30 Q M _M Q _X R P . 0 7 L EI M BL summary losses over 2016 Integrated losses of all UFOs per BLM 3. 5 3 2. 5 2 1. 5 1 0. 5 ROMAN POT AREA 0 10/10/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 36

Appendix – F 1 structure 07/12/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 37

Appendix – F 2 structure 07/12/2017 | Schematic overview of UFO Buster analysis tool Martyna Dziadosz 38

TIMESCALE plot That’s an idea to work on Merging it together with the coming slide Step 1 18 days Jul 20 - Aug 14 Step 2 18 days Step 2 Aug 15 - Sep 7 24 days Step 3 Aug 15 - Sep 17 16 days Sep 8 - Sep 30 Step 3 25 days Oct 4 - Nov 7 Step 4 21 days Milestone 5 Milestone 2 Milestone 1 Jun 7 May 10 Nov 2016 May Jun Nov 11 - Dec 11 Jul Milestone 3 Milestone 4 Aug 12 Sep 25 Aug Sep Oct 30 Milestone 6 Nov 15 Oct Nov Dec 2017 END

2/11/2017 | UFO Buster analysis tool – software status update Martyna Dziadosz 40