News and Announcements Tom Junk and Andrew Norman

  • Slides: 16
Download presentation
News and Announcements Tom Junk and Andrew Norman DUNE Core Computing Meeting September 12,

News and Announcements Tom Junk and Andrew Norman DUNE Core Computing Meeting September 12, 2017

Upcoming Dates • Proto. DUNE-SP Cold Box test: Sep-Oct 2017. • DAQ Milestone Week

Upcoming Dates • Proto. DUNE-SP Cold Box test: Sep-Oct 2017. • DAQ Milestone Week @CERN: Week of Sep. 18 • Proto. DUNE Data Challenge: Week of November 6 • DUNE Physics Week, Nov 14— 17 at Fermilab – with structured working time ("Hack Days" style) o Request from Ryan Patterson for tutorials o A repeat? o Physics tutorials? o Programming help? 2 8/8/17 T. Junk and A. Norman | News

Welcome New Members • dunetpc librarian: - Christoph Alt, ETH Zürich. - Many thanks

Welcome New Members • dunetpc librarian: - Christoph Alt, ETH Zürich. - Many thanks to Tingjun for his valuable service! - Tinjun has been getting Christoph up to speed with the duties. • DUNE Computing co-Coordinator: - Heidi Schellman - Many thanks to Tom Junk for his service! - We will work with Heidi to define duties 3 8/8/17 T. Junk and A. Norman | News

3 x 1 x 1 Data Import • Initial 392. dat files transferred by

3 x 1 x 1 Data Import • Initial 392. dat files transferred by Steve. Tom ran import jobs and documented at the last meeting. • New data have arrived – Steve ironing out file transfer • New dunetpc version – v 06_49_00 containing a bugfix to the timestamp handling in the import jobs. • Need to re-import the old 3 x 1 x 1 data, plus new data • dunetpc version included in metadata: can use this to distinguish passes • file family: test-data, data-tier: raw (changes needed? ). DUNE's test-data contains split 35 t data too • Was: about 0. 5 TB, but on doing it again we can get a factor of ~3 in data compression. May have to split it up among several jobs if the compression takes some CPU. • 3 x 1 x 1 reco being tuned up – no request to run reco in the same import jobs 4 8/8/17 T. Junk and A. Norman | News

Proto. DUNE Overlay Discussion. Old slide, but • New WIB frame spec in Doc.

Proto. DUNE Overlay Discussion. Old slide, but • New WIB frame spec in Doc. DB 1701 • Overlay proposal in Doc. DB 4877 – new version after iterating with JJ development ongoing • Milo Vermeulen added as a developer on dune-raw-data. Ruth says they have initial code but needed permission to check it in • Discussion with Brett on channel numbering and making sure we have access to fiber and crate numbers • John Freeman has written a developer's guide for dune-raw-data https: //cdcvs. fnal. gov/redmine/projects/dune-raw-data/wiki/The_dune-rawdata_developer's_guide • JJ is making progress, but has to run the overlay code live in three places: online/offline (dune-raw-data) Vivado HLS – in order to verify the firmware via simulation In the ARM chip – used to verify the firmware in a live environment 5 8/8/17 T. Junk and A. Norman | News

gallery Demos for Proto. DUNE • I've been expanding the toolset of gallery scripts

gallery Demos for Proto. DUNE • I've been expanding the toolset of gallery scripts (ROOT scripts, really), that do basic monitoring things for 3 x 1 x 1 imported data - 2 D Event Display - Channel ADC, RMS, d. RMS - FFT - Correlation plots • Where to put these? New repo? dunegallery? dunetpcobj? • I have compiled gallery main programs, but need to get some practice including headers and linking with bits of code necessary for unpacking data 6 - overlays - raw. cxx for uncompressing raw: : Raw. Digits - geometry and channel list. - *obj LAr. Soft code products are for framework-independent code 8/8/17 T. Junk and A. Norman | News

3 x 1 x 1 Raw Data Display using gallery 7 8/8/17 T. Junk

3 x 1 x 1 Raw Data Display using gallery 7 8/8/17 T. Junk and A. Norman | News

And an event with a shower 8 8/8/17 T. Junk and A. Norman |

And an event with a shower 8 8/8/17 T. Junk and A. Norman | News

3 x 1 x 1 Channel Mean and RMS d. RMS is the RMS

3 x 1 x 1 Channel Mean and RMS d. RMS is the RMS of the difference between a channel and its neighbor, divided by sqrt(2). It's a measure of the uncorrelated noise 9 8/8/17 T. Junk and A. Norman | News

Channel to channel Correlation 3 x 1 x 1 100 ticks in the middle

Channel to channel Correlation 3 x 1 x 1 100 ticks in the middle of an event. First few ticks are messed up 10 8/8/17 T. Junk and A. Norman | News

3 x 1 x 1 FFT using gallery magnitude (arb. units) Frequency scale assumes

3 x 1 x 1 FFT using gallery magnitude (arb. units) Frequency scale assumes 2 MHz samples 11 8/8/17 T. Junk and A. Norman | News

Extras 12 8/8/17 T. Junk and A. Norman | News

Extras 12 8/8/17 T. Junk and A. Norman | News

Photon Detector Overlays • I talked briefly with Zelimir - Only small changes wrt

Photon Detector Overlays • I talked briefly with Zelimir - Only small changes wrt 35 -ton planned for photon detector readout for Proto. DUNE, at least as far as data format is concerned - Re-use 35 -ton overlay classes, though need to evaluate how they fit in with the events – make sure events are consistent. - Martin Haigh (Warwick) had written them for 35 -ton - Need to check with J. Freeman on boardreader/fragment generator 13 8/8/17 T. Junk and A. Norman | News

dunetpc librarian duties • We would like to help Tingjun out – he tells

dunetpc librarian duties • We would like to help Tingjun out – he tells me he does these things for dunetpc 14 - Updates the larsoft version number in product_deps - Builds new release locally and runs unit tests (in case something in the new larsoft release breaks something of ours) - Merges branches. • LAr. Soft-provided ones • User branches on request – resolve conflicts - Fields questions about data product differences found by the CI system – okay to generate new reference files or start debugging? - n. b. Some DUNE repositories that depend on LAr. Soft aren't on Lynn's umbrella to maintain when there are breaking changes in LAr. Soft (header files move around for example), such as the nucleon decay, ND, and BSM repositories. 8/8/17 T. Junk and A. Norman | News

dunetpc release manager duties • Increase the dunetpc version number • Build release on

dunetpc release manager duties • Increase the dunetpc version number • Build release on /grid/fermiapp • Install release in CVMFS • Clean up space in /grid/fermiapp • Test that the release works • Announce to dune-reco 15 8/8/17 T. Junk and A. Norman | News

Received Electronics Test Info from BNL • Warm ASIC test results • /dune/data/users/bkirby/20170706_elecprod_quad. Fe.

Received Electronics Test Info from BNL • Warm ASIC test results • /dune/data/users/bkirby/20170706_elecprod_quad. Fe. Asic. tar • JSON file documentation coming at: https: //github. com/DUNE/femb_python/tree/master/femb_python /test_measurements/fe. Asic. Test • Files have a formatting bug; easy enough to fix. • Contain mean, RMS, and Gain. Mean may be the pedestal, need further clarification. Also failure flags. • I asked Brian if these ASICs are the ones to be used in the upcoming test of APA 1 at CERN. 16 8/8/17 T. Junk and A. Norman | News