Big Data Expressmdtm FTP SC 18 March 3
Big. Data Express/mdtm. FTP @SC’ 18 March 3, 2021
Big. Data Express Paper • Big. Data Express paper presentation – Venue: INDIS’ 18 Workshop – Time: Nov 11, 2018 – https: //scinet. supercomputing. org/works hop/sc 18 -program
Big. Data Express Demo • Collaborators – ORNL, KISTI, KSTAR, KREONET, ESnet, MAX, SURFNet, Ciena, Star. Light • Demo Booths – DOE, KISTI, MAX, Star. Light
Big. Data Express @SC’ 18
Big. Data Express Demo @DOE Booth • Gave a 50 -minute talk and demo to DOE BER program manger – Justin Hnilo • Justin was very interested in Big. Data Express – Talked about the possibilities of integrating Big. Data Express into ESGF – Asked how to integrate Big. Data Express into scientific work flows – ESGF: https: //esgf. llnl. gov/
Big. Data Express Demo @KISTI Booth • Demonstrated cross continental bulk data transfer • Media reports on Big. Data Express at South Korea – http: //hellodd. com/? md=news&mt=view&pid=66693 – http: //www. fnnews. com/news/201811140955244885? utm_source=naverblog &utm_medium=blog – https: //www. sedaily. com/News. View/1 S 76 PGT 6 I 9 – http: //www. popsci. co. kr/news/article. View. html? idxno=8226 – http: //www. ggilbo. com/news/article. View. html? idxno=563834 • SC’ 18 Follow-up – KISTI is considering to organize a workshop on mdtm. FTP/Big. Data Express at South Korea – KISTI, KSTAR, and KREONT would like to team up with FNAL to demonstrate bulk data transfer in SCA’ 19 at Singapore using mdtm. FTP/Big. Data Express
Big. Data Express Demo @UMD Booth • SC’ 18 Follow-up – Integrate Big. Data Express with SESNE (New APIs)
Big. Data Express Demo @Star. Light Booth • SC’ 18 Follow-up – Deploy Big. Data Express at CERN and Tokyo university – Form team to participate in ”MOVER DATA CHALLENGE” at SCA’ 19 held in Singapore
mdtm. FTP Demo @SC’ 18 • FNAL teamed up with Star. Light, RNP, NCSA, Am. Light to demonstrate LSST data transfer from Chile to NCSA using mdtm. FTP • Julio Ibarra and Jeronimo Bezerra (Am. Light) showed interest in trying Big. Data Express for LSST – Discussed how to integrate Big. Data Express into LSST work flows – Discussed to form team to participate in data transfer demos at TNC’ 19
Meetings @SC’ 18 • With David P. Schissel and Mark Kostuk from General Dynamics – David and Mark are collaborating with Chinese fusion community to transfer fusion data between Hefei, China and San Diego, US – David is interested in trying mdtm. FTP and Big. Data Express in EAST Fusion Collaboration • With Yee Ting Lee from SLAC/Stanford – Discussed to use mdtm. FTP/Big. Data Express for Light Source projects – Will have a follow-up meeting in early December
- Slides: 10