Pacific Research Platform Science Drivers Opening Remarks PRP

  • Slides: 10
Download presentation
“Pacific Research Platform Science Drivers” Opening Remarks PRP Science Driver PI Workshop UC Davis

“Pacific Research Platform Science Drivers” Opening Remarks PRP Science Driver PI Workshop UC Davis March 23, 2016 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD http: //lsmarr. calit 2. net 1

Vision: Creating a West Coast “Big Data Freeway” Connected by CENIC/Pacific Wave Use Lightpaths

Vision: Creating a West Coast “Big Data Freeway” Connected by CENIC/Pacific Wave Use Lightpaths to Connect All Data Generators and Consumers, Creating a “Big Data” Freeway Integrated With High Performance Global Networks “The Bisection Bandwidth of a Cluster Interconnect, but Deployed on a 20 -Campus Scale. ” This Vision Has Been Building for 25 Years

DOE ESnet’s Science DMZ: A Scalable Network Design Model for Optimizing Science Data Transfers

DOE ESnet’s Science DMZ: A Scalable Network Design Model for Optimizing Science Data Transfers • A Science DMZ integrates 4 key concepts into a unified whole: – A network architecture designed for high-performance applications, with the science network distinct from the general-purpose network – The use of dedicated systems for data transfer – Performance measurement and network testing systems that are regularly used to characterize and troubleshoot the network – Security policies and enforcement mechanisms that are tailored for high performance science environments The DOE ESnet Science DMZ and the NSF “Campus Bridging” Taskforce Report Formed the Basis for the NSF Campus Cyberinfrastructure Network Infrastructure and Engineering (CC-NIE) Program Science DMZ Coined 2010 http: //fasterdata. es. net/science-dmz/

Based on Community Input and on ESnet’s Science DMZ Concept, NSF Has Funded Over

Based on Community Input and on ESnet’s Science DMZ Concept, NSF Has Funded Over 100 Campuses to Build Local Big Data Freeways Red 2012 CC-NIE Awardees Yellow 2013 CC-NIE Awardees Green 2014 CC*IIE Awardees Blue 2015 CC*DNI Awardees Purple Multiple Time Awardees Source: NSF

How Prism@UCSD Transforms Big Data Microbiome Science: Preparing for Knight/Smarr 1 Million Core-Hour Analysis

How Prism@UCSD Transforms Big Data Microbiome Science: Preparing for Knight/Smarr 1 Million Core-Hour Analysis Knight 1024 Cluster In SDSC Co-Lo Gordon 1. 3 Tbps Data Oasis 7. 5 PB, 200 GB/s CHERu. B 100 Gbps Knight Lab 120 Gbps Emperor & Other Vis Tools 10 Gbps 12 Cores/GPU 128 GB RAM 3. 5 TB SSD 48 TB Disk 10 Gbps NIC 40 Gbps Prism@UCSD 64 Mpixel Data Analysis Wall

Next Step: The Pacific Research Platform Creates a Regional End-to-End Science-Driven “Big Data Freeway

Next Step: The Pacific Research Platform Creates a Regional End-to-End Science-Driven “Big Data Freeway System” NSF CC*DNI Grant $5 M 10/2015 -10/2020 PI: Larry Smarr, UC San Diego Calit 2 Co-Pis: • Camille Crittenden, UC Berkeley CITRIS, • Tom De. Fanti, UC San Diego Calit 2, • Philip Papadopoulos, UC San Diego SDSC, • Frank Wuerthwein, UC San Diego Physics and SDSC

Pacific Research Platform Regional Collaboration: Multi-Campus Science Driver Teams • Jupyter Hub • Biomedical

Pacific Research Platform Regional Collaboration: Multi-Campus Science Driver Teams • Jupyter Hub • Biomedical – Cancer Genomics Hub/Browser – Microbiome and Integrative ‘Omics – Integrative Structural Biology • Earth Sciences – – Data Analysis and Simulation for Earthquakes and Natural Disasters Climate Modeling: NCAR/UCAR California/Nevada Regional Climate Data Analysis CO 2 Subsurface Modeling • Particle Physics • Astronomy and Astrophysics – Telescope Surveys – Galaxy Evolution – Gravitational Wave Astronomy • Scalable Visualization, Virtual Reality, and Ultra-Resolution Video 7

UCB PRP UC-Jupyter. Hub Backbone Next Step: Deploy Across PRP UCSD Source: John Graham,

UCB PRP UC-Jupyter. Hub Backbone Next Step: Deploy Across PRP UCSD Source: John Graham, Calit 2 GPU Jupyter. Hub: Gb 40 ps 2 x 14 -core CPUs 256 GB RAM 1. 2 TB FLASH 3. 8 TB SSD Nvidia K 80 GPU Dual 40 Gb. E NICs And a Trusted Platform Module GPU Jupyter. Hub: 1 x 18 -core CPUs 128 GB RAM 3. 8 TB SSD Nvidia K 80 GPU Dual 40 Gb. E NICs And a Trusted Platform Module

Next Step: Global Research Platform Building on CENIC/Pacific Wave and GLIF Current International GRP

Next Step: Global Research Platform Building on CENIC/Pacific Wave and GLIF Current International GRP Partners

UC Davis PRP Science Drivers • Particle Physics Data Analysis – UCSD: A. Yagil,

UC Davis PRP Science Drivers • Particle Physics Data Analysis – UCSD: A. Yagil, F. Wuerthwein (team leader; UC Davis: M. Chertok, J. Conway, R. Erbacher, M. Mulhearn, M. Tripathi); UCI: A. Lankford, A. Taffard, D. Whiteson; UCSC: A. Seiden, J. Nielsen, B. Schumm; Caltech: H. Newman; UCSB: C. Campagnari; UCR: R. Clare, O. Long, S. Wimpenny • Telescope Surveys Team: – LBNL: Peter Nugent; UCD: Tony Tyson; Caltech/IPAC/JPL, UCB, Stanford/SLAC, UCI, UCSC, UW • Microbiome and Integrative ‘Omics Team: – UCSD: Rob Knight; UCD: David Mills, Carlito Labrilla; Caltech: Sarkis Mazmanian; UCSF: Sergio Baranzini • Data Analysis and Simulation for Earthquakes and Natural Disasters Team: – UCB: Steve Mahin, with UCSD, UCLA, UCI, USC, Stanford, OSU, and UW • Scalable Visualization and Virtual Reality Team: – UCSD: Falko Kuester, Tom Levy, Jurgen Schulze; UIC: Maxine Brown; UHM, Jason Leigh; UCD: Louise Kellogg; UCI: Magda El Zarki, Walt Scacchi; UCM, Marcelo Kallmann, Nicola Lecari; Uv. A: Cees de Laat.