Overview of Chinese Computing Grid Gang CHENIHEPCC 12

  • Slides: 36
Download presentation
Overview of Chinese Computing Grid • Gang CHEN/IHEP-CC • 12 December 2006 • Chinese-French

Overview of Chinese Computing Grid • Gang CHEN/IHEP-CC • 12 December 2006 • Chinese-French Workshop

Outline • HEP Grid • • • Experiments Grid services Hardware&Software Network Other activities

Outline • HEP Grid • • • Experiments Grid services Hardware&Software Network Other activities Future plan • Other Chinese Grid Projects • CNGrid • China. Grid Gang Chen/CC/IHEP 2020/9/24 - 2

HEP Grid: Experiments • Support CMS, ATLAS, about 80 physicists participating in the two

HEP Grid: Experiments • Support CMS, ATLAS, about 80 physicists participating in the two experiments • CMS: Peking University(PKU), IHEP • Atlas: Shandong University(SDU), University of Science and Technology of China(USTC), Nanjing University(NJU), IHEP • Local Experiment: BES • 29 institutes from China, Japan, Germany, Russia US, UK, etc • 5 PB totally in next 5 years • 2000 k. Spec. Int 2 K • ARGO-YBJ Cosmic Ray Experiment • China-Italy project Gang Chen/CC/IHEP 2020/9/24 - 3

Grid Services • • • UI (User Interface):Glite-3. 0. 2 RB (Resource Broker): Glite-3.

Grid Services • • • UI (User Interface):Glite-3. 0. 2 RB (Resource Broker): Glite-3. 0. 2 (LCG RB) My. Proxy:Glite-3. 0. 2 SE (SRM/Dcache/DPM):Glite-3. 0. 2 CE (Torque):Glite-3. 0. 2 (LCG-CE) MON (R-GMA):Glite-3. 0. 2 BDII:Glite 3. 0. 2 WNs:Glite-3. 0. 2 FTS: Glite-3. 0. 2 LFC:LHC File Catalogue CA:IHEP CA VOMS: for BES VO Gang Chen/CC/IHEP 2020/9/24 - 4

Hardware Resources • Computing Resources • • 28 CPUs (Xeon 3. 2 GHz/2 GB/73

Hardware Resources • Computing Resources • • 28 CPUs (Xeon 3. 2 GHz/2 GB/73 SCSI, IBM Blade Server) 10 CPUs (Xeon 3. 0 GHz/2 GB/80 GB Sata, 1 U Rackmount). • Storage resources • • CMS SE (Dcache/srm): 1. 2 TB(SCSI Raid 5) Atlas SE (Dcache/srm): 1. 2 TB(SCSI Raid 5) Gang Chen/CC/IHEP 2020/9/24 - 5

Infrastructure • 500 m 2 floor space refurbished by spring 2006 • • •

Infrastructure • 500 m 2 floor space refurbished by spring 2006 • • • Power UPS Cooling Gang Chen/CC/IHEP 2020/9/24 - 6

Software • • • All machines running Scientific Linux CERN 3. 0. 5 Quattor

Software • • • All machines running Scientific Linux CERN 3. 0. 5 Quattor based OS installation Network File System • • • Mass Storage System: CASTOR 1. 7. 1. 5 CASTOR 2 Grid Middleware: g. Lite 3. 0 based Local Resource Manager: Torque Monitoring: ganglia Currently supported VOs: • User home directory: AFS • Experiment data: NFS/Lustre(testing) • ATLAS, CMS, BES, GILDA, EUCHINA, ARGO Gang Chen/CC/IHEP 2020/9/24 - 7

CA and BES VOMS Operation • IHEPCA is a CA, covering HEP and Biomedical.

CA and BES VOMS Operation • IHEPCA is a CA, covering HEP and Biomedical. • Statistics: Number of issued certificates: Types User Host Server Total Valid 59 82 2 143 Revoked 33 9 1 43 Gang Chen/CC/IHEP 2020/9/24 - 8

VOMS for BES experiment Gang Chen/CC/IHEP 2020/9/24 - 9

VOMS for BES experiment Gang Chen/CC/IHEP 2020/9/24 - 9

LCG Deployment in China UI PKU VO: CMS CE_torque UI SDU VO: ATLAS SE_dcache

LCG Deployment in China UI PKU VO: CMS CE_torque UI SDU VO: ATLAS SE_dcache BDII PX CSTNETCERNET UI MON SE_classicl WN 1 SE_classicl CE_torque RB LFC_mysql UI WN 1 WN 2 CE_torque WN 2 WN 1 WN 2 PC farm IHEP CNIC Gang Chen/CC/IHEP 2020/9/24 - 10

To lcg 00123. grid. sinica. edu. tw Gang Chen/CC/IHEP 2020/9/24 - 11

To lcg 00123. grid. sinica. edu. tw Gang Chen/CC/IHEP 2020/9/24 - 11

grid 05. lal. in 2 p 3. fr Gang Chen/CC/IHEP 2020/9/24 - 12

grid 05. lal. in 2 p 3. fr Gang Chen/CC/IHEP 2020/9/24 - 12

The result of ping • Ping –c hostname • lcg 00123. grid. sinica. edu.

The result of ping • Ping –c hostname • lcg 00123. grid. sinica. edu. tw 1000 packets transmitted, 1000 received, 0% packet loss rtt min/avg/max/mdev = 55. 821/56. 120/57. 655/0. 363 ms • grid 05. lal. in 2 p 3. fr 1000 packets transmitted, 1000 received, 0% packet loss min/avg/max/mdev = 318. 826/319. 256/324. 179/0. 651 ms Gang Chen/CC/IHEP 2020/9/24 - 13

Comments • Performance largely affected by network • Multi-stream can achieve good performance •

Comments • Performance largely affected by network • Multi-stream can achieve good performance • About 20 MB/s to Taipei with 30 streams • Network to Europe is far from satisfactory • CNIC is helping us to improve it Gang Chen/CC/IHEP 2020/9/24 - 14

Gang Chen/CC/IHEP 2020/9/24 - 15

Gang Chen/CC/IHEP 2020/9/24 - 15

Grid VPN between IHEP and USTC • Motivation • International bandwidth bottleneck of China

Grid VPN between IHEP and USTC • Motivation • International bandwidth bottleneck of China universities • Academic users in universities have to use commercial service shared with millions of public users. • Grid won’t be function this way! • Solution • Virtual Private Network (VPN) channel between CSTNET (USTC) and CSTNET (IHEP). d 0 ustc gain 120 -600 k. Bps stable net connection. Gang Chen/CC/IHEP 2020/9/24 - 16

Secure VPN Gang Chen/CC/IHEP 2020/9/24 - 17

Secure VPN Gang Chen/CC/IHEP 2020/9/24 - 17

Other Activities • Partner of EUChina. GRID project • Aims to support the interoperability

Other Activities • Partner of EUChina. GRID project • Aims to support the interoperability of the Grid infrastructures in Europe (EGEE) and China (CNGRID) for the benefit of e. Science applications • To foster the creation of a intercontinental e. Science community Training people § Supporting existing and new applications § • The official start is 1 st January 2006, 24 Months duration • Support ATLAS and CMS@LHC and the Cosmic Ray Experiment ARGO in Yangbajing • Attend WISDOM data challenge • scheduled from 01/10/2006 to 15/12/2006 Gang Chen/CC/IHEP 2020/9/24 - 18

Current Problems • Network performance is limited • Well Trained Manpower is not sufficient

Current Problems • Network performance is limited • Well Trained Manpower is not sufficient • More user tutorials is needed Gang Chen/CC/IHEP 2020/9/24 - 19

Beijing Site in the Future • Beijing site have been extended up to more

Beijing Site in the Future • Beijing site have been extended up to more computing power and storage capacity, will provide more powerful resource support. • Signed MOU for building two T 2 for CMS and Atlas respectively: 2 X Tier 2 CPU (k. SI 2 K) Disk (TB) 2006 2007 2008 2009 2010 100 500 1000 1400 20 50 400 600 Gang Chen/CC/IHEP 2020/9/24 - 20

Other Chinese Grid Projects • CNGrid • China. Grid Gang Chen/CC/IHEP 2020/9/24 - 21

Other Chinese Grid Projects • CNGrid • China. Grid Gang Chen/CC/IHEP 2020/9/24 - 21

CNGrid in Brief • Key project supported by the National High-Tech R&D Program (the

CNGrid in Brief • Key project supported by the National High-Tech R&D Program (the 863 program) • 4 -year project • • Launched in May 2002 Earliest and largest Grid project in China 100 million yuan fund from the Government (Mo. ST) Two to three times more associated funds from local governments, organizations and industry Gang Chen/CC/IHEP 2020/9/24 - 22

CNGrid Sites Gang Chen/CC/IHEP 2020/9/24 - 23

CNGrid Sites Gang Chen/CC/IHEP 2020/9/24 - 23

Applications on CNGrid • • Bioinformatics Environment science Material Science Computational Chemistries Distributed java

Applications on CNGrid • • Bioinformatics Environment science Material Science Computational Chemistries Distributed java computing Scientific visualization …… Gang Chen/CC/IHEP 2020/9/24 - 24

Deployment of grid software Web Portal RA 2 GS CNGrid GOS APIs CNGrid Info

Deployment of grid software Web Portal RA 2 GS CNGrid GOS APIs CNGrid Info and GS or Res. manager wrappers GT 3 core Reg. RA 3 RA 1 Local resource Grid Site A Grid Server Local resource Web browser Grid mgr. CNGrid Info and GS or Res. manager wrappers RB 2 GT 3 core Internet application RB 3 Grid Site B Grid Server Grid software RB 1 outsource Reg. Applications WS GS Web. Sphere, . Net OGSA/OGSI 7 CNGrid GOS APIs Application server Gang Chen/CC/IHEP 2020/9/24 - 25

Ground Water Survey Gang Chen/CC/IHEP 2020/9/24 - 26

Ground Water Survey Gang Chen/CC/IHEP 2020/9/24 - 26

Result from GRAPES forecasting snow (rain) in Dec. 21, 2004 (grid: 30 km) Gang

Result from GRAPES forecasting snow (rain) in Dec. 21, 2004 (grid: 30 km) Gang Chen/CC/IHEP 2020/9/24 - 27

Scientific Data Grid Portal Gang Chen/CC/IHEP 2020/9/24 - 28

Scientific Data Grid Portal Gang Chen/CC/IHEP 2020/9/24 - 28

Gang Chen/CC/IHEP 2020/9/24 - 29

Gang Chen/CC/IHEP 2020/9/24 - 29

China. Grid in Brief • China Education and Research Grid • Funded by Ministry

China. Grid in Brief • China Education and Research Grid • Funded by Ministry of Education • Based on CERNET (China Education and Research Network) • First Phase • • 2003 -2005 12 key universities More than 6 Tflops 20 key universities as initiative w/60 TB now Gang Chen/CC/IHEP 2020/9/24 - 30

China. Grid (The First Phase) Gang Chen/CC/IHEP 2020/9/24 - 31

China. Grid (The First Phase) Gang Chen/CC/IHEP 2020/9/24 - 31

China. Grid Specific Application ZSU PKU SJTU XJTU NEU HUST SCUT BUAA NUDT Remote

China. Grid Specific Application ZSU PKU SJTU XJTU NEU HUST SCUT BUAA NUDT Remote Image education processing grid THU Bioinformatics grid SEU Fluid dynamics grid SDU Massive information processing grid Data grid Computational grid Access grid High performance computing environment (campus grid) Gang Chen/CC/IHEP 2020/9/24 - 32

Bio-info Grid • To provide the bio-information data resources such as gene databases and

Bio-info Grid • To provide the bio-information data resources such as gene databases and Chinese medicine components databases, and bioinformation analysis tools to grid users; • To develop computing grid aided drug design systems based on the integration of the techniques of assembled biology, assembled chemistry, and computer aided filter, sequence analysis and structure, to optimize the drug design. Gang Chen/CC/IHEP 2020/9/24 - 33

Course On-line Grid Gang Chen/CC/IHEP 2020/9/24 - 34

Course On-line Grid Gang Chen/CC/IHEP 2020/9/24 - 34

Comments • Middle-wares of CNGrid and China. Grid are different from g. Lite •

Comments • Middle-wares of CNGrid and China. Grid are different from g. Lite • Security schema not based on CA • No efficient data management system • Interoperability work undergoing with BUAA and CNIC Gang Chen/CC/IHEP 2020/9/24 - 35

Thank you! Gang Chen/CC/IHEP 2020/9/24 - 36

Thank you! Gang Chen/CC/IHEP 2020/9/24 - 36