INherentINdonesia GRID Bobby Nazief Ph D naziefcs ui
INherent/INdonesia GRID Bobby Nazief, Ph. D. nazief@cs. ui. ac. id GCRG@CSUI Grid Computing Research Group FASILKOM – University of Indonesia SUN HPC GRID Seminar
Agenda n Komputasi Grid: n n n Motivasi, Konsep, Cakupan Proyek-proyek Pengembangan Komputasi Grid di Dunia in. GRID n Motivasi, Arsitektur, Spesifikasi Teknis, Rencana 2/23/2021 SUN HPC GRID Seminar 1
Komputasi Grid: Model Operasional Severs NCSA Cluster (225 CPU) Client (AIST) Severs AIST Cluster (50 CPU) Titech Cluster (200 CPU) KISTI Cluster (25 CPU) 2/23/2021 SUN HPC GRID Seminar 2
Quality, economies of scale Komputasi Grid: Motivasi Decouple production & consumption, enabling n n On-demand access Economies of scale Consumer flexibility New devices Time 2/23/2021 SUN HPC GRID Seminar 3
Komputasi Grid: Konseptual “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations” 3 1 2/23/2021 2 SUN HPC GRID Seminar 4
Komputasi Grid: Cakupan Cluster Grid 2/23/2021 Enterprise Grid SUN HPC GRID Seminar Global Grid 5
Proyek-proyek Pengembangan Komputasi Grid Many Grid development efforts — all over the world • UK e-Science Grid • NASA Information Power Grid • Netherlands – VLAM, Polder. Grid • DOE Science Grid • Germany – UNICORE, Grid proposal • NSF National Virtual Observatory • France – Grid funding approved • NSF Gri. Phy. N • Italy – INFN Grid • DOE Particle Physics Data Grid • Eire – Grid proposals • NSF Tera. Grid • Switzerland - Network/Grid proposal • DOE ASCI Grid • Hungary – Demo. Grid, Grid proposal • DOE Earth Systems Grid • Norway, Sweden - Nordu. Grid • DARPA Co. ABS Grid • Data. Grid (CERN, . . . ) • NEESGrid • Euro. Grid (Unicore) • DOH BIRN • Data. Tag (CERN, …) • Astrophysical Virtual Observatory • NSF i. VDGL • GRIP (Globus/Unicore) • GRIA (Industrial applications) • Grid. Lab (Cactus Toolkit) • Cross. Grid (Infrastructure Components) • EGSO (Solar Physics) 2/23/2021 SUN HPC GRID Seminar 6
NEES (Network for Earthquake Engineering Simulation) Collaboratory U. Nevada Reno www. neesgrid. org 2/23/2021 SUN HPC GRID Seminar 7
NEESgrid at Work UIUC Experimental Model U. Colorado Experimental Model NCSA Computational Model m 1 f 2 f 1 f 2 m 1 2/23/2021 SUN HPC GRID Seminar 8
Inisiatif Komputasi Grid di Negara Tetangga n Thailand – Thai. Grid n n n Singapore – NGP (National Grid Project) n n n Dimulai pada bulan September 2002 3 univ. , 5 kementrian (MOE, MOH, MITA, MINDEF, MTI) Malaysia n n Dimulai pada tahun 2002 Pendanaan: $ 6 M (3 tahun) 10 univ. , Weather Forecast Services, NECTEC 158 CPUs Proposal “National Technology Roadmap for Grid Computing” diajukan ke MOSTI (inisiator: MIMOS Berhad, th. 2005) Forum-forum Regional: n n 2/23/2021 SEA Grid Forum (3 negara) Ap. Grid (14 negara) SUN HPC GRID Seminar 9
in. GRID: INHERENT/INDONESIA GRID n Ide n n RI-GRID: Usulan Pengembangan Infrastruktur Komputasi Grid Nasional, Mei 2006 Bagian PHK INHERENT K 1 UI ”Menuju Kampus Dijital: Implementasi Virtual Library, Grid Computing, Remote-Laboratory, Computer Mediated Learning, dan Sistem Manajemen Akademik dalam INHERENT, ” Sep ’ 06 – Mei ‘ 07 n Tujuan: n Membangun infrastruktur komputasi grid di INHERENT dengan kapasitas sumber daya komputasi awal sebesar 32 prosesor (~ Intel Pentium IV) dan 1 TB n n Kapasitas ini diharapkan bertambah dengan bergabungnya sumber daya komputasi lainnya di INHERENT lainnya Membangun komunitas e-Science di Indonesia. 2/23/2021 SUN HPC GRID Seminar 10
INHERENT: Indonesia Higher Education Network 2/23/2021 SUN HPC GRID Seminar 11
Motivasi in. GRID n n n Tersedianya infrastruktur jaringan komputer nasional (INHERENT) Semakin matangnya perangkat lunak komputasi grid Kedua hal di atas memungkinkan pembangunan infrastruktur komputasi berkapasitas besar dan tidak mahal n n n bertahap kolaboratif Infrastruktur komputasi berkapasitas besar dibutuhkan dalam pengembangan e-Science 2/23/2021 SUN HPC GRID Seminar 12
e-Science n n The term e-Science (or e. Science) is used to describe computationally intensive science that is carried out in highly distributed network environments, or science that uses immense data sets that require grid computing [John Taylor] Bioinformatics (study of the human genome and proteome to understand genetic diseases) n Nanotechnology (design of new materials from the molecular scale) n Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems) n Business (commercial data center, pay-per-use computing) 2/23/2021 SUN HPC GRID Seminar 13
Arsitektur in. GRID PORTAL User U* Globus Head Node User Windows/x 86 Cluster INHEREN T Linux/x 86 Cluster UI I* Globus Head Node Solaris/x 86 Cluster 2/23/2021 Linux/Sparc Cluster Custom PORTAL SUN HPC GRID Seminar 14
Spesifikasi Teknis: H/W n in. GRID Portal n n Globus Head Node n n SUN Fire X 2100, AMD Opteron Processor (2. 2 GHz, dual core), 1 GB Memory, 80 GB Disk, 2 10/1000 Mbps NICs, DVD-ROM Drive Linux Cluster (16 simpul) n n SUN Fire X 2100, AMD Opteron Processor (2. 4 GHz, dual core), 2 GB Memory, 80 GB Disk, 2 10/1000 Mbps NICs, DVD-ROM Drive SUN Fire X 2100, AMD Opteron Processor (2. 2 GHz, dual core), 1 GB Memory, 80 GB Disk, 2 10/1000 Mbps NICs Storage Server n Dual Xeon Processor (3. 0 GHz), 2 GB Memory, 1 TB Disk 2/23/2021 SUN HPC GRID Seminar 15
Spesifikasi Teknis: S/W n Antar-Muka Pengguna: n n n Globus Toolkit n n Povray Utilities: n C, Java Paralel: MPICH 2/23/2021 Blast Computer Graphic: n n Gromach Biologi: n Sun Grid Engine (SGE) Lingkungan Pemrograman: Kimia: n Job Scheduler: n n Aplikasi Middleware n n UCLA Grid Portal n SUN HPC GRID Seminar Perkalian Matriks, Sort, Octave (Matlab-like) 16
Globus Toolkit™ n Kumpulan perangkat lunak yang mendukung komputasi grid, dengan komponen-komponen utama: n GSI: Grid Security Infrastructure single sign-on, authentication, authorization, secure data transfer n GRAM: Grid Resource Allocation & Management remote job submission & management n RFT/Grid. FTP: Reliable File Transfer secure & robust data movement n MDS: Monitoring & Discovery Service directory services of available resources & their status n API untuk mengakses komponen-komponen di atas n Lingkungan pemrograman (C header files) untuk membangun program-program berbasis grid 2/23/2021 SUN HPC GRID Seminar 17
in. GRID: Alur Kendali 2/23/2021 SUN HPC GRID Seminar 18
in. GRID: Portal http: //grid. ui. ac. id/portal 2/23/2021 SUN HPC GRID Seminar 19
in. GRID: Data Management 2/23/2021 SUN HPC GRID Seminar 20
in. GRID: Job Management 2/23/2021 SUN HPC GRID Seminar 21
in. GRID: Application Management 2/23/2021 SUN HPC GRID Seminar 22
in. GRID: Resource Management 2/23/2021 SUN HPC GRID Seminar 23
Rencana Pengembangan n n Membangun komunitas pengguna/e-Science (silakan mendaftar di http: //grid. ui. ac. id/ingrid/pendaftaran) Menambah koleksi aplikasi Meningkatkan kapasitas sumber daya komputasi (menghubungkan cluster-cluster komputer di PT-PT lainnya) Mengembangkan lingkungan pemrograman komputasi paralel/terdistribusi (Workflow, Ninf, dst. ) Mengembangkan portal-portal komputasi grid yang disesuaikan pada kebutuhan komunitas penggunanya (“Chem. Grid”, “Bio. Grid”, dst. ) 2/23/2021 SUN HPC GRID Seminar 24
Beberapa Sumber Informasi n Situs Grid Computing Research Group – FASILKOMUI: http: //grid. ui. ac. id/ n n blog pengembangan: http: //grid. ui. ac. id/blog Milis in. GRID: ingrid@ui. ac. id n n berlangganan: http: //news. ui. ac. id/cgibin/mailman/listinfo/ingrid arsip: http: //news. ui. ac. id/pipermail/ingrid/ n Globus Alliance: http: //www. globus. org/ n Open Grid Forum: http: //www. ogf. org/ 2/23/2021 SUN HPC GRID Seminar 25
Daftar Referensi n n n Yoshio Tanaka, Asia Pacific Grid: Towards a production Grid Bart Jacob, Grid computing: What are the key components? , June, 2003 Ian Foster, Grid Computing: Concepts, Applications, and Technologies, Tutorial at Grid Computing in Canada Workshop, Edmonton, May 1, 2002 Ian Foster, Introduction to the Grid, COMDEX 2003, Las Vegas, Nevada USA, November 18, 2003 Ian Foster, Globus Toolkit version 4, Tutorial, 1 st Intl. Conf. on e-Science and Grid Computing, Melbourne, Australia, December 12, 2005 Bobby Nazief, RI-GRID: Usulan Pengembangan Infrastruktur Komputasi Grid Nasional, e-Indonesia Initiative, Bandung, Mei, 2006 2/23/2021 SUN HPC GRID Seminar 26
- Slides: 27