WORKSHOP REMOTE MICROSCOPY FOR ELECTRON MICROSCOPY ITALIAN NATIONAL

  • Slides: 38
Download presentation
WORKSHOP REMOTE MICROSCOPY FOR ELECTRON MICROSCOPY ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND

WORKSHOP REMOTE MICROSCOPY FOR ELECTRON MICROSCOPY ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT www. cresco. enea. it migliori@enea. it

CRESCO Supercomputer and Telemicroscopy integrated in ENEA-GRID infrastructure Silvio Migliori; Giovanni Bracco; Salvatore Podda;

CRESCO Supercomputer and Telemicroscopy integrated in ENEA-GRID infrastructure Silvio Migliori; Giovanni Bracco; Salvatore Podda; Andrea Quintiliani; Marco Vittori ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM) Contents ENEA-GRID infrastructure (www. afs. enea. it/project/eneagrid) CRESCO and Telemicroscopy (www. cresco. enea. it) www. cresco. enea. it migliori@enea. it

ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim – Give to

ENEA-GRID Born in 1998 with 6 Italian geographic clusters Main aim – Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software – Build an homogeneous ICT infrastructure but with a distributed and delegated control – Integrate the ENEA-GRID with National and International GRIDS Application Software catalogs User Collective Resource Computers ENEA-GRID www. afs. enea. it/project/eneagrid Sensor nets Connectivity Fabric Colleagues & 3 D www. cresco. enea. it Data archives migliori@enea. it

THE CONCEPT OF ENEA GRID INFRASTRUCTURE By-Mark Ellisman DATA ACQUISITION DATA ANALYSIS ADV. -COMP.

THE CONCEPT OF ENEA GRID INFRASTRUCTURE By-Mark Ellisman DATA ACQUISITION DATA ANALYSIS ADV. -COMP. -GRAPHICS NETWORK Cell Centered Data Base “CCDB” IMAGING-INSTRUMENTS COMP. -RESOURCES MULTI-SCALE-DATA-BASES www. cresco. enea. it migliori@enea. it

ENEA-GRID from the user point of view Main feature: – – – Access from

ENEA-GRID from the user point of view Main feature: – – – Access from any kind of connection Sharing data in world wide areas (geographical file system AFS) Access to the data from any kind of digital device client Running any kind of programs Access to National and International GRIDS ENEA-GRID Computers Data archives Computers Sensor nets Software catalogs Trisaia Brindisi Portici ( Roma-1 Roma-2 Bologna www. cresco. enea. it EU… migliori@enea. it

ENEA-GRID from application point of view Potentiality: – – – Running all Software Model

ENEA-GRID from application point of view Potentiality: – – – Running all Software Model for any kind of computer architecture Only one installation for each software for all geographical computers All authorized users can have access the software from local site Any application can share the data in the common geographical file system All sensors can share the data easily using the geographical file systems Computers ENEA-GRID Software Model 1 Computers Software Model 2 Rules Software Model 3 Computers Sensor nets Software Model. . Software catalogs Trisaia Brindisi Portici ( Roma-1 Roma-2 Bologna www. cresco. enea. it EU… migliori@enea. it

ENEA GRID WEB ICA Application Portal (ICA-Protocol) Monitoring, Automatic recovery Accaunting Quality of service

ENEA GRID WEB ICA Application Portal (ICA-Protocol) Monitoring, Automatic recovery Accaunting Quality of service Graphical User Interface User programs and commercial codes LSF multi-cluster as integrator LSF XTERM AFS Geographical cross platform & File System AIX SGI SUN HP Win www. cresco. enea. it Linux Alpha migliori@enea. it …

A Simple view of ENEA GRID management environment WEB ICA User programs & commercial

A Simple view of ENEA GRID management environment WEB ICA User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler. Telnet LSF WEB ICA Cluster 5° ( Portici) Graphic User Interface Load Leveler Telnet User programs & commercial code Graphic User Interface LSF multi-cluster as integrator LSF Load Leveler & File System Telnet LSF AFS Geographical cross platform& File System Cluster 6° ( Brindisi) WEB Cluster 2° (Casaccia) ICA WEB User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler Telnet LSF AFS Geographical cross platform& File System ICA User programs & commercial code Graphic User Interface LSF multi-cluster as integrator Load Leveler Telnet LSF AFS Geographical cross platform& File System Cluster 1° ( Bologna) Cluster 3° (Frascati) Cluster 4° (Trisaia ) www. cresco. enea. it migliori@enea. it 8

ENEA-GRID Computational & 3 D Centers Ispra Saluggia S. Teresa 30 BOLOGNA #CPU/Core CASACCIA

ENEA-GRID Computational & 3 D Centers Ispra Saluggia S. Teresa 30 BOLOGNA #CPU/Core CASACCIA 140 FRASCATI 400 Manfredonia PORTICI 2750 90 45 BRINDISI TRISAIA www. cresco. enea. it migliori@enea. it

ENEA-GRID Computational Resources OS #CPU/Core Gflops AIX >300 3000 Linux x 86 32/64 >3000

ENEA-GRID Computational Resources OS #CPU/Core Gflops AIX >300 3000 Linux x 86 32/64 >3000 25000 Linux IA 64 (Altix) 64 300 IRIX 26 40 Frascati(8), Casaccia(4), Portici(1), Trisaia(8), Brindisi(1), Bologna(5) Solaris 8 10 Trisaia(4), Casaccia(2), Bologna(2) Windows 32/64 46 100 Mac OS X 14 60 Frascati(258), Bologna(24), Portici(18), Brindisi(2) Frascati(140), Casaccia(54), Portici(2700), Trisaia(20), Brindisi(84) Casaccia Frascati(4), Portici(34), Trisaia(4), Brindisi(4) Frascati(1), Trisaia(13) Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575) www. cresco. enea. it migliori@enea. it

HPC CRESCO INFRASTRUCTURE Backup system CRESCO Ø 17 TFlops SERVERS BACKUP IB Interconnections Infini.

HPC CRESCO INFRASTRUCTURE Backup system CRESCO Ø 17 TFlops SERVERS BACKUP IB Interconnections Infini. Band 4 XDDR IB 3 Nodi IBM 3650 FC SERVERS GPFS 4 Nodi IBM 3650 FC 300 TByte IBM Tape Library TS 3500 with 4 drives High speed disc 2 GByte/s 160 TByte IBM/DDN 9550 Section 1 (Large memory) 42 Nodi SMP IBM x 3850 -M 2 with 4 Xeon Quad-Core Tigerton E 7330 (32/64 GByte RAM 2. 4 GHz/ 1066 MHz/6 MB L 2) total 672 cores Intel Tigerton Section 2 (MPP) 256 Nodi blades IBM HS 21 with 2 Xeon Quad-Core Clovertown E 5345 (2. 33 GHz/1333 MH z/8 MB L 2), 16 GB RAM total 2048 cores Intel Clovertown Section 3 (Special) 4 Nodi blades IBM QS 21 con 2 Cell BE Processors 3. 2 Ghz each. 6 Nodi IBM x 3755, 8 Core AMD 8222 FPGA VIRTEX 5 4 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X 2 4 Nodi windows 8 core 16 Byte RAM Double interconnection at 1 Gbit & 1 network at 1 Gbit for management 35 Node for services Servers for : • Front-end • installations • AFS • … 4 x 10 Gbits Portici LAN www. cresco. enea. it 1000 Mbits GARR (WAN) 1000 Mbits migliori@enea. it

CRESCO HPC hall www. cresco. enea. it migliori@enea. it

CRESCO HPC hall www. cresco. enea. it migliori@enea. it

CRESCO HPC details Sections 1 & 3 Control room Corridor hot Sections 1 &2

CRESCO HPC details Sections 1 & 3 Control room Corridor hot Sections 1 &2 network: IB/GB www. cresco. enea. it Section 2 & DDN backup system migliori@enea. it

Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 3000 CPU/cores Code

Computational ability ENEA-GRID & CRESCO An heterogeneous system with more than 3000 CPU/cores Code Risorsa Serial Section 1 & ENEA-GRID Parallel hardly coupled Section 2 Embarrassing parallel Section 1, 2, ENEA-GRID System with several parallel codes Section 1, 2, Section 1+2 Special ( FPGA, GB, CELL) Section 3 windows (serial and parallel) Section 3 Not LINUX ENEA-GRID Large date “Data Base” Section 1, 2, 3 e GPFS www. cresco. enea. it migliori@enea. it

CRESCO in the Top 500 List June 2008 Italy (06/2008) 90 CINECA 125 ENEA

CRESCO in the Top 500 List June 2008 Italy (06/2008) 90 CINECA 125 ENEA 131 ENI 135 CILEA 156 CINECA 226 Telecom Jack Dongarra 2002 www. cresco. enea. it migliori@enea. it

GEANT 2008 boquad. bologna. enea. it dafne. casaccia. enea. it sp 4_-1. frascati. enea.

GEANT 2008 boquad. bologna. enea. it dafne. casaccia. enea. it sp 4_-1. frascati. enea. it Kleos. portici. enea. it Portici infocal. trisia. enea. it Gateway to EGEE & GRISU Brindisi Accesso WEB ercules. brindisi. enea. it Accesso Client www. cresco. enea. it www. afs. enea. it/project/eneagrid Accesso migliori@enea. it Diretto

ENEA GRID and experimental facilities DNA Sequence system ( ABI Prism 3700) Trisaia DB_2

ENEA GRID and experimental facilities DNA Sequence system ( ABI Prism 3700) Trisaia DB_2 ENEA GRID Controlled Nuclear Fusion: FTU Frascati Tokamak Upgrade Video Acquisition WEB ICA SSH CPUS DB_1 DB_3 Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) www. cresco. enea. it migliori@enea. it

ENEA-GRID for experimental facilities Main feature: – Access from any kind of connection –

ENEA-GRID for experimental facilities Main feature: – Access from any kind of connection – Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client Computers ENEA-GRID Sensor nets Computers Sensor nets Logical access (AFS) Trisaia Brindisi Portici ( Roma-1 Roma-2 EU… www. cresco. enea. it USA… migliori@enea. it

ENEA AFS ‘’DATA BASE’’ Università (Salerno) ORNL (USA) ENEA (Trisaia) Università (………. ) ENEA

ENEA AFS ‘’DATA BASE’’ Università (Salerno) ORNL (USA) ENEA (Trisaia) Università (………. ) ENEA Portici Corso SISM 9 -10 Ottobre 2007 www. cresco. enea. it migliori@enea, it

Conceptual structure for TEM Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Rem ote

Conceptual structure for TEM Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Rem ote U ser Remote Controlled Web-cam Mtaframe Special Driver for TEM AFS Local Operation Remote Local Operation Local Data AFS Data Integration > 4 TByte Local GRID Cluster TEM Room www. cresco. enea. it migliori@enea. it

Citrix Xen. App Unix Web conferencing WEB Sever Linux Cluster Citrix Xen. App Windows

Citrix Xen. App Unix Web conferencing WEB Sever Linux Cluster Citrix Xen. App Windows File server Local Data AFS Data Integration > 4 TByte Local GRID Cluster Special Driver for TEM Streaming server ENEA GRID SOFTWARE INFRASTRUCTURE Conceptual structure from a remote user’s point of view Main service Classroom • View of TEM image • Programs & Data • E-learning tools Remote Application Users ICA protocol • View of TEM image • Programs & Data • Supercomputing • 3 D Display • E-learning tools + Remote operation Remote Operation Users www. cresco. enea. it migliori@enea. it

Data synchronization from local to AFS (1) Corso SISM 9 -10 Ottobre 2007 www.

Data synchronization from local to AFS (1) Corso SISM 9 -10 Ottobre 2007 www. cresco. enea. it migliori@enea, it

Web data exchange from AFS (2) Gestione Documenti www. cresco. enea. it migliori@enea. it

Web data exchange from AFS (2) Gestione Documenti www. cresco. enea. it migliori@enea. it

Data exchange using AFS client (3) Client AFS AFS PC user Corso SISM 9

Data exchange using AFS client (3) Client AFS AFS PC user Corso SISM 9 -10 Ottobre 2007 www. cresco. enea. it migliori@enea, it

Shearing TEM images Local User BRINDISI Remote Controlled Web-cam Local Operation TEM Room Corso

Shearing TEM images Local User BRINDISI Remote Controlled Web-cam Local Operation TEM Room Corso SISM Remote User ROME Remote Local Operation Remote User USA Remote User FEI AFS Local Data AFS Data Integration > 4 TByte Local GRID Cluster ENEA Local Toolsmigliori@enea, it www. cresco. enea. it migliori@enea. it 9 -10 Ottobre 2007 TEM Images

Remote Controlled Web_cam Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Remote Controlled Web-cam

Remote Controlled Web_cam Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Remote Controlled Web-cam Remote User Local Operation Remote Local Operation TEM Room www. cresco. enea. it migliori@enea. it

Shearing TEM operation Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Classroom http: //connect.

Shearing TEM operation Electron Microscope (Brindisi) 300 Ke. V (sept. 2004) Classroom http: //connect. portici. enea. it/. . Remote Controlled Web-cam Local Operation connect server Remote User Remote Local Operation TEM Room www. cresco. enea. it migliori@enea. it

Corso SISM 9 -10 Ottobre 2007 www. cresco. enea. it migliori@enea, it

Corso SISM 9 -10 Ottobre 2007 www. cresco. enea. it migliori@enea, it

Remote TEM operation El. Microscope (Brindisi) 300 Ke. V (sept. 2004) Remote Controlled Web-cam

Remote TEM operation El. Microscope (Brindisi) 300 Ke. V (sept. 2004) Remote Controlled Web-cam Local Operation TEM Room Security Using NAT FEI Sotware for remote PAD FCS for cameras Remote User able to operate Coonect server Remote Local Operation Local User www. cresco. enea. it migliori@enea. it

Monitor Signal FCS Server internet www. cresco. enea. it migliori@enea. it

Monitor Signal FCS Server internet www. cresco. enea. it migliori@enea. it

www. campus. enea. it Selection Function On Line Curses Room Curses Virtual Room www.

www. campus. enea. it Selection Function On Line Curses Room Curses Virtual Room www. cresco. enea. it migliori@enea, it

www. cresco. enea. it Selection Function Software Collaborative work Supercomputing www. cresco. enea. it

www. cresco. enea. it Selection Function Software Collaborative work Supercomputing www. cresco. enea. it migliori@enea. it

A new ENEA-GRID & Virtual Lab New material & TEM ENEA Li University and

A new ENEA-GRID & Virtual Lab New material & TEM ENEA Li University and research institute Enterprise New collaborations www. cresco. enea. it migliori@enea. it

La ENEA-GRID interoperability with others GRID ENEA has been developing the “shared proxy” solution

La ENEA-GRID interoperability with others GRID ENEA has been developing the “shared proxy” solution EGEE ? EFDA • Maintain the GRID internal architecture and autonomy • Allow multiplatform impementations GARR • Under production on EGEE Others Entity PI 2 S 2 • Under production on GRISU • Required by EFDA for EGEE www. cresco. enea. it migliori@enea. it

ENEA-GRID & GRISU & IGI Ispra Saluggia Italian GRID Infrastructure BOLOGNA S. Teresa CASACCIA

ENEA-GRID & GRISU & IGI Ispra Saluggia Italian GRID Infrastructure BOLOGNA S. Teresa CASACCIA EN FRASCATI IN EA FN -G -G RI PORTICI RI D D Manfredonia BRINDISI TRISAIA GRISU SPACI www. cresco. enea. it migliori@enea. it

CRESCO for EUROPEAN FUSION IB Cresco 25 Tflops peak System for development and test

CRESCO for EUROPEAN FUSION IB Cresco 25 Tflops peak System for development and test of computational codes for ITER (EFDA contract) 1 Tflops peak www. cresco. enea. it migliori@enea. it

To collaborate with CRESCO www. cresco. enea. it migliori@enea. it

To collaborate with CRESCO www. cresco. enea. it migliori@enea. it

ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT www. cresco. enea. it

ITALIAN NATIONAL AGENCY FOR NEW TECNOLOGY, ENERGY AND THE ENVIRONMENT www. cresco. enea. it migliori@enea. it