Storage ieri oggi e domani Luca dellAgnello INFNCNAF
- Slides: 10
Storage (ieri, oggi e domani) Luca dell’Agnello INFN-CNAF
Tematiche della sessione n Consolidamento del servizio ¨ Supporto Sto. RM ¨ Stato del MSS al Tier 1 ¨ Integrazione gestione sistemi storage per il calcolo e per i servizi n n Uno sguardo sul futuro ¨ Test di file-system/sistemi di storage per HEP ¨ Idee (e dubbi ) sul futuro dello storage Incipit discussione in vista meeting storage WLCG
Sto. RM n Product team (~ 3. 5 FTE) ha in carico sviluppo, test, certificazione, supporto (v. talk F. Giacomini) ¨ …. ed alcune componenti “esterne” n n n Stage roll-out con “early adopters” ¨ ¨ n ~ 2 settimane INFN-T 1, INFN-CNAF, INFN-BARI, INFN-PADOVA, … Prevista procedura per “urgent fix” ¨ ¨ n Plug-in gridftp per checksum Layer GPFS-TSM Solo se per problemi bloccanti AND solo se non esiste workaround Rilascio rpm ad hoc per sito con problema 3 livelli supporto ¨ ¨ ¨ Helpdesk di EGI (smistamento ticket) Support unit in INSPIRE (esperti in shift) Sviluppatori: da interpellarsi solo per bug!
GEMSS: GPFS/TSM/Sto. RM integration • GPFS is a parallel file system while TSM is a high-performance backup/archiving solution • Both products (from IBM) are widely used (separately) and diffused • Large GPFS installation is in production at CNAF since 2005, with increasing disk space and number of users • 2 PB of net disk space (~ 6 PB in Q 2 2010) partitioned in several GPFS clusters • • 150 disk-servers (NSD + Grid. FTP) connected to the SAN We combined the features introduced in version 3. 2 of GPFS and TSM with Sto. RM, to provide a transparent grid-enabled HSM solution. An interface between GPFS and TSM (named GEMSS) was implemented to enable tape-ordered recalls CASTOR phase-out nearly completed (Q 1 2010) 4
Building blocks of the new system • Disk-centric system with five fundamental components 1. GPFS: disk-storage software infrastructure DAT A FILE TSM DAT A FILE 2. TSM: tape management system N 3. Sto. RM: SRM service DATA FILE DAT A FILE TA 4. GEMSS: Sto. RM-GPFS-TSM interface DATA FILE GEMSS DATA MIGRATION PROCESS IL GEMSS DATA RECALL PROCESS SA N 5. Grid. FTP: WAN data transfers DATA FILE N TA DAT A FILE M Sto. RM DATA FILE SA N WORKER NODE DAT A FILE LAN GPFS DAT A FILE LAN DAT A FILE DAT A FILE SAN Grid. FTP WAN data transfers DAT A FILE 5
Lo storage: un tema sempre caldo in ambito WLCG n Revisione critica del modello attuale di storage ¨ Forte spinta dagli esperimenti ¨ Varie idee non ancora focalizzate n Alcune “tappe” fissate ¨ Storage jamboree (Amsterdam 16 -18 Giugno) ¨ WLCG workshop (London 7 -9 Luglio) n Porteremo nostra esperienza come INFN
Links Storage Jamboree (June 16 -18 2010) http: //indico. cern. ch/conference. Display. py ? conf. Id=92416 n WLCG workshop (July 7 -10 2010) n
Sto. RM production layout for CMS 2 x 10 Gbps 4 Grid. FTP servers (4 x 2 Gbps) 6 NSD servers (6 x 2 Gbps on LAN) LAN 20 x 4 Gbps 8 x 4 Gbps 500 TB GPFS file system SAN 6 x 4 Gbps HSM STA 3 TSM Storage Agents and HSM clients 3 x 4 Gbps DB 2 SAN DB 2 HSM STA TSM server TAPE LIBRAR Y TAN 8 x 4 Gbps 11 tape drives 1 TB per tape 1 Gbps per drive 9
Sto. RM layout for ATLAS (T 1 D 0) 2 x 10 Gbps 6 Grid. FTP servers (6 x 2 Gbps) 4 NSD servers (4 x 2 Gbps on LAN) LAN 20 x 4 Gbps 8 x 4 Gbps 16 ( 60 TB) GPFS fs SAN 4 x 4 Gbps HSM STA TSM Storage Agents and HSM clients 2 x 4 Gbps DB 2 SAN DB 2 HSM STA TSM server TAPE LIBRAR Y TAN 8 x 4 Gbps 11 13 tape drive 1 TB per tape 1 Gbps per drive 10
