Job Process Data Promoting Science 3 Job Promoting
데이터 분석 Job Process Data Promoting Science 3
그리드 작업 Job Promoting Science 4
WLCG 그리드 작업 처리 기본 정책 Job Process Data Promoting Science 5
WLCG 그리드 작업 처리 기본 정책 Job processed on site where the Data stored Process Data Site Domain Promoting Science 6
WLCG 그리드 작업 처리 기본 정책 Job Job To reduce I/O overhead as much as possible Process Data Site Domain Promoting Science 7
그렇다면 사용자 관점에서는? Job Don’t care! Promoting Science 8
실제로 어떤 일이 벌어질까? Data Location File Catalog WMS Grid Gate Batch System Queue Data Job Site Domain Promoting Science 9
Computing Element Data Location File Catalog WMS Grid Gate Queue Batch System Computing Element Data Job Site Domain Promoting Science 10
Computing Element Data Location File Catalog WMS CE Queue Batch System Computing Element Data Job Site Domain Promoting Science 11
다시 한번 사용자 관점에서는? Job Don’t care! BUT Result must be returned fast AND must not DIE!! Promoting Science 12
Pilot Job Data Location File Catalog WMS Pilot Job Queue CE Batch System Computing Element Data Job Site Domain Promoting Science 13
Pilot Job Data Location File Catalog WMS CE Queue Job Batch System Pilot Job Computing Element Check Job Environment Site Availability Data Site Domain Promoting Science 14
Promoting Science 15
Pilot Job Data Location File Catalog WMS CE Queue Job Batch System Pilot Job Computing Element Check Job Environment Site Availability Data Site Domain Promoting Science 16
그래서 실제로는 WMS Queue Job Agent Job Agent Job Agent activated by pilot job PULLS user Job (The Real Job) Worker Node Promoting Science 17
데이터 RAW Data LHCOPN XRoot. D Cluster Disk TAPE Site Domain Promoting Science 18
Storage Element LHCOPN XRoot. D Cluster Disk ALICE: : KISTI_GSDC: : TAPE Storage Element TAPE Site Domain Promoting Science 19
File Catalog LHCOPN XRoot. D Cluster Disk ALICE: : KISTI_GSDC: : TAPE Data Location File Catalog Storage Element TAPE Site Domain Promoting Science 20
LFN vs PFN Logical Filename Physical Filename /alice/data/2016/LHC 16 e/123456/ESD/001/root_archive. zip xroot: //alice-t 1 -xrdr 01. sdfarm. kr: 1094//01/39482/…/root_archive. zip xroot: //eos-alice. cern. ch: 1094//01/39482/…/root_archive. zip Replication Promoting Science 21
Real Picture Promoting Science 22
Data, Job, Trust? Promoting Science 23
CA is not enough! CERN CA Who you are! X. 509 Cert Promoting Science It’s me! Site 24
CA is not enough! KISTI CA Hmm. . Give me data! Site Promoting Science X. 509 Cert 25
VOMS /vo=alice/role=user /vo=alice/role=lcgadmin VOMS X. 509 Cert We are the one! Site Promoting Science X. 509 Cert 26
기타 • • • Information Service Accounting - APEL Squid Proxy perf. SONAR-PS … Promoting Science 27
결론 • WLCG 구성요소 • • • Computing Element Storage Element Information Service VOMS … Promoting Science 28
- Slides: 28