Status report on the implementation of GISC at

  • Slides: 17
Download presentation
Status report on the implementation of GISC at CMA Li Xiang NMIC, CMA 2010.

Status report on the implementation of GISC at CMA Li Xiang NMIC, CMA 2010. 2

Development of GISC service • Metadata generation • Metadata Synchronization • Metadata search •

Development of GISC service • Metadata generation • Metadata Synchronization • Metadata search • Data subscription • Data dissemination • Web interfaces To support WIS/GISC’s functions and provide the services of DAR, Data request, Data subscription and GTS data ingest to WIS centers and authorized users.

GTS Bulletin Vol. C 1 CMA NWP Data CMA Satellite Data CMA TIGGE Data

GTS Bulletin Vol. C 1 CMA NWP Data CMA Satellite Data CMA TIGGE Data Vol. C 1 + Static Referance Information. Vol A Metadata Information Generating Table B 1 -B 6 from OP for GTS code list. . . . Metadata Basic Info. Metadata File Generating Metadata Generation Template XML File

Metadata Generation l Auto-generation - DAR metadata for GTS Bulletin • WMO Volume C

Metadata Generation l Auto-generation - DAR metadata for GTS Bulletin • WMO Volume C 1 (Catalogue of Meteorological Bulletins) - CMA NWP, FY Satellite Data, TIGGE data • Metadata files: 114, 495, including the metadata files for – GTS data (Vol C 1): 59, 175 – CMA NWP + FY satellite data : 1, 222 – TIGGE products: 54, 098 (10 centers’ products)

Metadata Synchronization (OAI, FTP) Development environment • Java jdk 1. 5 Metadata synchronization system

Metadata Synchronization (OAI, FTP) Development environment • Java jdk 1. 5 Metadata synchronization system • Oracle 10 g • OAI framework: - OAICat - OAIHarvester 2 • Web container JMA, DWD … Harvest System - Tomcat Provider System JMA, DWD …

Metadata Synchronization – provider configuration, monitoring

Metadata Synchronization – provider configuration, monitoring

Metadata Synchronization – harvester configuration, monitoring

Metadata Synchronization – harvester configuration, monitoring

Metadata Search • Directory navigation • Simple Search (keywords, title, time, …) • Complex

Metadata Search • Directory navigation • Simple Search (keywords, title, time, …) • Complex Search (geographical location+keywords+…) • SRU service, being implemented based on OCLC’s SRW/SRU open source

Data subscription • Web Interface (subscribe data) • Subscription parser (data order, dissemination metadata)

Data subscription • Web Interface (subscribe data) • Subscription parser (data order, dissemination metadata) • Service management (queue, monitoring) • Data dissemination (ftp, http, email)

Data dissemination • GTS – protocols: ftp, tcp sockets – other GTS centers •

Data dissemination • GTS – protocols: ftp, tcp sockets – other GTS centers • Internet – protocols: ftp, http, email – other centers, end-users

Collaboration with JMA • Implemented the services – Metadata synchronization • OAI-PMH, FTP –

Collaboration with JMA • Implemented the services – Metadata synchronization • OAI-PMH, FTP – Remote data request/reply • Access JMA data from CMA WIS portal • Access CMA data from JMA WIS portal – Web Data Ingest • CMA: bulletin-based interface, TAC->BUFR • JMA: report-based interface • software shared between CMA and JMA • Data Synchronization using blog-based technology

Collaboration with DWD • Metadata – DWD Metadata generator – Dissemination metadata • Contents,

Collaboration with DWD • Metadata – DWD Metadata generator – Dissemination metadata • Contents, XML template • Service backup – CMA Metadata synchronization components: harvester and provider • Data synchronization test (2009. 9) – AFD/FTP/SFTP, BLOG/HTTPS – test results: AFD has a better performance on making routine data exchange

Collaboration with DWD • Metadata synchronization test (2010. 1) • Test beds – CMA:

Collaboration with DWD • Metadata synchronization test (2010. 1) • Test beds – CMA: in-house software – DWD: Geo. Network • Test results – CMA harvesting metadata from DWD provider: 12387 metadata in 14940 s (1. 206 s/rec) – DWD harvesting metadata from CMA provider : 47326 metadata in 64441 s (1. 361 s/rec) -> more tests planned in March -> analyze performance and make improvement

Collaboration meeting on WIS development • Participants: • CMA, DWD, JMA • WISPO •

Collaboration meeting on WIS development • Participants: • CMA, DWD, JMA • WISPO • Discussion on • • DAR Metadata Data Synchronization Metadata Synchronization Service Monitoring and Service Backup • Outcomes • test plans for metadata synchronization • the document related to DAR metadata, including metadata file identifier, usage of keywords, usage of ISO element <CI_Online. Resource> for accessing online data and products, and submited it to CBS expert team.

Collaboration with HKO • HKO will operate a DCPC in connection with the World

Collaboration with HKO • HKO will operate a DCPC in connection with the World Weather Information Service (WWIS) and Severe Weather Information Centre (SWIC) under the WMO Public Weather Services Programme. • Beijing will be one of its the associated GISC • NMIC, CMA and HKO made discussion on WIS development in Beijing in November, 2009 – DAR metadata – metadata provision • Metadata provision tests – planned in March

Progress Metadata generation Metadata Synchronization √ √ Metadata search 80% (SRU service will be

Progress Metadata generation Metadata Synchronization √ √ Metadata search 80% (SRU service will be available in March) Data subscription 80% Data dissemination Web interface GISC service backup √ 70% Planned in 2010