NOAANWS Telecommunication Gateway GTS System Fred Branski May

NOAA/NWS Telecommunication Gateway GTS System Fred Branski May 21, 2004

National Weather Service Telecommunication Gateway The Primary Data Communications Switching Facility of the NWS Operated 24 X 7 by the Telecommunication Operations Center Which is Part of the Office of the Chief Information Officer Housed in a Highly Resilient Facility with Dedicated Power and Environmental Systems

National Weather Service Telecommunication Gateway Serves the U. S. Public, Government and Commercial Hydrometeorological, Oceanographic, Climatological and Emergency Management Communities Critical Acquirer and Provider of Data and Products to and from Many Systems and Agencies

National Weather Service Telecommunication Gateway The Advanced Weather Interactive Processing System (AWIPS) and NOAAPort Network Control Facility (NCF) The ASOS Operations and Monitoring Center (AOMC) Aggressively Pursuing an Alternate Operational Facility

National Weather Service Telecommunication Gateway ICAO - The Communications Portion of the Washington World Area Forecast System (WAFS) Center Aeronautical Fixed Telecommunication Network (AFTN) Switch OPMET Data Bank Server Critical to the Aviation Community for Acquiring and Providing Timely Data and Products

National Weather Service Telecommunication Gateway WMO - The Communications Portion of the Washington World Meteorological Center Regional Telecommunication Hub (RTH) for WMO Region IV Provides the Path for U. S. Meteorological and Related Products to the Rest of the World and for their Products Back into the U. S.

NWSTG Structure & Function Components • • • 3 Mainframes – Active, standby, test & development >70 Unix servers (HTTP, File server, communications, data processing) >2 terabytes of online storage >160 point-to-point communication circuits 7 internal networks 5/21/2004 7

NWSTG Structure & Function 5/21/2004 8

NWSTG Structure & Function Message Processing • Data input from various sources • Data is identified by WMO or AWIPS heading • Data stored in a receive queue along with information retrieved from a switching directory (>130, 000 entries) • Some data selected for processing which may generate new products • Data written to transmit queue(s) based on switching directory information • Data sent to destination(s) 5/21/2004 9

NWSTG Structure & Function Message Processing >850, 000 messages received daily >8. 5 billion bytes received daily 5/21/2004 10

WMO Global Telecommunication System Main Trunk Network 5/21/2004 11

The Improved MTN (IMTN) The planned IMTN configuration should be achieved in 2004 Cloud I Frame Relay by BT Ignite Beijing Tokyo Melbourne Washington Buenos Aires Brasilia Moscow New Delhi Prague Sofia Exeter Jeddah Cloud II Offenbach Frame Relay by Equant Nairobi Dakar Cairo Toulouse Algiers

MTN Connectivity in RAII &V (slide from Hiroyuki ICHIJO (JMA) [Mbytes/20 min] 4 Melbourne to Tokyo (326 kbps) (3 October 2003) [Mbytes/20 min] Washington to Tokyo (CIR=768 kbps) 60 3 File FAX BIN AN 2 50 1 0 00 03 [UTC] [Mbytes/20 min] 4 06 09 12 15 18 40 21 (3 October 2003) Tokyo to Melbourne (16 kbps) File FAX BIN 30 3 FAX BIN 2 AN 20 AN 1 0 00 03 06 09 12 15 18 21 [UTC] 0 00 CIR= Access circuit 768 kbps 1. 5 Mbps 32 kbps 1. 5 Mbps Tokyo 16 kbps 32 kbps 09 12 15 Tokyo to Washington (CIR=32 kbps) 18 21 [UTC] (3 October 2003) 4 1 Bracknell 32 kbps 64 kbps 256 kbps BIN AN 2 32 kbps Melbourne 5/21/2004 06 3 IMTN Cloud I Frame Relay 16 kbps 256 kbps 03 [Mbytes/20 min] Washington 16 kbps 32 kbps 10 0 00 03 06 09 12 15 18 21 [UTC] 13

Specific characteristics of IMTN datacommunication clouds Flexibility of establishing logical connections (PVC) Asymmetric bandwidths (CIR: Committed Information Rate) PVC Access circuit 1. 5 Mbps CIR= 768 kbps Tokyo 32 kbps 1. 5 Mbps Washington 16 kbps Cloud I Frame Relay 32 kbps 16 kbps Bracknell Melbourne 256 kbps 32 kbps 64 kbps 256 kbps

Observations $ Over 450, 000 Observations Distributed Daily $ 152, 000 Surface Observations $ 3, 100 Upper Air Observations $ 4, 700 Ship Reports $ 46, 000 Aircraft Reports $ 48, 000 DCP Reports $ 200, 000 Satellite Reports $ Observations from 33, 000 Places

Model Output $ Over 96, 000 Model Products Distributed Daily $ 9 NCEP Models Run Daily $Hurricane, Volcanic Ash and Hydrological Dispersion Model as Needed $EPA Air Quality Forecast $ Also from Canada, United Kingdom, Japan, Australia, NWS River Forecast Centers, Do. D

Text Products $ Over 36, 000 Text Products Distributed Daily $ 23, 800 NWS Produced Text Products $ 7, 000 other U. S. Agency Text Products $ 5, 300 International Text Products

Pictorial Products $ Over 2, 000 Pictorial Products Distributed Daily $ Most in Red Book Graphic Format $OFCM Standard FCM-S 2 $ CCITT T 4 Fax and GIF products also

Data Input to the NWSTG • • • NWS (ASOS, WFOs, NCEP National Centers) – observations, guidance, forecasts, watches & warnings, national products FAA (ASOS) – aviation observations & intnl data Do. D (FNMOC, AFWA) Do. T (Coast Guard) – marine reports Other Government and Scientific Sources (NOS, OAR, USDA, Scripps Institute, Sea. Keepers, etc. ) – observations FEMA, Do. A, EPA ICAO (ISCS, AFTN) – aviation data WMO (GTS MTN, Other GTS) – meteorological and hydrological data Commercial community 5/21/2004 19

Data Input to the NWSTG Data Input Methods • • • IP Sockets X. 25 Asynchronous FTP – http: //weather. gov/tg/ftpingest. html Email – http: //weather. gov/tg/emailingest. html Web - http: //weather. gov/tg/bullguid. html 5/21/2004 20

Data Input to the NWSTG 5/21/2004 21

Data Input to the NWSTG 5/21/2004 22

NWSTG Data Dissemination - Push Broadcast, multicast, and point-to-point data dissemination: • • • NOAAPORT NWWS - NOAA Weather Wire Service • ISCS – International Satellite Communications System FOS – Family of Services • EMWIN – Emergency Manager’s Weather Information Network 5/21/2004 23

NWSTG Data Dissemination - Push ISCS – International Satellite Communications System • Supports two data dissemination requirements for – ICAO World Area Forecast System (WAFS) – WMO Regional Meteorological Telecommunication Network for Region IV (North America) supporting two-way communication (RMTN/GTS) • C-band satellite coverage for – US area of responsibility - 30°W to 120°E – European area of responsibility - 100°E to 30°W (SADIS) 5/21/2004 24

NWSTG Data Dissemination - Push ISCS – International Satellite Communications • • Data includes aviation weather and other meteorological, hydrological, and climatological products Six data streams – WAFS Text, GRIB, and Facsimile – RMTN Text, GRIB, and Facsimile • • Volume: >630 MB/day >180, 000 Products/day More Information at – http: //weather. gov/tg/iscscvr. html – http: //www. nws. noaa. gov/iscs/ 5/21/2004 25

NWSTG Data Dissemination - Push International Satellite Communications System 5/21/2004 26

ATLANTIC OCEAN REGION (AOR) ØThe AOR portion of the successor ISCS will be centered around the World. Com shared Master Satellite Hub, in Andover, Maine. ØThe Master Satellite Hub will be linked via a 64 Kbps (128 Kbps bursting) terrestrial (redundant) circuit to the National Weather Service Telecommunications Gateway (NWSTG) in Silver Spring, Maryland. ØThe NWSTG will continue to serve as the central point of data entry into the ISCS. ØAll ISCS data originating at the NWSTG will be transmitted, using TCP/IP network protocol, over to the World. Com Andover facility for broadcast to all ISCS AOR sites. 5/21/2004 27

NWSTG Data Dissemination - Push International Satellite Communications System RMTN two-way sites shown in orange 5/21/2004 28

ISCS WAFS – Pacific Ocean Region 5/21/2004 29

5/21/2004 30

5/21/2004 31

5/21/2004 32

5/21/2004 33

5/21/2004 34

NWSTG Data Dissemination - Push EMWIN – Emergency Managers Weather Information Network • Hemispheric direct broadcast using GOES East/West • Data includes a watches & warnings, forecasts, graphics, satellite imagery • • • Volume: >85 MB/day Used to distribute data to Emergency Managers More Information at – http: //iwin. nws. noaa. gov/emwin/index. htm 5/21/2004 35

NWSTG Data Dissemination - Push EMWIN – Satellite Footprint 5/21/2004 36

EMWIN Architecture 5/21/2004 37

NWSTG Data Dissemination - Push NOAAPORT • • • AWIPS satellite broadcast network (SBN) C-band satellite covering the entire US Data includes NCEP model products, satellite imagery, observations, forecasts, watches & warnings Volume: >23 GB/day >2, 000 Products/day Used to distribute data to – – • NWS field offices (WFOs and RFCs) Commercial Users with NOAAPORT Receiver Systems More Information at http: //www. nws. noaa. gov/noaaport/html/noaaport. shtml 5/21/2004 38

NWSTG Data Dissemination - Push Americom 4 C-Band NOAAPORT (SBN) 3. 5 T 1 Circuits: NOAAPORT Receive System (NRS) NCEP/NWSTG Data GOES East GOES West Master Ground Station (MGS) Non-GOES Imagery/DCP 4 T 1 Circuits 140+ AWIPS Field Sites Weather and Forecast Products Satellite Imagery AWIPS Network Control Facility (ANCF) 5/21/2004 Source: NGIT AWIPS Briefing, L. Klet 39

NWSTG Data Dissemination - Push NWWS – NOAA Weather Wire Service • • • Nationwide satellite distribution system for text products C-band Ku-band satellite covering the entire US Data uplinked from 14 WFOs/RFCs, 6 National Centers Data includes forecasts, watches & warnings Volume: >8 GB/day Used to distribute data to – – • Media Emergency Managers More Information at – – 5/21/2004 http: //www. nws. noaa. gov/nwws/ http: //dynis. dyncsc. com/contracts/nwws/index. html 40

NWSTG Data Dissemination - Push NWWS – System Data Flow Source: Detailed NWWS Data Collection Flowchart 5/21/2004 41

NWSTG Data Dissemination - Push FOS – Family of Services (Push) • • • Point-to-point and multicast communication services Serves commercial customers on a cost recovery basis More information at – http: //www. nws. noaa. gov/datamgmt/fosindex. html • FOS Offerings 5/21/2004 Public Product Service High Resolution Data Service Domestic Data Service Radar Product Service International Data Service Server Access Service (not push) 42

NWSTG Data Dissemination - Push Products Provided via Push • Content managed by the Data Management group in the Operations Support and Performance Branch • Changes made on a daily basis in response to operational requirements and customer requests • Products identified in the NWSTG (the Switching Directory) listed at http: //weather. noaa. gov/tg/wmohdg. shtml • Products pushed via FOS, ISCS, NOAAPORT, and EMWIN listed at http: //weather. noaa. gov/tg/dir_subset. shtml 5/21/2004 43

NWSTG Data Dissemination - Pull Servers provide access to stored data through various server protocols • FTP – Access to data files via anonymous FTP at ftp: //tgftp. nws. noaa. gov (since 1993!) • FTPMail – Email based FTP for clients without the ability to establish interactive sessions • HTTP – Access to data files via http: //weather. noaa. gov/pub (since 1994!) FOS Server Access Services – FTP access through a dedicated connection • 5/21/2004 44

NWSTG Data Dissemination - Pull FTP – Access to data files via anonymous FTP at ftp: //tgftp. nws. noaa. gov including • NCEP model output http: //weather. gov/tg/modfiles. html • Product files (multiple messages or bulletins per file) http: //weather. gov/tg/txtfiles. html http: //weather. gov/tg/obsfiles. html • WSR-88 D Level III products http: //weather. gov/tg/radfiles. html • Satellite products http: //weather. gov/tg/satfiles. html • Facsimile products http: //weather. noaa. gov/fax/index. html See http: //weather. gov/tg/dataprod. html for more information 5/21/2004 45

NWSTG Data Dissemination - Pull FTPMail – Email based FTP • • Access to all FTPable products on ftp: //tgftp. nws. noaa. gov Email an FTP command sequence to ftpmail@weather. noaa. gov • Used primarily in the maritime community to retrieve products via satellite email services • See http: //weather. gov/tg/ftpmail. html for usage details 5/21/2004 46

NWSTG Data Dissemination - Pull HTTP – Access to data files • Access all the products at ftp: //tgftp. nws. noaa. gov without FTP overhead at http: //weather. noaa. gov/pub • Provides more browsable alternative to FTP • Application-based HTTP file transfers are often faster than FTP • Traditional interactive Web services include – http: //weather. gov – http: //weather. noaa. gov – http: //iwin. nws. noaa. gov 5/21/2004 47

NWSTG Data Dissemination - Pull FOS Server Access Services (SAS) – FTP access through a dedicated connection • SAS customers establish a point-to-point connection with and NWS router • Customer router hosting at the NWSTG for balanced multiple-circuit connections • • 64 Kb, T 1, multiple-T 1, and T 3 connections Access to a non-public anonymous FTP server holding the same data as ftp: //tgftp. nws. noaa. gov 5/21/2004 48

NWSTG Data Dissemination - Pull File Formats • Single product files: http: //weather. noaa. gov/pub/data/raw/wg/wghw 70. phfo. ffs. hi. txt • Multiple product files: http: //weather. noaa. gov/pub/SL. us 008001/DF. an/DC. sflnd/DS. metar/sn. 0021. txt • See http: //weather. gov/tg/fstandrd. html for a description of how products are delimited within a file Non-headed product files: • CWA-specific, Zone-specific or named files: http: //weather. noaa. gov/pub/SL. us 008001/ST. opnl/MT. eta_CY. 00/RD. 20040108/PT. grid_DF. bb/fh. 0000_tl. press http: //weather. noaa. gov/pub/data/forecasts/zone/wa/waz 007. txt http: //weather. noaa. gov/pub/data/records/wa/seattle. txt 5/21/2004 49

NWSTG Data Dissemination - Pull Directory Structures • Descriptive directory naming: http: //weather. noaa. gov/pub/data/forecasts/zone/wa/waz 007. txt http: //weather. noaa. gov/pub/data/records/wa/seattle. txt • See http: //weather. gov/tg/engfiles. html Encoded Directory naming: http: //weather. noaa. gov/pub/SL. us 008001/DF. an/DC. sflnd/DS. metar/sn. 00 21. txt http: //weather. noaa. gov/pub/SL. us 008001/ST. opnl/MT. eta_CY. 00/RD. 200 40108/PT. grid_DF. bb/fh. 0000_tl. press See the Directory and File Naming Standards document at http: //www. nws. noaa. gov/datamgmt/filstnd. html to understand how to decode 5/21/2004 50

NWSTG Data Dissemination - Pull Directory Structures – decoding example http: //weather. noaa. gov/pub/SL. us 008001/DF. an/DC. sflnd/DS. metar/sn. 0021. txt SL. us 008001 – server location: United States (us), NWSTG (008), Server 1 (01) DF. af – data format: WMO bulletins of alphanumeric data as GTS exchanged (ASCII) DC. sflnd – data category: Surface data (land) DS. metar – data subcategory: Aviation – METAR sn. 0021. txt – sequence number file (21 st in the sequence) containing text data 5/21/2004 51

NWSTG Data Dissemination - Pull Directory Structures – decoding example http: //weather. noaa. gov/pub/SL. us 008001/ST. opnl/MT. eta_CY. 00/RD. 20040108 /PT. grid_DF. bb/fh. 0000_tl. press SL. us 008001 – server location: United States (us), NWSTG (008), Server 1 (01) ST. opnl – status of data files: operational MT. eta – model type: Eta Forecast Model CY. 00 – cycle of run: 00 UTC RD. 20040108 – reference date: January 08, 2004 PT. grid – product type: gridded DF. bb – data format: WMO bulletins of binary fields in GRIB as GTS exchanged fh. 0000 – forecast hour 0000 UTC tl. press – type of level or layer: pressure 5/21/2004 52

1954 - 9 Teletype Circuits 1966 - 2 IBM 360 Computers 104 Ckts, one at 3. 6 k bps 1992 - 3 HDS 9060 Computers T 1 to NMC (NCEP) 1998 - 2 IBM 9672, 1 IBM 9673 2 IBM 6000/F 50 servers 2 IBM 6000/H 50 servers 10 Mbs Ethernet to NCEP ATM and multiple T 1 s Today? KWBC Weather Bureau Communications Began as a manual data collection and distribution center in World War II

A View of the Past

Your Data and Product Advocates Data Management Staff P Fred Branski - Team Leader, Data Management fred. branski@noaa. gov (301) 713 -0864 ext 146 P Julie Hayes - Family of Services Manager julie. hayes@noaa. gov (301) 713 -0864 ext 120 P Walter Smith - Senior Data Manager walter. smith@noaa. gov (301) 713 -0864 ext 139 P Richard Robinson - Data Manager richard. robinson@noaa. gov (301) 713 -0864 ext 179 P Sharon Abbas – Data Manager sharon. abbas@noaa. gov (301) 713 -0864 ext 120 P Tom King – Statistics Analysis and Support tom. king@noaa. gov (301) 713 -0864 ext 110 P KWBC Communication Control Center (CCC) - Tech Control <Point of contact 24 hours every day < Phone: (301) 713 -0902 < Fax: 5/21/2004 (301) 587 -1773 55

National Weather Service Telecommunication Gateway GTS System Questions / Discussion