Mission Operations ESPC Enterprise Product GenerationDistribution Chris Sisko

Mission Operations: ESPC Enterprise Product Generation/Distribution Chris Sisko NESDIS/OSPO - Mission Operations Division Telephone: 301 -817 -4783 Email: Chris. A. Sisko@noaa. gov 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov)

Presentation Outline Satellite Operations Overview ESPC – Environmental Satellite Processing Center What is the Product Distribution and Access System? Future NESDIS Data Operations: System interface to near real-time users - Nominal Operations - Non-nominal Operations (COOP/Back-up) - Top Challenges - Latest schedule information Summary Questions and Answers 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 2

Office of Satellite and Product Operations (OSPO) OSPO manages and directs: satellite operations, including health and safety of the spacecraft. central ground facilities which ingest, process, and distribute environmental satellite data and derived products to domestic and foreign users. 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 3

OSPO Operational Facilities Over 500 staff supporting or operating the satellites, receptors, and processing systems Suitland, MD College Park, MD Fairmont, WV* Wallops, VA Fairbanks, AK * GOES-R and JPSS (New) Backup Facility 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 4

Three Observation Vantage Points Polar-orbiting / LEO Operational Geostationary Operational Environmental Satellites Deep Space at Lagrange 1 Point 0 M , 30 22 iles ile M 540 s Each satellite covers the Earth twice per day • Pole-to-pole orbit is 101 minutes and views each location at the same time of day; capability for ½ orbit dumps with JPSS-1 • Global coverage every 12 hours with one satellite Continuous monitoring of the Sun Continuous monitoring of the Americas • Coverage over the same geographic location • Constant monitoring for nowcast purposes and forecast applications (NWP, etc. ) • Uninterrupted view of the sun • Information is used for solar winds monitoring for Space Weather warnings • EUMETSAT - mid-morning orbit • NOAA - early afternoon orbit 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 5

Nominal Satellite Data Flow 6

Product Distribution and Access (PDA) Overview NESDIS’s future enterprise distribution interface for real-time users. A scalable Service Orientated Architecture (SOA) that functions as both a high availability and high performance distribution system. Enables users to tailor products to meet unique mission requirements, including latency. Enhances IT security posture by utilizing in-depth defenses against evolving threats. PDA at NSOF (Suitland, MD) will support many missions; however, PDA at CBU (Fairmont, WV backup site) will only support the JPSS missions. Peak Throughput: • From Externals to PDA: ~10 Gbps • From PDA to Externals: ~55 Gbps • Network to Edge: scalable up to 120 Gbps Data Volumes: • 1 GOES-R Satellite – produces ~1 TB/day • 1 JPSS Satellite – produces ~4 TB/day (uncompressed) • 1 JPSS Satellite – produces ~1. 5 TB/day (compressed) • Note – other new satellite missions are likewise driving up the data volume sizes 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 7

PDA Interface Types Two types of PDA interfaces: o Standard PDA interface w/ User Portal to manage subscriptions Push & Pull services Standing subscriptions Ad-hoc request (i. e. one-time request) o Web Services PDA Interface to feed AWIPS Data Delivery (for NWS only) Pull service only Ad-hoc request Data Transfer Protocols o FTP-S - authorization credentials are encrypted, but data payload is not. o SFTP - whole session encryption o HTTPS Pull capability 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 8

Nominal Operations PDA supports near real-time users – prioritized according to most critical mission need. Network infrastructure provided by NWAVE; high performance, scalable network. PDA operators can perform load shedding of the lowest priority users – guarantees resources for highest priority users. ESPC Help Desk provides 1 st Tier of support – ESPCOperations@noaa. gov Phone: 301 -817 -3880 Operational Tier / Prioritization Tier 1 Tier 2 Tier 3 1 2 3 4 5 6 Life & Property / National Interest Missions Int'l Agreement Missions / NRT NOAA-NASA Environmental Missions/ Launch Support-Cal Val External Mission Support (i. e. AR) / Data Preservation/Archive Ops Test Support Mission (Dev) Test Support / Long Term Approved RT Request Prototype / Temporary Approved Dataflows or Tests / R 2 O 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 9

10

Notifications: Administrative / Outage Messages Direct notification process (ESPC Notification Message) o Utilizes email to contact a subscribed list of users o Send email to ESPCoperations@noaa. gov and ask to be added to the notification list Notification using bulletin services: o Outages, anomalies or COOP/back-up activation: WMO header: NOUS 71 KNES (AWIPS PIL: ADANES) for urgent notices - http: //www. weather. gov/view/valid. Prods. php? prod=ADM&node=KNES o Routine notices such as eclipse schedules, RSOs, maneuvers, etc. : WMO header: NOUS 72 KNES (AWIPS PIL: ADMNES) for routine notices - http: //www. weather. gov/view/valid. Prods. php? prod=ADA&node=KNES 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 11

Anomaly Notification / ESPC Messages Example of various message types. Msg Type Administrative Outage/Anomaly Msg Title Suomi-NPP Drag Makeup Maneuver (DMU) Suomi-NPP VIIRS Lunar Calibration with spacecraft roll (VLR) Suomi-NPP Risk Mitigation Maneuver (RMM) Suomi-NPP Inclination Maneuver (IM) Suomi-NPP Instrument Calibration Suomi-NPP Instrument Operating Mode Change Suomi-NPP General Notice (Unique Situations) Suomi-NPP Instrument Unknown Mode or Anomaly Suomi-NPP System Data Delay Suomi-NPP Ground System Anomaly Suomi-NPP Satellite Anomaly 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 12

Everyone, we have a problem! Remain Calm! We are moving to the Backup/COOP site! Suitland, MD 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 13

Non-Nominal Operations – Backup/COOP Operations transfers to Fairmont, WV (CBU) GOES-R transfers within minutes o Polar mission (JPSS) within 8 -12 hours o Data availability from CBU PDA: JPSS Mission: Prime Mission Sensor products o GOES-R Mission: None (CMI KPPs via GRB and AWIPS/SBN only) o • Fairmont, WV* Key Performance Parameters (KPPs) - key system capabilities that must be met in order for a system to meet its operational goals. 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 14

15

High Level Timeline / Schedule 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 16

Big Data Network Communication Challenges Bandwidth vs. time to transfer Necessary Bandwidth (Gbps) to receive data with no packet loss 6 Example: If you want to receive 20 GB of data in less than 5 minutes, a bandwidth speed of at least 500 Mbps of end to end network capacity is needed 5 4 100 GB 50 GB 3 20 GB 2 1 0 0 5 10 15 20 25 30 Time (minutes) NOTE: The slowest speed in the network path determines the overall data transfer speed. 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) GB - Gigabyte Gbps – Gigabit per second (1 Gigabit = 109 bits) 17

PDA User Data Volume Allocation Data Volume FTP-S SFTP (aggregated 24 hrs) (per day) 50 GB/day Bandwidth Projection* O O 100 GB/day ~5 Mbps ~15 Mbps 250 GB/day ~25 Mbps D A ~50 Mbps 1. 0 TB/day ~95 Mbps 1. 5 TB/day ~140 Mbps 2. 0 TB/day 3. 0 TB/day Concurrent Sessions No 3 This is the default data volume for users who are unable to determine their available bandwidth No 3 Option for users with larger data needs who have sufficient network/system resources ~10 Mbps 150 GB/day 500 GB/day Po. P Req’d D N ~190 Mbps Comments 3 A 3 Special authorization required from data access management group A Yes A Special authorization required from data access management group, accompanied with a technical assessment ~280 Mbps O – Optional D – Default A – Authorization required N – Not Authorized Po. P – Point of presence/dedicated route Default allocation based on less stringent requirements Premium allocation based on critical need by user Basic Premium allocation based on user capabilities Special allocation for select vital users with a major mission justification *note – absolute bandwidth minimum, does not factor in meeting user’s latency needs based on slowest link within the network path. 18

Summary Evolution of PDA and significant network upgrades (ESPC 2. 0) are crucial in the future mission success; those activities are on track with 1 st ORR scheduled in late July (GOES-R) and later in the summer for SNPP. The enterprise distribution system (PDA) and the associated network structure is highly scalable to meet near future data demands. Movement of large data between from systems to users is a significant challenge – slowest link in the network path dictates the overall speed across the entire path. New satellite mission data (NOAA and non-NOAA) are two orders of magnitude larger than our previous missions; therefore, users are dealing with Terabytes of data per day output from each spacecraft. 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 19

Many Thanks! Major Contributions from: Katie Feiner, Donna Mc. Namara, Paul Haggerty, Jing Han, Matt Seybold, Cherie Mumford and ESPDS Development Team 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 20

Acronyms CBU – Consolidated Backup COOP - Continuity of Operations Plan ESPC - Environmental Satellite Processing Center EUMETSAT - European Organisation for the Exploitation of Meteorological Satellites GB - Gigabyte Gbps - Gigabit per second (1 Gigabit = 109 bits) NESDIS - National Environmental Satellite, Data, and Information Service NSOF - NOAA Satellite Operations Facility OSPO - Office of Satellite and Product Operations PDA - Product Distribution and Access SOA - Service Orientated Architecture TB - Terabyte (1 TB = 1012 bytes Gbps) 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 21

Background Slides 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) Chris Sisko (chris. a. sisko@noaa. gov) 22

Future Architecture/Future Geo Operations 23

Future Architecture/Future Polar Operations 24

Key Performance Parameters Polar Orbiting Geostationary Mission SNPP/JPSS-1† METOP-A/B/C NOAA-19 GOES-R† Service / Location Primary PM (S-NPP) Primary AM (METOP-B) Prime Services SARSAT, ADCS TBD Imagery VIIRS* >70° N, NCC, 1. 6 µm AVHRR* > 70° N ABI (CMI) Sounder IR Cr. IS (TDRs) IASI/HIRS (L 1 B) Sounder microwave ATMS (TDRs) MHS AMSU-A/B (L 1 B) Re-broadcast X Other KPPs X † Well defined KPPs * Alaska Region Red: Recent Changes Note – KPPs are official for GOESR and JPSS missions only; this list contains other missions with equivalent KPPs if so defined in the near future. GOES-NOP H-8 MET-7/9/10/(11) 140 E MET 7 (57 E) MET 9/1 0 (9. 5 E, 0) Imager (CMI) AHI (CMI) MVIRI (CMI) SEVIRI (CMI) X X X MHS AMSU-A/B (L 1 B) X X X X GRB GVAR X X X ASCAT (OSWVs) X X X G 13 -E (75 W) G 15 -W (135 W) G 14 (spare) Acronym Description VIIRS Visible Infrared Imaging Radiometer Suite ASCAT Advanced Scatterometer Cr. IS Cross-track Infrared Sounder AVHRR Advanced Very High Resolution Radiometer ATMS Advanced Technology Microwave Sounder ABI Advanced Baseline Imager IASI Infrared Atmospheric Sounding Interferometer GRB GOES Rebroadcast HIRS High resolution Infrared Radiation Sounder GVAR GOES VARiable AMSU Advanced Microwave Sounding Unit MVIRI Meteosat Visible Infra-Red Imager AHI Advanced Himawari Imager SEVIRI Spinning Enhanced Visible and Infrared Imager CMI Cloud Moisture Imagery OSWV Ocean Service Wind Vector(s) KPP Key Performance Parameter H-8 Himawari 8 SNPP Suomi National Polar-orbiting Partnership GOES Geostationary Operational Environmental Satellite JPSS Joint Polar Satellite System METOP Meteorological Operational Satellite Infrared MET Meteosat Geostationary Satellite IR NCC 2016 Satellite Proving Ground/User-Readiness Meeting (May 9 -13, 2016) S(T)DR Sensor (Temperature) Data Record Near Constant Constrast Chris Sisko (chris. a. sisko@noaa. gov) 25