AWIPS Continuous Technology Refresh CTR AWIPS Software CTR
- Slides: 39
AWIPS Continuous Technology Refresh (CTR) AWIPS Software CTR TO 8: Outbrief February 7, 2008 This document includes data that shall not be duplicated, used, or disclosed – in whole or in part – outside the Government for any purpose other than to the extent provided in contract DG 133 W-05 -CQ-1067. However, the Government shall have the right to duplicate, use, or disclose the data to the extent provided in the contract. This restriction does not limit the Government’s right to use information contained in this data if it is obtained from another source without restriction. The data subject to this restriction are contained in all sheets.
T 08 Outbrief Introduction Intro AWIPS-II T 08 Summary n AWIPS-II Architecture Update n AWIPS-II CAVE Summary n AWIPS-II Workstation (CAVE) Capabilities n AWIPS-II SOA services n AWIPS-II Plug Ins n AWIPS-II Library n AWIPS-II Data n AWIPS-II TO 8 Testing n 12/29/2021 Page 2
Weather System Distributed User Needs: Increasing Data Interactions Drives Architecture Towards Advanced Solutions First Person Shooter Video Game Weather Edge User Visualization Summary Totally Non-Propriety Solution (Open Source) Quickly Adaptable to New Science & Data Types Accelerate Innovation & Speed of Deployment Sat Com Google Earth Situational Awareness Visualization CAD Systems Enabling of Con-Ops Flexibility: 164 Centers Increasing Data Rates High Data Rates With Gaming Style Interaction 12/29/2021 Page 3
TO 8 Task Order n Summary Primary task is to migrate D 2 D workstation capability to the new AWIPS-II developed architecture – Performed workstation capabilities migration – Performed server side migration for ingest and storage of data Perform risk reduction for GFE n Perform risk reduction for Hydro n 12/29/2021 Page 4
AWIPS-II Central Architectural Concept ESB SOA Plug In Adaptable T 08 SOA Data Type Plug Ins AWIPS-II Services Staging Ingest Purging Index VTEC Archive Notify Adapter Utility Auto. Bld Product Proxy Architecture Future Airep Binlightening Bufrua Gfe Grib Obs Pirep Radar Recco Satellite Sfcobs Shef Taf Text Eclipse RCP Visualization Plug Ins 14 Core 8 User Interface 22 Library 14 Application CAVE Thick /Light Client Mode Enterprise Service Bus 12/29/2021 Page 5
Mule ESB + SPRING Container Services decoupled from transport mechanisms MULE ESB Mule End Point Provider Data Message Receiver Inbound Router Architecture SEDA Load Balanced Queue Connector Transformers Mule Interceptor Pattern Logger Mule End Point Provider Transformers Connector Data • JMS • Files • HTTP • FTP • E-Mail • *** Outbound Router Profiler Message Receiver Security Check EDEXSOA Service EDEX SOA services are Dependency Injected Components • Configured in the XML Mule files 12/29/2021 Page 6
Plug Ins Pattern Refinements Dynamically Extends to New Data & Transforms Plug In (i. e)plugin-airep ESB Endpoint Config Architecture Auto Generated HDF 5 schema for Blob data Metadata DB HDF 5 Lighting Radar Satellite Grid GFE Auto Generates Schema Creates Data URI Specific Data Type Decoding Custom Data Transforms if necessary Custom Data Access Plug In Registry Table 12/29/2021 Page 7
Data Repository Maintenance Refinement Based on a circular cycle of tables & HDF 5 files 1 hr Wake Up Table holds retention period /2 of data (I. e. 12 hr of data for 24 hr of retention time) Architecture Purge. Srv Db. Manager HDF 5 directory tree Plugin Metadata delet e 30 1 Metadata_2 Metadata_3 new day & hour 2 Delete Referenced HDF 5 files Metadata_4 Purge creates new table and deletes oldest 12/29/2021 Page 8
Clustered Data Ingest Flow Refinement: Pass References and Meta. Data between Services. . /sbn/…. . /processing Staging. Srv singleton read & delete data record EDEX file reference clustered queue jms: //cp/… Ingest. Srv f(plugin) HDF 5 vm: //… metadata persist Index. Srv f(plugin) List records i. e. Meta. Data RDBMS Architecture Airep Binlightening Bufrua Gfe Grib Obs Pirep Radar Recco Satellite Sfcobs Shef Taf Text vm: //… Alert Topic Subscriptions Notify. Srv threaded 12/29/2021 Page 9
CAVE Data Notification + Subscription Data Matched to Menus by Optimized Decision Tree Architecture Data Item CAVE Decision. Tree CAVE Startup Quinlan ID 3 Algorithm Alert. Job. Starter EDEX Ingest. Srv Build Data URI Menu data. URIs URICatalog Index. Srv Message Received Alert. Manager. Job Data URI List quartz Timer ingested data. URIs Data URI Aggregator EDEX Auto. Bld. Srv Script Ids Notify. Srv topic: edex. alerts post. Gre. SQL topic: edex. subscription Table: Subscription Table: scripts Check scripts for URIs 12/29/2021 Page 10
Workstation CAVE Architecture Overview Built from Eclipse RCP Plugins + Extensible CAVE-Summary Eclipse 3. 3 XML User Customizable Menus & Tool bar GIS Display defined by map projection and set of layers (history recallable, procedures) High Performance Image Rendering by GPU Shader Language Controls of (Projection, Color, …) Large raster data set rendering through Quad Tree Tilling and HDF 5 chunking Active Raster and Vector Data Interrogation Dynamic map re-projection using Geo. Tools Transforms& GPU Solid Shape Warping Auto updating Animations of all data types in all panes Enterprise Service Bus Data Connections ESB Connection for thin/thick client access to data 12/29/2021 Page 11
CAVE leverages Eclipse Perspectives Enables Multiple User Interfaces Weather Workstation Hydrology Workstation CAVE-Summary Graphical Forecast Editing • Perspectives leverages entire set of CAVE eclipse plug ins • Each perspective can have unique menus, toolbars, and dialogs • User can actively switch back and forth between perspectives 12/29/2021 Page 12
Map Reprojection: Texture Warping GPU Fragment Shader 50 times Faster than CPU • Map Reprojection at Interaction Speeds • Interactive Color Map Eclipse RCP Visualization Mapping Vertex Array HDF 5 Repository HDF 5 Library IMAGING_GLSL_PROGRAM CAVE-Summary Chunked Float Array Color Map 1 D Texture Open. GL API JOGL RGB Color Map XML RGBA quads Control • Raw data sampling enabled by the use of raw data CPU-GPU Boundary GPU Commands & Data Streams Graphical Processing Unit (GPU) IMAGING_GLSL_PROGRAM 12/29/2021 Page 13
Workstation Menus / Toolbars / Rendering XML Configurable Menus + XML Bundles Workstation . ui. personalitles. awips plugin. xml. site. (from localization) plugin. xml XML Display Resource Bundles Commands plugin. xml Commands Parameters Menu labels ~19 Map set. Scale ~11 Plots Radar. Display. Controls menu. Retrieval product. URI product. Name variable. List 1 Skew-T ~30 Display Resources 8 Radar 11 Models 12/29/2021 Page 14
Workstation Configuration XML used for most all configuration Workstation CAVE configuration files under cave/etc bundles colormaps 121 RGBA list unlimited plotmodels 17 svg, 12 spi volumebrowser XML Menus warngen Templates + config radar. Info contour. Style. Rules imagery. Style. Rules graph. Style. Rules 12/29/2021 Page 15
Workstation Modes Implemented Using Eclipse Preferences Workstation VTEC Product class code Test phrases in Body of Warning 12/29/2021 Page 16
Workstation (CAVE) Localization Pattern Uses Utility. Srv with a HTTP interface ESB Sync Protocal Log In User Name Determines User Context Site Through Perferences Workstation <<SOA Service>> Utility. Srv CAVE Config At CAVE Start Up CAVE Menus Localization Hierarchy Base Local Persistence Of Current Active Localization Color Maps Site User 12/29/2021 Page 17
Workstation History and Procedures D 2 D Style Con-Ops (except Alter Bundle) Workstation Bundle Components Map Scale Definition Zoom Level Center Point Coord. Map Projection <XML> Bundle Grid Range Load Mode Layer Definitions Metadata Fields / File Name Menus Also Use Bundles • Easy Customization of Menus • Bundles are reuseable through the passing in of arguments Color Map Need to add XY Components Display Controls 12/29/2021 Page 18
GIS Map Display Defined by XML Bundle Enables reuse in D 2 D style Menus Workstation Map Scale Definition Zoom Level Center Point Coord. Map Projection <XML> Bundle Grid Range Load Mode Layer Definitions Display Bundle is automatically built as data is selected Metadata Fields / File Name Time matching control Color Map Display Controls Map Bundles Available Under Maps Menu Pull Down 12/29/2021 Page 19
Workstation Volume Browser Retrieves Views of Data From Grid Repository Workstation Time. Matcher Plan. View. Display Request. Job Loader {…}Resource HDF 5 Grid Repository Time. Matcher Loader Var. Height. Display Skew. TDisplay Time. Height. Display {…}Resource Point | Line Direct Port of D 2 D Time Matching Cross. Section…Display Slice Data Cube 12/29/2021 Page 20
Workstation Volume Browser Menus KOAX menu & Basic included in installation XML Menu Config cave/etc/volumebrowser KOAX Localization ADE 1. 0 Volume Browser Under CAVE menu Workstation Basic User Manual Rename Files To Create Basic Version Browser. Plan. View. Planes -> Browser. Time. Planes Browser. Space. Field. Menu -> Browser. Space. Fields, Browser. Cross. Section. Time. Fields, Browser. Height. Fields Browser. Time. Field. Menu -> Browser. Time. Fields Browser. Source. Conus -> Browser. All. Sources 12/29/2021 Page 21
Workstation Plot Model and Maintenance D 2 D Plot Vector Library Converted to SVG (XML) Metars Workstation Obs Meta. Data & Parsed data fields {…} Plug In Job Buoys Plot. Resource Plot. Model Generator Progressive Disclosure SVGPlot SVG Plot Models UA plot 925 MB Entire D 2 D present Wx symbol set converted to SVG 12/29/2021 Page 22
Workstation Color Map Editor Replicates D 2 D with transparency control Workstation Color Maps Stored on Server Eclipse RCP Plug In. viz. ui Also, set background color dialog Save. Color. Map. Dialog Utility. Srv . . /cave/etc/colormaps/. . Local Storage Initialized During Localization Color Map XML Format (unlimited number of colors) <color. Map>. . /data/utility/cave_static/base/colormaps <r>. . </r>. /site/colormaps/koax <g>. . </g>. /user/colormaps <b>. . </b> <a>. . </a> </color. Map> 12/29/2021 Page 23
Workstation Text WS and Editor Implemented as 2 RCP plug ins in CAVE Workstation . texteditor. textworkstation Text. DB Workstation Interacts with Text. DB EDEX text Plug In Hibernate Access Objects {tablename}Dao . . /opt/data/sbn/test Text Ingest Endpoint 12/29/2021 Page 24
Workstation Warning Generation Workstation T 09+ Delivered T 08 Delivered Warn. Gen GUI Life Cycle Rules Dissemination VTEC Database tornado. vm severethunderstorm. vm Templates 3. . 19 GIS Capabilities Warning by Poly. Gon Text. DB UPDATE LIST Severe Weather Statement Store Set VTEC Generate Text Send to Text. WS Restart Text Workstation Editor 12/29/2021 Page 25
Workstation Radar Display T 08 Delivered Workstation T 09+ Delivered Radar Plug In Radar HDF 5 Storage Render Radial Graphic Decode Render Raster Radial Decode Render Graphic Text Decode Raster Decode Store Radar Radial Products Store Radar Raster Products Store Radar Graphic Products Text. DB Post Radar Text Products 12/29/2021 Page 26
Workstation Skew-T Displays both UA and Model data Workstation CAVE RCP Plug In. viz. skew. T Meteo Library Skew. TDisplay Skew. TResource UAObs. Adapter Grib. Adapter Datacube EDEX Dependency on Fortran function with problem in JAVA interface Meta DATA bufrua Plug In Grib Plug In HDF 5 12/29/2021 Page 27
SOA Services Utility, Maps, Radar Message Handler SRTM Plus from UCSD • SRTM 30 products from USGS EROS • Ocean data from LDEO project • 30 sec resolution (~1 km). /CAVE/topo Topo. Query +get. Height() +get. Topo. Point() +get. Topo. Line() +get. Topo. Area() SOA Stored in decimated blobs to support Quad Titling. /CAVE/basemaps Map Overlays Imported: • BCD Files • Geo. TIFFs • LPI Files • Shapefiles • SPI Files METARs Used to support disclosure in Plot models. 12/29/2021 Page 28
T 08 Radar Implementation Reuse of AWIPS I SOA NEW AWIPS II SBN NCF Level 2 Filtered Level 3 Products DXn Server ORPG Level 3 Products ORPGComms. Mgr . . /radar/* ESB Container (EDEX) RDBMS Meta. Data Radar Plug In HDF 5 12/29/2021 Page 29
SOA Data Type Plug Ins Bin lighting (plugin-binlightning) satellite. h 5 n GINI Satellite (plugin-satellite) n Grib 1 and 2 (plugin-grib) n BUFR with RAOB (plugin-bufrua) n Aircraft (plugin-airep, plugin-pirep, plugin-recco) n Synoptic (plugin-sfcobs) n binlighting. h 5 grib. h 5 – Buoy, Metar, CMAN, Land, MAROB, Mobile, SHIPS Radar (plugin-radar) n TAF (plugin-taf) n METAR (part of Synoptic) n Text (plugin-text) n radar. h 5 – Collectives and Std. Text 12/29/2021 Page 30
Library Capabilities Library VTEC management n Meteo Library n Text Generation (XML) n – Switched from ANTLR parsing of existing templates to creating new Velocity based templates – Output text remains the same n Generalized Time 12/29/2021 Page 31
VTEC Management as a Service Initial User is Warn. Gen Text Generation New SOA Service Vtec. Srv Hibernate Access Objects {tablename}Dao VTEC Database http Vtec API Warngen. Action +update. Vtec +run. Template Vtec. Factory Library Warn. Gen GUI Vtec. Event. Retrieval. js Vtec. Event. Update. js Vtec. Object. Retrieval. js Vtec. Retreival. js Warning Templates tornado. vm, cfg Severethunderstorm. vm, cfg Text Work. Station Text Data Base 12/29/2021 Page 32
D 2 D Meteo Library T 08 Component Users Contour. Support fortconfbuf() hgt 2 pres() Topography. Graph Skewt. Display calcrh() Mixrat() uvcomp() Controller +add_array() ******* +ztopsa() Glue. Gen Java JNI Interface Code libmeteo. Lib. so 127 FORTRAN Modules 17 C Modules 12/29/2021 Page 33
Data Management n Data access refinement (4 D data cube) – SPRING Data Base Connection Pooling (T 06 ran with 1 connection) – Dao. Pool Data access object pooling for improved performance n Data repository refinement – Added automatic index creation on sub tables Hydro IHFS repository + Object to Relational Mapping (Hibernate) n Text Data Base + Object to Relational Mapping n Data Access Objects Dao Classes Direct Port of AWIPS-I Text. DB 12/29/2021 Page 34
Data Access Improved Performance By managing data access objects Singleton Developed mid T 08 to improve ingest performance where queries need to be performed before inserts Dao. Pool Dao Classes Data Example Use Pirep Plug In Pirep. Decoder PIREP Meta. Data 12/29/2021 Page 35
Hydro IHFS OB 8. 1 Data base tables Middlegen used to auto Generate relational to object mapping files Data IHFS 180 Tables OB 8. 1 Hibernate Data Access Objects Dao Classes One for each table 12/29/2021 Page 36
T 08 Omaha Test Environment Development and Test Hardware Resources Testing Omaha Raytheon Server Room CP Processor Dell 2550 Raytheon Firewall awipscm Dell Server Unidata LDM-6. 6. 5 Auto Nightly 2 Week Stability Testing Fiber Line DVB-S awips-int 1 2950 Server awips-int 2 2950 Server LDM-6. 6. 5 filters EDEX Cluster EDEX Bld. XX awips-dev 1 2950 Server LDM-6. 6. 5 filters EDEX Nightly Orion Network awips-db 2950 Server postgre. Sql awips-nas 2950 Server Shared NFS 12/29/2021 Page 37
T 08 Integration Test Bed Metrics Testing Cluster Balance 12/29/2021 Page 38
T 08 AWIPS-II Cumulative Memory Profiles Small Leak Noted: Working with profiling tools Example Daily Profile Testing JMX cpu Useage 0. 41% Day Average 12/29/2021 Page 39
- Timertamp
- Technology refresh definition
- Clases de espacios aereos
- Timing diagram
- Cpm cpc ctr
- Vertical
- Miernik rychlosti
- Sys ctr endpoint protection
- Jdr ctr impact factor
- Present continous as future
- Present continuous past continuous future continuous
- Awips download
- Advanced weather interactive processing system
- What is awips
- Awips weather
- Nawips
- Unidata awips cave
- Section 508 update
- Conceptual framework for interactive graphics
- Knowledge refresh
- Dram refresh failure
- Dynamic ram refresh rate
- Dynamic ram refresh rate
- Microsoft campus 3
- Dvst stands for
- Peps refresh
- Refresh and gladden my spirit
- Baza danych prezentacja
- Swipe refresh layout
- Peel past simple
- Past progresive
- Past simple vs past continuous ejemplos
- Past continuous tense
- Past simple past continuous or past perfect
- Future continuous i future perfect
- Continuous monitoring vs continuous auditing
- Continuous auditing continuous monitoring
- Past perfect simple and past perfect continuous
- Future perfect continuous and simple
- Present perfect continuous auxiliary verb