EOVSA Data and Database System Gordon Hurford and
EOVSA Data and Database System Gordon Hurford and Jim Mc. Tiernan EOVSA Prototype Readiness Review 24 -Sept-2012
EOVSA Prototype Software • Primary goal – Software support for evaluating hardware performance • Secondary goals – Support for occasional solar observing – Test bed for development of full-array software
1 1 Role of Digital Packaging Processor • To filter, average, partially calibrate and convert raw correlator output into a Miriad-compatible format that is written to Interim Data Base
23 -Oct-10 OVSA Expansion Software and Data Handling - Kickoff Meeting OVSA-specific Monitor and Control CASPER-based Operator Miriad-based RHESSI-based DSPU Antennas, receivers, analog subsystems NJIT GH/JM+ NJIT Data Packaging Processor Interim Data Base Data selection, averaging, reformatting & calibration Archive Databases ~6 GB/day Burst identification Light curve, spectra generation Map generation Hi-Level Analysis Map display IDL Shell Users Tohban Light curve, spectra display Quick look & metadata products Browser
Elements of Prototype Software • DPP software to generate Miriad format interim database • Scripts for conversion of interim database to application databases and useful data products • Scripts and modules for calibration analyses and data displays • Selection, acquisition and integration of data processing hardware platforms
EOVSA Prototype – DPP Software Tasks • Ingestion of correlator output • Access of relevant parameters from state frame • Suppression of RFI bands identified using predetermined subbands and spectral kurtosis – (Generation of and display tools for RFI database) • Application of predetermined complex gains – – Gains applied at science channel level Assumes subband level gains applied in correlator Does nominal correction for attenuator state Does fine delay corrections (based on Tn, T(n+1)…. • Transfer of RFI and calibration tables from ACC – method? • Output as Interim Database in Miriad format Status: Mostly done Still to be done
Scripts and modules • Conversion of selected scans to calibration and utility data bases • Analysis of calibration data base (Miriad scripts) – – – Phase and amplitude calibration Closure phase calculation and display Baseline calibration Delay center calibration Custom modules (NJIT) • Basic data displays – Spectra for individual baselines and/or antennas – Light curves – Dynamic spectra • ? ? Support for frequency-synthesis 1 -D mapping
Other items (or not) • • • Basic display of non-engineering parameters Display Miriad header parameters Basic index to data Basic database management No IDL shell (initially) for prototype analysis No direct display of stateframe parameters
DPP Hardware Platform • Unit with 4 quad core processors • • • 2 for input handling 1 for communications with ACC 1 for handling state frame N for packet processing at the subband level 1 for spectral processing at the science band level 1 formatting and output • Single unit located at OVRO ? ? – Assumes software development can be done with existing processors – No backup for unit failure – How to support remotely ? ? • Linux operating system – flavor? • Next step - Identify and order
- Slides: 9