HEASARC Supported Activities at SAO Roger Brissenden April
HEASARC Supported Activities at SAO Roger Brissenden April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 1
Outline 1. SAO/HEASARC Coordination 2. Feb 04 HUG Issues 3. Chandra Mission Status 4. HEASARC Activities at SAO 5. Chandra Data Archive (CDA) 6. Cal. DB 7. SAOImage ds 9 April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 2
1. SAO/HEASARC Coordination • • HEASARC established partnership with SAO in 1999 in order to strengthen the ties between the two groups, access expertise of both groups, maximize common approaches, and allow integration of the Chandra archive Steve Murray assumed HEASARC Associate Director role Funding for ~1. 25 FTE provided to support closer ties in the areas of archive standards, Cal. DB and software development (e. g. , DS 9) Partnership has been effective with coordinated extensions to archive standards, Cal. DB and providing direct support for DS 9 development Steve Murray stepped down as HEASARC AD Feb 2004 to concentrate on new responsibilities and Roger Brissenden assumed PI role Roger’s role as HEAD AD and CXC Manager provides an opportunity for even closer ties with the CXC, and maximizes resource leverage Effort during the present 4 years focused on full Chandra archive integration, extending Cal. DB, support for DS 9 and VO, with an opportunity to locate the Chandra archive at SAO for the long term April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 3
Staff at SAO Who Roger Brissenden Arnold Rots Dale Graessle Bill Joye SAO Role CXC Manager Chandra Archive Scientist Chandra Cal. DB Scientist SAOImage ds 9 Developer April 12 - 13, 2006 HEASARC Users Group HEASARC Role Associate Director Archive Integration Cal. DB Interface SAOImage ds 9 Roger Brissenden FTE % <5 25 25 75 4
2. Feb ‘ 04 HUG Issues (a) Long term plan for the Chandra Archive • Plan to establish the Chandra permanent archive at SAO as part of the HEASARC included in proposal to Senior Review • Approach ensures data remain co-located with expertise (b) Chandra Data Archive Plans • CXC data archive formats are HEASARC/OGIP FITS compatible • CXC uses the Cal. DB format and is working actively to extend standard April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 5
3. Chandra Mission Status • 7 years of Operation on 23 July 2006 • Cycle 7 observations on track, observing efficiency close to optimal • Spacecraft and Science Instruments continue to operate well; no significant anomalies • NASA funding baseline for 10 year mission; planning for 15+ • Consumables not a factor in extending lifetime April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 6
4. HEASARC Activities at SAO Goals Presented to Senior Review 1. Full Chandra Data Archive (CDA) integration with the HEASARC to provide complete access to Chandra archive metadata through the multimission search and retrieval software. Allows for Chandra Archive at SAO/HEASARC long term. 2. Upgrade to Cal. DB and Cal. DB tools to allow more effective support for current and future missions. 3. SAOImage ds 9 maintenance, ports and as resources allow, selected new functionality. April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 7
5. Chandra Data Archive (CDA) • Current volume: – 2. 85 TB in 10. 65 million files (currently growing faster during reprocessing run) – Essential data at second server at Cf. A • Active mirror sites (public primary and secondary data products only) – – LEDAS, UK (2000) ASDC, Rome, Italy (2004) HEASARC (2005) IUCAA, Pune, India (2005) April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 8
CDA: Holdings April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 9
CDA: Observations • Distributed over the course of the mission: – 4751 proprietary observations • Publicly available: – 4079 Scientific observations – 1399 Calibration observations April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 10
CDA: Downloads April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 11
CDA: Downloads April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 12
CDA: HEASARC Integration • 2003: The CDA integrated in HEASARC Browse – i. e. , Chandra looks like other missions at the HEASARC website • 2005: The CDA mirror at HEASARC fully integrated in HEASARC Browse – i. e. , Chandra data access identical to other missions at the HEASARC website April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 13
CDA Plans: FITS Dictionary • Comprehensive dictionary of all keywords used in Chandra data products • User query interface from CDA web page • Status: awaiting completion of keyword descriptions (2006) April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 14
CDA Plans: Bibliography • Complete through 2005 – 6891 articles, of which 4038 refereed – 6299 data–literature references: • 1685 papers • 2978 distinct observations – Categories: • 2920 • 2949 • • • 417 206 329 Present specific observations Refer to published results (including multi-wavelength, follow-up analysis, theory to explain Chandra data) Instrumentation, software, operations Predict Chandra results Cannot be classified • User access: • Chaser • Dedicated CDA interface • ADS April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 15
CDA: Bibliography Package • Available as multi-mission tool (2006) • Contains: – Configurable database • Mission-specific flags and lists, database links • Associated literature keywords • Literature – dataset links – Maintenance interface • Automatic ADS mission-specific keyword search of abstract and body • GUI for processing candidate papers, including categorization, flag assignment, access to paper • Provided to XMM GOF April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 16
6. Cal. DB Chandra Metrics: • 13 Cal. DB upgrades • 126 new files added – 10 new codename types – ~158 old files retired • Current Cal. DB index includes 814 paired files and extensions. April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 17
Cal. DB: HEASARC Tasks • Adapting Cal. DB to mission-independent tool design: coord. with Mike Corcoran – Automate setting of Cal. DB file selection parameters (2006 -7) • Higher-level processing of archival data – Ensure calibration version consistency with the calibration history of input data (2007) • Cal. DB system for new missions and software architecture – Improve data structure extensibility (2008) April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 18
7. SAOImage ds 9 • Current version 4. 0 b 9 (released today) – Supported on 9 hardware platforms • Last Year – 3 Incremental beta releases – over 30, 000 downloads • In addition to HEASARC supported missions, collaborating with ground based: – DEIMOS, GEMINI, MMT April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 19
ds 9: New Features • Catalogs – Load / Save / Filter / Sort – Supports Vizie. R (CDS) catalog servers • Regions – Composite Regions – Templates – Instrument Field of View • New Optional GUI Configurations April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 20
ds 9: Current Development • New Infrastructure – Pure Tcl/Tk implementation • New Windows version • New Mac. OSX Aqua version • Internationalization April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 21
Catalog Support • Full support for loading, displaying, sorting, filtering, and saving catalogs • Example shows overlays of the HST and GSC catalogs April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 22
Catalog Tool • Interface for catalog downloads. Support includes sorting and filtering April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 23
Instrument Fields • SAOImage ds 9 now provides support for loading, displaying, and saving Instrument Field of Views • FOVs for Chandra, XMM, and SAO MMT are provided April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 24
Optional GUI Layout • Vertical layout, conserves screen space • Feature turn-on/off April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 25
ds 9: Future Development • • • 3 D Slicer 3 D Volume Render Bad Pixel Maps WCS Editor Image Statistics Suggestions welcome: http: //hea-www. harvard. edu/RD/ds 9 April 12 - 13, 2006 HEASARC Users Group Roger Brissenden 26
- Slides: 26