2 G Instrumentation Pipelines Sandra Castro Pipeline Products

2 G Instrumentation Pipelines Sandra Castro

Pipeline Products 1. Product FITS header 2. QC parameters (PAF file) 3. Naming products 4. Saving products 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 2

Pipeline Products 1 All product files created by the pipeline must be in FITS format 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 3

Product FITS header creating a DRS keys QCs product header empty or raw header setup header product header 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 4

Setup Header cpl_error_code cpl_dfs_setup_product_header( cpl_propertylist * const cpl_frameset * const cpl_parameterlist * const char * ) header, proframe, set, pars, recid pipeid dicid recid ocam_mbias pipeid PACKAGE/PACKAGE_VERSION dicid PRO-1. 15 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 5

Setup Header Copy to header: ORIGIN, TELESCOPE, INSTRUME, OBJECT, RA, DEC, EPOCH, EQUINOX, RADECSYS, DATE-OBS, MJD-OBS, UTC, LST, PI-COI, OBSERVER. Copy all the HIERARCH. ESO. _ keywords, with the exception of the HIERARCH. ESO. DPR. _, and of the. PRO. _ and. DRS. _ keywords. If found, remove the HIERARCH. ESO. DPR. _ keywords from header. If found, remove the ARCFILE and ORIGFILE keywords from header. Add to header the PRO keywords: PIPEFILE, PRO. DID, PRO. REC 1. DRS. ID, PRO. REC 1. PIPE. ID, PRO. DATANCOM, PRO. CATG, and PRO. TYPE. http: //archive. eso. org/Tools/Did. Rep. Web. Query ESO-VLT-DIC. PRO 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 6

Multi-HDU Headers PRO CATG Common keywords to all extensions INSTRUME PIPEFILE HIERARCH ESO PRO CATG Keywords for extension 1 EXTNAME = ‘DET 1. CHIP 1’ All other HIERARCH ESO PRO HIERARCH ESO QC Keywords for extension 2 EXTNAME = ‘DET 1. CHIP 2’ All other HIERARCH ESO PRO HIERARCH ESO QC 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 7

Multi-HDU Headers /* Plist is my primary header */ cpl_dfs_setup_product_header(Plist, proframe, set, pars, recid, pipeid, dicid); /* Remove undesired keywords */ cpl_propertylist_erase_regex(Plist, “ESO PRO”, 0); /* Xlist is my extension header */ cpl_dfs_setup_product_header(Xlist, proframe, set, pars, recid, pipeid, dicid); /* Remove undesired keywords */ const char delkeys[] = “^(ORIGIN|TELESCOPE|INSTRUME|OBJECT|RA|DEC|EPOCH| PIPEFILE|EQUINOX|RADECSYS|DATE-OBS|MJD-OBS|UTC|LST|PICOI|OBSERVER)$”; cpl_propertylist_erase_regex (Xlist, delkeys, 0); /* Add PRO. CATG to primary header */ cpl_propertylist_copy_property (Plist, Xlist, “ESO PRO CATG”); /* Save product */ cpl_image_save(NULL, name, bitpix, Plist, CPL_IO_DEFAULT); cpl_image_save(image, name, bitpix, Xlist, CPL_IO_EXTEND); 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 8

Pipeline Products 2 All QC parameters must be also saved on disk on a log file. One file per FITS extension PAF 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 9

QC parameters – PAF file PAF. HDR. START PAF. TYPE PAF. ID PAF. NAME PAF. DESC PAF. CHCK. CHECKSUM PAF. HDR. END ; #start of header “pipeline product” “ocam_mbias” “ocam_masterbias. paf” “QC file” “” ; #end of header ARCFILE EXTNAME DATE-OBS TPL. ID MJD-OBS QC. MBIAS. MEAN QC. MBIAS. STDEV “OCAM_IMG_BIAS 076_0003. fits” “DET 1. CHIP 1”; #extension name “ 2005 -03 -17 T 12: 16: 44: 632”; #Date “OCAM_img_cal_bias”; # Template id “ 53446. 5”; # Obs start 120. 2234 15. 23445 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 10

Pipeline Products 3 All output FITS files must be named in a unique and predictable way by the recipe 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 11

Naming Products OCAM_IMG_OBS 076_0001. fits OCAM_IMG_OBS 076_0002. fits OCAM_IMG_OBS 076_0003. fits ocam_reduce_sci ocam_JITTERED_IMAGE_1. fits ocam_JITTERED_IMAGE_2. fits ocam_JITTERED_IMAGE_3. fits ocam_COADD. fits • no matter what input files • no matter what input parameters TEXT predictable 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 12

Pipeline Products 4 All product files must be saved on the working directory 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 13

Good news! CPL function to save PAF files CPL function to save products Planned for CPL-4. 0 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 14

Pipeline Products 1. Products must be FITS files 2. QCs are written on headers and PAF files 3. Names must be unique and predictable 4. Products are saved on the working directory 19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 15

19 April 2007 Sandra Castro 2 G Instrumentation Pipelines 16