USGS Digital Aerial Mapping Camera Status l l

USGS Digital Aerial Mapping Camera Status l l l CRSS/ASPRS Specialty Conference October 2007 USGS Remote Sensing Technologies Project http: //calval. cr. usgs. gov/ Greg Stensaas, stensaas@usgs. gov George Lee, gylee@usgs. gov U. S. Department of the Interior U. S. Geological Survey

Outline l l Background USGS Quality Assurance Plan Description and status of components Related development activities 2

Background • Evolution: • • New digital sensors available to the industry Requirement for USGS Camera Calibration Certificate ASPRS study and recommendations Establishment of Digital Camera Calibration at EROS 3

Background • Evolution: • Formation of the JACIE and activities to verify and validate merging commercial satellite data • Establishment of Remote Sensing Technologies Project to oversee aerial and satellite V&V activities 4

Background • Formation of the Interagency Digital Imagery Working Group (IADIWG): • • • Initially NDOP Technical Subcommittee supplemented by other stakeholder agencies IADIWG proposes a Quality Plan which is beyond sensor calibration IADIWG hosts a user workshop and reacts to initial MAPPS concerns 5

Background • Ways to perform evaluation of sensors, systems and data products: • • • Sensor calibration in lab environment Error analysis of components of system In-situ system performance of system Product characterization over test site ISO-like certification: Process evaluation Define best practices and standardize across community 6

USGS Quality Assurance Plan • USGS (IADIWG) Quality Assurance Plan: • • Manufacturer Certification Data Provider Certification Contracting Guidelines Quality Assessment Guidelines 7

USGS Quality Assurance Plan • Underlying implementation strategy: • • Define general approach for each component Initial trials with “Partners” Review and refine process Standard operating procedure 8

Manufacturers Certification • Type certification vs. individual calibration • Basic requirement to understand: • Prototype testing and results • Standard production testing • Calibration process • Manufacturing process control • Maintenance procedures, factory vs. on-site • User documentation and recommendations to data providers • Simplified re-certification process • Need to extend concept beyond United States 9

Manufacturers Certification Status • Four Manufacturer Certifications completed • Applanix DSS, Microsoft Ultra. Cam D, Intergraph DMC, and Leica ADS-40 • Several requests for upgrade certification • Applanix and Microsoft • Certification interest by others • Di. MAC, Jenoptik, Airborne Data Systems, John Deere, Wehrli, and Pictometry • Review process and finalize guidelines • Four additional manufacturers in FY 08 10

Data Provider Certification • Basically a review of process control and documentation of procedures • Ensures manufacturers recommendations are followed • If not, why not • Vendor’s standard operating procedures • Exercises “best practices” throughout operations 11

Data Provider Certification Status • Data Provider Certification Team formed: • • Scope and level of detail for certification of process evaluation Define evaluation criteria and grading scheme Five “Partners” identified to test process Acceptance by major contracting offices Avoid limiting competition Cost of certification to be determined Ability to quickly certify all interested parties 12

Protection of Intellectual Property l l For both Manufacturers and Data Providers Signing of Non-disclosure Agreements Documents must be appropriately marked as IP Public version of certification report after review by Manufacturers and Data Providers 13

Contracting Guidelines • “Products, Specs, and Contracting 101” • Tough for new users • Can be tough for Data Providers in beginning • Standardize language and terminology for specifying products • Adequate QA/QC methods are specified • Guidelines for selection of qualified vendors (e. g. , experience, past performance, and best practices) • Best practices to ensure clear understanding of contract requirements (e. g. , Pre-meeting and sample product delivery) 14

Contracting Guidelines Status • Initial draft compiled and reviewed • Web tools are being developed & refined • Training workshops at ASPRS and other forums 15

Quality Assessment Guidelines • Is beauty in the eyes of the beholder? • Yes, but it must be in specifications • Needs to be clear understanding of acceptance and rejection criteria • QA/QC must to be objective and uniform • Statistically valid if sampling is used • Formal documentation and record keeping • Industry standards for automated quality control 16

Quality Assessment Guidelines Status • Quality Assessment Team formed: • Exchange of information on existing processes within federal government • Identification and review of state procedures • Draft quality assessment document • Both general and product specific levels of detail 17

USGS Quality Assurance Plan • Other activities: • • • Establish network of in-situ ranges Research on medium format cameras in lab Research on sensor stability Workshops at ASPRS and other forums Discussion with international organizations 18

Questions? l Gregory L. Stensaas Remote Sensing Systems Characterization Manager 605 -594 -2569 stensaas@usgs. gov l George Lee National Digital Orthophoto Program Manager 650 -329 -4255 gylee@usgs. gov l USGS and Inter-Agency Digital Imagery Working Group (IADIWG) information available at: http: //calval. cr. usgs. gov/ 19