The Joint Agency Commercial Imagery Evaluation Team and Product Characterization Approach

The Joint Agency Commercial Imagery Evaluation (JACIE) team is a collaborative interagency group focused on the characterization of commercial remote sensing data products. The team members - the National Aeronautics and Space Administration (NASA), the National Imagery and Mapping Agency (NIMA), and the U.S. Geological Survey (USGS) - each have a vested interest in the purchase and use of commercial imagery to support government research and operational applications. For both research and applications, commercial products must be well characterized for precision, accuracy, and repeatability. Since commercial systems are built and operated with no government insight or oversight, the JACIE team provides an independent product characterization of delivered image and image-derived end products. End product characterization differs from the systems calibration approach that is typically used with government systems, where detailed system design information is available. The product characterization approach addresses three primary areas of product performance: geopositional accuracy, image quality, and radiometric accuracy. The JACIE team utilizes well-characterized test sites to support characterization activities. To characterize geopositional accuracy, the team utilizes sites containing several "photo-identifiable" targets and compares their precisely known locations with those defined by the commercial image product. In the area of image quality, spatial response is characterized using edge targets and pulse targets to measure edge response and to estimate image modulation transfer function. Additionally, imagery is also characterized using the National Imagery Interpretability Rating Scale, a means of quantifying the ability to identify certain targets (e.g., rail-cars, airplanes) within an image product. Radiometric accuracy is characterized using reflectance-based vicarious calibration methods at several uniform sites. Each JACIE agency performs an aspect of product characterization based on its area of expertise, thus minimizing duplication of effort. The JACIE team collaborated to perform comprehensive characterization of products from Space Imaging Inc.'s IKONOS satellite and from DigitalGlobe's QuickBird satellite and is currently characterizing products from OrbImage s OrbView-3. JACIE assessments have resulted in several improvements to commercial image product quality and have enhanced working relationships between government and industry. Assessment results are presented at an annual JACIE High Spatial Resolution Commercial Imagery Workshop.