InSight Mission

InSight Cameras Peer Review

Help

This page includes documentation, descriptions, and examples of the data and software included in this Peer Review, as well as the tools that can be used to view and access the data. If you require further assistance, please contact Cristina De Cesare.

What is PDS4?

PDS has adopted XML for PDS4. The Extensible Markup Language (XML) is an international standard that is widely used by many online data systems to document their data. It provides a standard syntax and structure for describing data for many different industries. A significant number of vendors and programming languages provide support for reading and writing XML files. XML integrates directly with web-based applications allowing for the metadata, described in XML, to be rendered in a number of different formats. See the following pages for more detailed information regarding the PDS4 standard:

What is PDS4? - Overview of PDS4.
PDS4 Concepts Document - Introduction to PDS4 key concepts - the view from 10,000 feet, avoiding gory details.
PDS4 Model Specification - Detailed descriptions of each attribute and class in the PDS4 standard.
PDS4 Standards Reference v1.10.1 - One of the two fundamental reference documents for PDS4. You will need this as you work your way through the Data Provider's Handbook and as you prepare an archive.
The Small Bodies Node Wiki contains a ton of useful information about XML standards, schemas, and PDS4 intricacies.
Other PDS4 Documentation - Other PDS4 documentation including Data Provider's Handbook, Data Dictionary, Information Model Specification, and Policies.

Validating the Data

The PDS4 Validate Tool is software developed by the PDS Engineering Node for validating PDS4 product labels and product data. The associated specific schema for the product label specifies syntactic and semantic constraints. The product label itself specifies the constraints for the data.

Download and Installation

Download Validate Tool (development version): (tar) (zip)

The downloaded package includes Installation and Operation instructions in the /doc directory.
Note: This development version is required because several bugs, which impact InSight data, were discovered after the latest release. The patched version has not yet been officially released.

Download InSight configuration - right click the link and click "Save Link As..."

InSight-specific Examples

Assumptions

Using Mac OSX or Cygwin on Windows
You have downloaded and unpackaged the InSight Cameras Bundle to $HOME/insight_cameras.
Validate Tool has been installed per the downloaded instructions. See doc directory in the Validate Tool downloaded software.
You have downloaded the Validate Tool Configuration File and placed it alongside the insight_cameras bundle under your $HOME directory ($HOME/validate_config.txt)

To validate a single product against the dictionaries in the bundle and output the report to validate-report.txt (update $HOME if path to bundle differs)

    # go to the location of the bundle
    cd $HOME
    
    # run validate with the config file
    validate insight_cameras/data/sol/0005/mipl/edr/idc/D006L0005_596974677EDR_F0101_0060M1.xml -c validate_config.txti
    
    # check the report
    cat validate_report.txt

To validate the entire sample bundle and output the report to validate-report.txt:

    # go to the location of the bundle
    cd $HOME
    
    # run validate with the config file
    validate insight_cameras -c validate_config.txt
    
    # check the report
    cat validate_report.txt

Inspecting the Products

PDS4 labels in this review's sample archive are in XML format. While it is possible to view these with any standard text editor, we recommend software to view XML. The simplest solution is to install a browser extension and follow the links below to open the labels in your browser. You may prefer to download the sample archive and then open the label files in a viewer/editior application, such as Eclipse. We provide links below to recommended XML tools.

XML Tools

XV Chrome Extension - view/search XML in the browser
Eclipse IDE - open source Integrated Development Environment, with extensions to act as XML editor and viewer

The Small Bodies Node Wiki contains a lot of documentation for setting up and using Eclipse.

oXygen XML Editor - XML editor and viewer (requires license)

The Small Bodies Node Wiki may be used for some of this setup and configuration.

InSight Cameras Bundle Organization

The following list describes the structure of the InSight Cameras bundle, with links to help you navigate between different parts of the bundle:

Bundle Label
- archive/insight_cameras/bundle.xml
Calibration Collection -- Contains files needed for calibration of camera data.
- archive/insight_cameras/calibration/
Context Collection -- Contains context products.
- archive/insight_cameras/context/
Data Collection -- Contains cameras data products. Products are grouped by sol, category, and instrument.
Document Collection -- Contains documentation files, including SIS documents and example PDS4 labels.
- archive/insight_cameras/document/
Miscellaneous Collection -- Contains Apache Velocity template & macro files used to produce the labels in the Data collection.
- archive/insight_cameras/miscellaneous/
Schema Collection -- Contains the PDS4 XML Schema used in the production of this bundle.
- archive/insight_cameras/xml_schema/

Viewing the Images

There are a few options for viewing the image products in PDS4:

Browse Images - these quick-look products are part of the bundle but only available for Raw Data products
Marsviewer - easy to view original images (EDRs) as well as all derived image products (RDRs)
PDS4 Viewer - can be used to view all viewable data products on the fly. Note: some data products (i.e. XYZ) are not viewable images
Transform Tool

Note: The ERP data products are Reference Pixel images and therefore not a visualizable product.

Browse Images

The browse images found in insight_cameras/data/sol/xxxx/mipl/browse were all generated using the MIPL Transcoder (InSight pipeline software), and are the full-resolution PNG images produced from the raw data products. The following are links to the directories containing those browse products:

Marsviewer

The Mars Image Viewer (Marsviewer) is an image viewing tool tailored to Mars in-situ missions. It makes it easy to view original images (EDRs) as well as all derived image products (RDRs), such as XYZ maps, slope, reachability, mosaics, etc. Originally designed as a quality control tool for the MER image processing team, it sees wide use throughout the MER, MSL, and PHX ops and science teams.

Download

Installation

Installation instructions can be found here.
Also be sure to take a look at the FAQs for some potential issues during installation or while trying to start the application.

NOTE: Use the Downloads linked above instead of the versions on the Imaging Node website. This version has been augmented specifically for InSight.

Usage

Download the bundle to your local disk.
After you have opened the application, you will be prompted to select a File Finder.
For the File Finder Type dropdowns, select NSYT and NSYT_UBER_SPEX.
For the File Finder Root, we will select the sol directory from the bundle on your local disk, e.g. /path/to/insight_cameras/data/sol
Click the Select button.
Then along the left panel, select Sol 5.
Click the Refresh List button.
You should then see a list of EDRs you can click and see the accompanying RDRs.

For more information on how to use Marsviewer you can see the Using Marsviewer help. That information is MSL-centric but aplies similarly to InSight.

PDS4 Viewer

The PDS4 Viewer is a visualization tool for PDS4 data. PDS4 Viewer is a tool that allows uers to open a PDS4 label (XML) and view metadata in a human-readable format, and also view the image file described by the label. Here's an example of how to use the PDS4 viewer:

Download & install the PDS4 Viewer as discussed on the SBN Wiki.
Launch PDS4 viewer.
Click File >> Open
Select a PDS4 XML label.
View label information
Click the "Image" button to view the image.

Transform Tool

Developed by the PDS Engineering Node, the Transform Tool is the PDS-wide command-line tool used for transforming PDS3 and PDS4 product labels and product data into other formats. The following is an example of transforming an ICC 2D (or grayscale) image into a JPEG.

% transform insight_cameras/data/sol/0004/mipl/browse/icc/C000M0004_596879869EDR_F0000_0134M1.PNG.xml -f jpg

Last updated Monday October 26, 2015 10:09 AM