Autonomous robot using infrared thermal camera to discriminate objects in outdoor scene

A complete autonomous legged robot is beig designed at Carnegie Mellon University to perform planetary exploration without human supervision. This robot must traverse unknown and geographically diverse areas in order to collect samples of materials. This paper describes how thermal imaging can be used to identify materials in order to find good footfall positions and collection sites of material. First, a model developed for determining the temperature of materials in an outdoor scene is presented. By applying this model, it is shown that it is possible to determine a physical characteristic of the material: thermal inertia. Second, experimental results are described that consist in recording thermal images of an outdoor scene constituted with sand and rock. Third, results and limitations of applying the model to experimental images are analyzed. Finally, the paper analyzes how basic segmentation algorithms can be combined with the thermal inertia segmentation in order to improve the discrimination of different kinds of materials.