Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments

Kevin van Hecke, Guido de Croon, Daniel Hennes, Timothy P. Setterfield, Alvar Saenz-Otero, Dario Izzo

Research output: Chapter in Book/Conference proceedings/Edited volumeConference contributionScientificpeer-review

Abstract

Although machine learning holds an enormous promise for autonomous space robots, it is currently not employed because of the inherent uncertain outcome of learning processes. In this article, we investigate a learning mechanism, Self-Supervised Learning (SSL), which is very reliable and hence an important candidate for real-world deployment even on safety-critical systems such as space robots. We introduce a novel SSL setup that allows a stereo vision equipped robot to cope with the failure of one of its cameras. We present preliminary results from an experiment on the International Space Station (ISS) performed with the MIT/NASA SPHERES VERTIGO satellite. The presented experiments were performed on October 8th 2015 on board the ISS. The main goals were (1) data gathering, and (2) navigation on the basis of stereo vision. First the astronaut Kimiya Yui moved the satellite around the Japanese Experiment Module to gather stereo vision data for learning. Subsequently, the satellite freely explored the space in the module based on its (trusted) stereo vision system and a pre-programmed exploration behavior, while simultaneously performing the self-supervised learning on board. The two main goals were successfully achieved, representing the first online learning robotic experiments in space. These results lay the groundwork for a follow-up experiment in which the satellite will use the learned single-camera distance estimation for autonomous exploration in the ISS, and are an advancement towards future space robots that continuously improve their navigation capabilities over time, even in harsh and completely unknown space environments.
Original languageEnglish
Title of host publicationProceedings of the 67th International Astronautical Congress (IAC), Guadalajara, Mexico, 26-30 September 2016
PublisherIAF
Number of pages7
Publication statusPublished - 2016
Event67th International Astronautical Congress - Guadalajara, Mexico
Duration: 26 Sep 201630 Sep 2016
Conference number: 37
https://www.iac2016.org/

Conference

Conference67th International Astronautical Congress
Abbreviated title67th IAC
CountryMexico
CityGuadalajara
Period26/09/1630/09/16
Internet address

Fingerprint Dive into the research topics of 'Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments'. Together they form a unique fingerprint.

  • Cite this

    van Hecke, K., de Croon, G., Hennes, D., Setterfield, T. P., Saenz-Otero, A., & Izzo, D. (2016). Self-supervised learning as an enabling technology for future space exploration robots: ISS experiments. In Proceedings of the 67th International Astronautical Congress (IAC), Guadalajara, Mexico, 26-30 September 2016 [IAC-16-F1.2.3 ] IAF.