Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation of Operator Interfaces

Juan Jesús Roldán, Elena Peña-Tapia, David Garzón-Ramos, Jorge de León, Mario Garzón, Jaime del Cerro, Antonio Barrientos

Research output: Chapter in Book/Conference proceedings/Edited volumeChapterScientificpeer-review

17 Citations (Scopus)

Abstract

This chapter describes a series of works developed in order to integrate ROS-based robots with Unity-based virtual reality interfaces. The main goal of this integration is to develop immersive monitoring and commanding interfaces, able to improve the operator’s situational awareness without increasing its workload. In order to achieve this, the available technologies and resources are analyzed and multiple ROS packages and Unity assets are applied, such as multimaster_fkie, rosbridge_suite, RosBridgeLib and SteamVR. Moreover, three applications are presented: an interface for monitoring a fleet of drones, another interface for commanding a robot manipulator and an integration of multiple ground and aerial robots. Finally, some experiences and lessons learned, useful for future developments, are reported.

Original languageEnglish
Title of host publicationStudies in Computational Intelligence
PublisherSpringer
Pages29-64
DOIs
Publication statusPublished - 2019
Externally publishedYes

Publication series

NameStudies in Computational Intelligence
Volume778
ISSN (Print)1860-949X

Keywords

  • Immersive teleoperation
  • Multi-robot systems
  • Operator interfaces
  • Virtual reality

Fingerprint Dive into the research topics of 'Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation of Operator Interfaces'. Together they form a unique fingerprint.

Cite this