MANIPULAY XR: Gamified robotics training in VR
Duration:
11/2024
—
08/2025
Total Time:
Months
Photo: JOANNEUM RESEARCH and POLYCULAR
The Project
MANIPULAY XR provides a modular system for teaching the basics of kinematics, robots and their programming in a virtual environment. Extended reality and playful elements make access to robotics much easier. The aim is to actively counteract the shortage of skilled staff in automation. The interactive concept supports a deep understanding of complex interrelationships such as robot kinematics and at the same time strengthens the safe cooperation between man and machine.
Our activities within the project
We develop components that allow users to build kinematically accurate robot models in virtual reality – from simple, easy-to-understand setups to industry-grade systems – using modular elements. These robots can be controlled through an intuitive programming interface. In close collaboration with our partner Polycular GmbH, we combine our expertise to create well-structured, educationally sound learning paths.
Research groups
Downloads
Sponsors
Master
Project Partners
JOANNEUM RESEARCH ROBOTICS
Polycular GmbH,
Project Details
MANIPULAY XR is a toolkit for innovative educational games that combines virtual reality (VR) and gamification to revolutionize the learning process in robotics. Users can assemble robots from different components in an immersive VR environment and program their movements to solve puzzles in a playful way. The intuitive, block-based programming interface makes it easier to understand complex concepts such as the construction of manipulators and kinematics. Through this interactive approach, MANIPULAY XR not only promotes technical understanding, but also safe collaboration between humans and robots. The project aims to train a new generation of skilled workers for the automated industry.
The benefits for the creation of learning content are of course not limited to the duration of the project. In addition to further use by the project partners themselves, the funding EU project MASTER stipulates that the developments from MANIPULAY XR are to be used in other open call projects by teaching institutions. The MASTER XR framework is used for this purpose, which serves to share XR experiences and supports a variety of different XR platforms. This also includes an authoring tool into which the elements from MANIPULAY XR are integrated.
The pillars of MANIPULAY XR are the assembly and programming of robots, both of which we realise in VR through the simple steps of placing objects. Robot parts are placed on top of each other and programme commands are inserted into programme tracks to solve the respective level by touching all waypoints and avoiding all obstacles. All the necessary elements can be customised, arranged and expanded as required when creating tasks in the editor. And thanks to the MASTER-XR platform, the learning experiences can also be completed in teams, even if they are spread across the globe.
Co-funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union. Neither the European Union nor the granting authority can be held responsible for them.
Sponsor
Project Participants
Mara
Zammernig
BSc MSc
