The metaverse enables collaborative training remotely, so the uniqueness of this use case is to bring learners and professionals together no matter where they are physically located.
Robot training pilot is a customized industrial multiuser metaverse environment for training the basic operations and programming of a robot in digital twin environment in metaverse.
Combining pedagogy models and virtual reality capabilities takes training sessions on metaverse environment beyond limitations of the physical locations. Managing behavior models and interactions with 3D assets tied with a track of avatar movements and spent time brings key means to simulate real-life like sessions through remote presence with avatar UI/UX and utilization of AI technologies. Support for a multilingual training environment with the speech-to-subtitles functionality is focused as well. This way by tying up e-learning course steps with actions and interactions made within metaverse space opens new competitive ways to improve realism and adaptation of virtual training sessions.
Pilot users can remotely access to jointly control a robot from both, Finpeda FVS environment via browser and Turku UAS metaverse environment by virtual reality (VR) headset. FVS learning environment feature cozy classrooms where learning takes place with help of video tutorials or online meetings with teacher by video connection. Digital twin of robot is in Turku Machine Technology Center. By opening the Polyscope robot simulator both users can remotely operate and program the digital twin robot, thus having a common learning experience and get the instant feedback. The user experience with the Polyscope software is 100% authentic, which in turn teaches users how to use it more accurately.
Metaverse-based training can be extended with more realistic visualization and use of senses, even haptic sensors, along with real-time monitoring of user interactions within 3D space. Moving even closer to realism with hybrid working models and operations with remote access through metaverse environments the communication with the real robot in the future is possible as well.