Necoverse.fi published – the remote operations use cases are progressing – see pictures

A new Necoverse.fi website has been published in the Necoverse project, which presents the progress of the two-year project. The goal of the research project is to develop innovative solutions for remote inspections, technology-assisted inspections and remote cooperation between inspectors and customers. The Necoverse project, which had a late start has now taken significant strides forward, thanks to the efforts of our experts and research partners.

Leading research organizations Aalto University, VTT and Turku University of Applied Sciences and several other companies are involved in the project. The fruits of the cooperation will be seen in the future as many new piloted technologies and methods that aim to improve the efficiency and safety of inspections.

In the crane pilot, technology shows its power

One of the project’s most significant pilot projects is the crane inspection pilot, which aims to inspect an overhead crane remotely. This remotely controlled crane will be equipped with cameras, sensors and an inspection robot. It will also include software that uses artificial intelligence to identify deviations from images and videos. In addition, a virtual twin is used to show the exact position of the crane. A contact person can be on site to assist if necessary. This concept, created by Aalto University’s doctoral and master’s students, offers valuable information about the technology’s possibilities and future inspection methods, even though it is not yet in commercial use. It also helps crane manufacturers design future cranes

Cooperation with Kone’s development team in the elevator pilot – affects the development of future elevators

In the elevator pilot, Kiwa cooperates with Kone’s development team and Aalto University researchers to develop inspection and maintenance activities of the future. 360-degree cameras, motion sensors and a high-speed internet connection will be installed in a research elevator. The inspectors use our remote collaboration technology and Kone’s digital maintenance log book, which enables the remote inspector to collaborate on-site with the maintenance staff. The aim is to keep this solution as simple as possible, so that the quality of inspections, the safety of people and the efficiency of work can be studied and further developed. The core question is which stages of the inspection could be carried out remotely, and which still require the presence of an expert.

Research organizations Aalto, VTT and Turku University of Applied Sciences, Kone's development staff and Kiwa experts discussing on May 8, 2024 at Aalto University what kind of pilot would benefit both maintenance staff and inspectors

Augmented reality in inspections – digital annotations on premises and equipment
 
Our research partner VTT is researching the use of augmented reality in, for example, fire and extinguishing inspections. Augmented reality glasses (e.g. Magic Leap 2) can show the digital content directly on the inspection site. VTT´s researchers are developing software that could allow inspectors to leave digital annotations on premises, such as three-dimensional models or markings, for use by other inspectors or maintenance staff. This technology enables several people to participate in inspection events remotely, which improves cooperation and speeds up maintenance procedures.

In the future, the inspector could be able to leave digital annotations in the 3D space, for other inspectors or maintenance to see.

NDT pilots and inspection robots – cooperation with Vincotte (Kiwa company)

In the NDT pilot, Turku University of Applied Scienses is studying the use of inspection robots in hard-to-reach spaces and in monitoring structures. Inspection robots, such as the drones, robotic arms, robot worms and crawlers have proven to be very useful in industrial inspections. Our goal is to implement a pilot together with Turku University of Applied Sciences, Vincotte and equipment manufacturers. These robots and other inspection equipment are constantly evolving and have the potential to advance the inspection industry.

A Hibot Floatarm robotic arm used by Kiwa inspectors on site

Participation in inspections and assessment remotely? Already possible today!
 
In the fall, we will implement a remote monitoring pilot at Kiwa, where we will use a remote support solution and software. This enables, for example, the monitoring of inspections and the presence of the customer during the inspections using a remote connection. This pilot is driven by Development Manager Petri Hannuniemi, and it is tested in all our inspections and certifications. If you have a customer who would like to try the technology, let Petri know.

Business Development Manager Tuomas Suominen, Area Manager Samuli Salmela and Development Manager Petri Hannuniemi (not pictured) presenting a remote support solution to Kiwa management team on May 30, 2024. The remote support solution can be used with a helmet attached to the head or with a smartphone. The solution is tested 2024

Drone inspections inside wind turbines

Carrying out internal inspections of wind turbine blades and ladders with small quadcopters is also being researched. Kiwa’s expert Pertti Davidkin has also studied possibilities of drone technology in other demanding inspection tasks.

screenshot from the DJI Avata quadcopter video. The operator controlled the device with a headset and remote control. The small quadcopter could even fit through the ladders. The challenge is still the structural (shake) inspection, which is impossible to do with a quadcopter. The inspector also successfully examined the inside of the wind turbine's blades

Virtual meetings and training – from video meetings to virtual meetings?

The Necoverse project also explores the possibilities of virtual meetings. The technology is already out there. For example Microsoft has launched Immersive Spaces for its Teams platform (Mesh). These platforms allow people to participate in meetings in a virtual space. The best experiences are achieved with VR glasses, but the applications also work on computer displays. These VR technologies have the potential to improve training and meetings, maybe in the future also assessments, when avatars start to really resemble real people.

virtual meeting
Microsoft's Mesh environment is already available in Teams. To use the virtual space, you need to create a digital character, an avatar, of yourself in Teams. Image: Microsoft

Technology develops – Kiwa develops along with it

The technologies used for remote collaboration have developed significantly and their user experience is constantly improving. Artificial intelligence and smart glasses are getting better at recognizing objects and processes in the real world. For example, Ray-Ban Meta smart glasses have already entered the market, they are not much more expensive than normal spectacles. Although the inspected assets such as elevators, cranes and electrical equipment develop slowly, it is very important to think about how asset data and inspection data will be managed and used in the future. The Necoverse pilots produce valuable information about what kind of solutions we should develop for hardware, applications, data management and inspection processes.ÂÂ

Ray Ban has developed smart glasses together with Meta. Glasses can e.g. take photos, make a video call or talk to Meta's artificial intelligence about objects and things in the environment. Photo: Ray Ban

What’s next?

During the fall and winter, we aim is to progress with the crane and elevator pilots to a proof-of-concept phase to showcase the pilots. In addition, we are testing a remote support solution for monitoring inspections. These solutions are carefully studied from the point of view of safety, efficiency and compliance. Research results will be public.

Kiwa Finland’s Growth and Innovation team, heads of business operations, leading experts and inspectors are involved in the project. The Necoverse project is a demonstration of how collaboration, technology and expertise can create new opportunities for the inspection industry and improve the efficiency and safety of inspections.

 
More information:Tuomas Suominen, Business Development Manager, Growth and Innovation – team