28 July 2020
Virtual reality surgery training platform gets support from AMRC
Medical students are now being remotely trained via a virtual reality surgery training platform which is transforming the way surgery is observed.
Explore this joint project between machine vision company i3D robotics and the HVM Catapult’s Advanced Manufacturing Research Centre (AMRC).
Medical students are now being remotely trained via a virtual reality surgery training platform which is transforming the way surgery is observed.
Explore this joint project between machine vision company i3D robotics and the HVM Catapult’s Advanced Manufacturing Research Centre (AMRC).
Virtual reality for medical use
“The Covid-19 pandemic has highlighted the global need for a digitally-connected world that allows for seamless remote working conditions. The ability for senior surgeons and doctors to remotely view and be immersed in a virtual representation of an operation will have a game-changing impact,” said Dr Ben Crutchley, Senior Machine Vision Engineer at industrial 3D robotics (i3Dr).
i3Dr and AMRC engineers won funding from Innovate UK for the Stereo Theatre project, as part of their Fast Start competition – a £40m government investment to accelerate innovative projects tackling economic and societal issues resulting from the coronavirus crisis.
An Industry 4.0 Digital Operating Theatre proof of concept has already been built by the Medical AMRC in Rotherham, which the Stereo Theatre project will build on. This demonstrator project combines a virtual reality digital twin, projection mapping and smart tools to enable objects and clinicians to be tracked in the theatre space. Information can be digitally displayed through screens, projections and augmented reality devices.
Ben said: “Currently, the AMRC’s Digital Operating Theatre can provide a virtual representation of the real-world theatre and monitor movements with commercial off-the-shelf (COTS) sensors and smart tools but does not have the ability to produce updated 3D models of patients. Stereo Theatre will fill this gap, allow for further upscaling of the technology and offers a revolutionary approach to both the teaching of surgical skills to medical students and surgical procedures.”
VR: transforming traditional training
The teams believe that this technology could revolutionise surgery training and assessment by improving remote learning processes. Students will be able to practice their skills and perform simulated surgeries on virtual patients via the VR platform.
In addition to surgical simulation, the platform also facilitates surgical training by allowing senior consultants to engage in procedures conducted by junior colleagues remotely, allowing more observations by experienced surgeons. This should improve surgical outcomes in the operating room.
Digital Design Manager in the AMRC’s Design and Prototyping Group, David King, said: “When the AMRC started the Digital Operating Theatre project our vision was to develop a fully immersive real-time digital twin of the surgical environment that would be as realistic as possible and allow the possibility for remote clinical collaboration and VR training.
“The integration of i3D robotics real-time stereo mapping technology within the AMRC Digital Operating Theatre brings us closer to our vision and provides a solution to the need for accurate real-time 3D visualisation of patients within the digital twin environment.”
Machine vision company i3Dr, based in Tonbridge, specialises in producing hardware and software solutions for industrial environments such as steel, nuclear and aerospace. i3Dr’s core technology, stereo vision, has evolved through decades of development for the Mars Rover missions.
COVID-19 MedTech innovation
“i3Dr’s sister company, IS-Instruments, is also developing technology to address the challenges faced by the Covid-19 pandemic. Our fluorescent imaging device to determine contamination levels could also further develop the Digital Operating Theatre concept,” said Ben.
The Stereo Theatre simulator will be tested in the Medical AMRC’s Digital Operating Theatre demonstrator to prove the technology can monitor the real-world patient to update a digital twin displayed in VR and AR in real or near-real-time.
“The AMRC will provide the requirements for the 3D vision system to be installed in the Digital Operating Theatre and i3Dr will use this information to produce a vision system capable of capturing 3D data of the chest of a patient,” said Ben.
“We will further develop software to allow this 3D model to incorporate into the AMRC’s digital twin of the theatre. The system and software will finally be tested at the AMRC with the view that it may act as a demonstrator beyond the end of the project.”
David added: “This is our first collaboration with i3Dr and we are already in discussions about significantly larger new programmes. The aligned vision of the AMRC and i3Dr with our combined knowledge and experience makes us confident this is the start of a long and exciting partnership.
“The technology developed and demonstrated within the AMRC’s Digital Operating Theatre is translatable across sectors with AMRC partners currently investigating new applications within the manufacturing environment.”
Fast Start competition funding
The Fast Start competition aims to fast-track the development of innovations born out of the coronavirus crisis while supporting the UK’s next generation of cutting-edge start-ups.
Business Secretary, Alok Sharma MP, said: “The coronavirus crisis has created challenges that impact the way we live, work and travel but has also prompted a wave of new innovations as businesses look at ways to solve some of the challenges facing our world today.
“This funding will support UK start-ups to deliver potential solutions, services and ways of working and help ensure the long term sustainability of these businesses.”
From VR headsets for safe ventilator production to innovative medical devices for stroke diagnosis, HVM Catapult Centres are at the forefront of MedTech innovation.
Discover our virtual reality technology capabilities to learn how VR could transform your manufacturing processes.