Mixed Reality and AI to aid surgeons with keyhole heart valve surgery

Cardiac surgeons could in the future be conducting procedures virtually before even stepping into an operating theatre, thanks to research at UWE Bristol’s Big Data lab and Faculty of Health and Applied Sciences (HAS). The team is developing technology that uses artificial intelligence (AI), augmented reality (AR) and virtual reality (VR) to assist cardiac surgeons in planning and preparing for complex keyhole heart valve surgery.
UWE Bristol researchers are initially collaborating with the Bristol Heart Institute (BHI), aSpecialist Research Institute at the University of Bristol, whose surgeons will test the system when preparing for minimally invasive cardiac valve surgery (MICVS).
Compared to conventional open-heart surgery involving cutting through the breastbone to reach the heart, MICVS is less intrusive as the heart is accessed through smaller incisions using endoscopic instruments. And patient recovery time is generally quicker after this keyhole surgery. However, MICVS is complex and requires hours of pre-operative planning and preparation.
Dr Hunaid Vohra, Consultant Cardiac Surgeon and Honorary Senior Lecturer and Researcher at the BHI, who is collaborating with UWE Bristol, said: “In the operating room, despite pre-planning, it is currently very common to find unexpected challenges, as every patient’s height, weight and heart-lung anatomy is different. And patients’ frailty varies.
“Mixed Reality and AI will enhance our ability to prevent the conversion of a keyhole heart valve operation to an open heart surgery, avoiding two sets of scars and delay in recovery.”
Surgeons will initially be able to use the system’s AI to tap into the patient’s medical data to predict the risks associated with the procedure. The likelihood of adverse events is then presented to the surgeon on a HoloLens using AR.
Next, the surgeon will have access to AR technology to show a patient a 3D version of their heart and explain the procedure to them via headsets.
Dr Muhammad Bilal, Associate Professor of Big Data and Artificial Intelligence at UWE Bristol and leading the research team, said: “Most terms surgeons use to describe heart surgery during consultation draw a blank from patients and this system makes the explanation task much clearer and easier.”
Incorporated in the system is also a pre-operative logistics element that optimises operation planning. This will assist medical teams in preparing the right instruments and materials, and booking the appropriate operating theatre and hospital beds, among other tasks.
Crucially, the software’s virtual planning feature will provide surgeons with access to a complete digital version of the patient, enabling them to perform the entire operation beforehand on a replica of the patient’s thoracic cavity. This will include ‘what-if’ scenarios to determine the most optimal and personalised surgical strategies.
Finally, in collaboration with UWE Bristol’s Centre for Print Research, surgeons performing very complex cases will be allowed to order a bespoke 3D printed model of the patient’s thoracic cavity mimicking organs, veins, and blood flow to simulate the procedure on a synthetic body.
“This will enable us to practise before the actual operation and minimise the potential for things to go wrong on the day,” said Dr Vohra. “Overall, we are excited to be involved in this technology, which could spell the future for highly successful minimally invasive procedures of this type in patients of all ages.”
Dr Bilal added: “Currently, the practice of MICVS is limited to a small group of surgeons in the world. This technology-enabled guidance promises to increase the number of doctors able to perform these operations, providing wider access to the general population.
“There are significant engineering challenges to be resolved before this technology can be rolled out into the NHS but our collaboration with the BHI provides a perfect testing ground.”
Related news

11 July 2025
Wound dressings developed with support from UWE Bristol to be launched by global firm
Technology that a team of UWE Bristol scientists helped develop to aid the healing of chronic wounds will be used in new ‘smart dressings’ being launched by global medical company.

03 July 2025
Research lab The Brunel Centre opens to power sustainable and inclusive growth for the West of England
A new data and research centre designed to support sustainable and inclusive growth and industrial strategy in the region, has officially launched.

26 June 2025
Development of innovative Devon food processing centre to tackle food waste gets UWE Bristol support
UWE Bristol is supporting the development of an innovative food processing centre in Devon that will transform food waste management and support greater food sustainability.

24 June 2025
Gestural musical gloves developed at UWE Bristol to feature at prestigious science exhibition
Groundbreaking gestural musical glove technology originally developed at UWE Bristol will be exhibited at the Summer Science Exhibition 2025 in London.

11 June 2025
Telling our story at UWE Bristol: RISE with us
UWE Bristol has launched RISE - standing for Research, Innovation, Skills and Enterprise - an institutional framework which shapes the University's purpose, culture and future growth.

30 May 2025
UWE Bristol student develops exoskeletal bionic glove to aid stroke recovery
A product design student from Iron Acton will unveil a prototype bionic glove to aid stroke rehab, during UWE Bristol’s annual Showcase starting on 5 June.

23 May 2025
New Centre launched at UWE Bristol to drive social and economic change across Africa through HE partnerships
UWE Bristol has launched the Centre for African Social and Economic Transformation (CASET) — a collaborative platform to support African-led innovation, research and HE initiatives.

21 May 2025
Students reveal creative responses to real-world experiences at UWE Bristol Showcase
UWE Bristol’s Showcase, celebrating student creativity and innovation across the College of Arts, Technology and Environment, returns this June.

19 May 2025
The Big Thing, a landmark event for immersive artists in the UK, comes to Bradford
Immersive Arts will launch its first major event this June in Bradford, the UK’s City of Culture, to bring together the country’s immersive arts community.

16 April 2025
More than 80 UK projects receive nearly £1.2 million in first Immersive Arts funding round
Almost £1.2 million has been allocated to 83 artist-led projects across the UK.

09 April 2025
UWE Bristol academics shaping the future of design across disciplines
Three senior leaders from the College of Arts, Technology and Environment have been appointed to prominent national roles in architecture, art and design.

08 April 2025
Associate Professor named among newest members of UK Young Academy of emerging leaders
The Royal Society has named UWE Bristol’s Dr Alexandros Stratakos, Associate Professor and Principal Investigator in Sustainable Agri-Food Production, as one of the emerging leaders across the UK who are the newest members of the UK Young Academy.