APPLICATION OF WEARABLE AUGMENTED REALITY TO AID PERCUTANEOUS PROCEDURES IN SPINE SURGERY

Aim of the study was the evaluation of the efficacy of the use of a new wearable AR video see-throught system based on Head Mounted Displays (HMDs) to guide the position of a working cannula into the vertebral body through a transpedicular approach without the use X-Ray images guidance. We describe a head mounted stereoscopic video see-through display that allows the augmentation of video frames acquired by two cameras with the rendering of patient specific 3D models obtained on the basis of pre-operative radiological volumetric images. The system does not employ any external tracker to detect movements of the user or of the patient. User's head movements and the consistent alignment of the virtual patient with the real one, are accomplished through machine vision methods applied on pairs of live images. Our system has been tested on an experimental setup that simulate the reaching of lumbar pedicle as in a vertebral augmentation procedure avoiding the employment of ionizing radiation. Aim of the study is to evaluate the ergonomics and the accurancy of the systems to guide the procedure. We performed 4 test sessions with a total of 32 kirschner wire implanted by a single operator wearing the HMD with the AR guide. The system accurancy was evaluated by a post-operative CT scan. The most ergonomic AR visualization comprise the use of a pair of virtual viewfinders (one at the level of the skin entry point and one at the level of the trocar's bottom) aligned according to the planned direction of the trocar insertion. With such AR guide the surgeon must align the tip of the needle to the center of the first viewfinder placed on the patient's skin. indeed the viewfinder barycenter provides a 2 degrees of freedom (DoFs) positioning guide corresponding to the point of insertion preoperatively planned over the external surface of the model. The second viewfinder is used by the surgeon to rotate and align the trocar according to the planned direction of insertion (2 rotational DOFs). After the first test series a clamping arm has been introduced to maintain the reached trocar's trajectory. The post-operative CT scan was registered to the preoperative one and the trajectories obtained with the AR guide were compared to the planned one. The overal results obtained in the 4 test session show a medium error of 1.18+/−0.16 mm. In the last year there was a growing interest to the use of Augmented Reality systems in which the real scene watched by the surgeon is merged with virtual informations extracted from the patient's medical dataset (medical data, patient anatomy, preoperative plannig). Wearable Augmented Reality (WAR) with the use of HDMs allows the surgeon to have a “natural point of view” of the surgical field and of the patient's anatomy avoiding the problems related to eye-hand coordination. Results of the in vitro tests are encouraging in terms of precision, system usability and ergonomics proving our system to be worthy of more extensive tests.