Optical see-through head-mounted displays (HMD) enable optical superposition of computer-generated virtual data onto the user's natural view of the real environment. This makes them the most suitable candidate to guide manual tasks, as for augmented reality (AR) guided surgery. However, most commercial systems have a single focal plane at around 2-3 m inducing 'vergence-accommodation conflict' and 'focal rivalry' when used to guide manual tasks. These phenomena can often cause visual fatigue and low performance. In this preliminary study, ten subjects performed a precision manual task in two conditions: with or without using the AR HMD. We demonstrated a significant deterioration of the performance using the AR-guided manual task. Moreover, we investigated the autonomic nervous system response through the analysis of the heart rate variability (HRV) and electrodermal activity (EDA) signals. We developed a pattern recognition system that was able to automatically recognize the two experimental conditions using only EDA and HRV data with an accuracy of 75%. Our learning algorithm highlighted two different physiological patterns combining parasympathetic and sympathetic informatio

Recognizing AR-guided manual tasks through autonomic nervous system correlates: A preliminary study

Mimma Nardelli;Sara Condino;Alejandro Luis Callara;Gianluca Rho;Marina Carbone;Vincenzo Ferrari;Enzo Pasquale Scilingo;Alberto Greco
2020-01-01

Abstract

Optical see-through head-mounted displays (HMD) enable optical superposition of computer-generated virtual data onto the user's natural view of the real environment. This makes them the most suitable candidate to guide manual tasks, as for augmented reality (AR) guided surgery. However, most commercial systems have a single focal plane at around 2-3 m inducing 'vergence-accommodation conflict' and 'focal rivalry' when used to guide manual tasks. These phenomena can often cause visual fatigue and low performance. In this preliminary study, ten subjects performed a precision manual task in two conditions: with or without using the AR HMD. We demonstrated a significant deterioration of the performance using the AR-guided manual task. Moreover, we investigated the autonomic nervous system response through the analysis of the heart rate variability (HRV) and electrodermal activity (EDA) signals. We developed a pattern recognition system that was able to automatically recognize the two experimental conditions using only EDA and HRV data with an accuracy of 75%. Our learning algorithm highlighted two different physiological patterns combining parasympathetic and sympathetic informatio
2020
978-172815386-5
File in questo prodotto:
File Dimensione Formato  
Nardelli2020_recognizingARtask.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 4.53 MB
Formato Adobe PDF
4.53 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11568/1074426
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 1
  • ???jsp.display-item.citation.isi??? 1
social impact