In this paper we describe a tool to build software systems which replace the role of the examiner during a typical Italian academic exam in technical/scientific subjects. Such systems are designed so as to exploit the advantages of self-adapted testing (SAT) for reducing the effect of anxiety and of computerised adaptive testing (CAT) for increasing the assessment efficiency. A SAT-like pre-exam determines the starting difficulty level of the following CAT. The exam can thus be dynamically adapted to suit the ability of the student, i.e. by making it more difficult or easier as required. The examiner simply needs to associate the level of difficulty with a suitable number of initial queries. After posing these queries to a sample group of students and collecting statistics, the,tool can automatically associate a level of difficulty with each subsequent query by submitting it to sample groups of students. In addition, the tool can automatically assign a score to the levels and to the queries. Finally, the systems collect statistics so as to measure the easiness and selectivity of each query and to evaluate the validity and reliability of an exam.

Performing automatic exams

FROSINI, GRAZIANO;LAZZERINI, BEATRICE;MARCELLONI, FRANCESCO
1998

Abstract

In this paper we describe a tool to build software systems which replace the role of the examiner during a typical Italian academic exam in technical/scientific subjects. Such systems are designed so as to exploit the advantages of self-adapted testing (SAT) for reducing the effect of anxiety and of computerised adaptive testing (CAT) for increasing the assessment efficiency. A SAT-like pre-exam determines the starting difficulty level of the following CAT. The exam can thus be dynamically adapted to suit the ability of the student, i.e. by making it more difficult or easier as required. The examiner simply needs to associate the level of difficulty with a suitable number of initial queries. After posing these queries to a sample group of students and collecting statistics, the,tool can automatically associate a level of difficulty with each subsequent query by submitting it to sample groups of students. In addition, the tool can automatically assign a score to the levels and to the queries. Finally, the systems collect statistics so as to measure the easiness and selectivity of each query and to evaluate the validity and reliability of an exam.
Frosini, Graziano; Lazzerini, Beatrice; Marcelloni, Francesco
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11568/201701
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 7
social impact