Assessing Computational Thinking Skills Through Artefacts: The Case of ModeLLer

Computational thinking (CT) skills provide structured approaches to problem-solving that are valuable for navigating the increasing complexity of technological environments. CT skills can be assessed through various methods and perspectives. EUDability provides a framework for evaluating end-user development (EUD) tools, with core dimensions directly aligned to CT skills. This paper explores how CT skills manifest in the creation of visual models, an activity that supports the representation and understanding of socio-technical systems. We propose an evaluation method employing ModeLLer, a block-based EUD modelling tool and a user study. We carry out a structured evaluation integrating the EUDability inspection and process-based CT skills evaluation with the assessment of the artefacts produced by end-users. Results highlight the ability of ModeLLer to support the modelling activity while also providing insights into the EUDability of the tool and end-users’ CT skills. Furthermore, although preliminary, our results illustrate the relationship between tool capabilities, user skills, and modelling outcomes.