Show simple item record

dc.contributor.authorBartolomé, Juan
dc.contributor.authorGaraizar, Pablo
dc.contributor.authorBastida, Leire
dc.date.accessioned2021-01-25T08:58:58Z
dc.date.available2021-01-25T08:58:58Z
dc.date.issued2020
dc.identifier.citationBartolomé, Juan, Pablo Garaizar, and Leire Bastida. “Validating Item Response Processes in Digital Competence Assessment through Eye-Tracking Techniques.” Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (October 21, 2020). doi:10.1145/3434780.3436641.en
dc.identifier.isbn978-1-4503-8850-4en
dc.identifier.urihttp://hdl.handle.net/11556/1062
dc.description.abstractThis paper reports on an exploratory study with the aim to validate item response processes in digital competence assessment through eye-tracking techniques. When measuring complex cognitive constructs, it is crucial to correctly design the evaluation items to trigger the intended knowledge and skills. Furthermore, to assess the validity of a test requires considering not only the content of the evaluation tasks involved in the test, but also whether examinees respond to the tasks by engaging construct-relevant response processes. The eye tracking observations helped to fill an ‘explanatory gap’ by providing data on variation in item response processes that are not captured by other sources of process data such as think aloud protocols or computer-generated log files. We proposed a set of metrics that could help test designers to validate the different item formats used in the evaluation of digital competence. The gaze data provided detailed information on test item response strategies, enabling profiling of examinee engagement and response processes associated with successful performance. There were notable differences between the participants who correctly solved the tasks and those who failed, in terms of the time spent on solving them, as well as the data on their gazes. Moreover, this included insights into response processes which contributed to the validation of the assessment criteria of each item.en
dc.language.isoengen
dc.publisherACMen
dc.titleValidating item response processes in digital competence assessment through eye-tracking techniquesen
dc.typeconferenceObjecten
dc.identifier.doi10.1145/3434780.3436641en
dc.rights.accessRightsembargoedAccessen
dc.subject.keywordsEye-tracking techniquesen
dc.subject.keywordsDigital competenceen
dc.page.final746en
dc.page.initial738en
dc.conference.titleTEEM'20: Eighth International Conference on Technological Ecosystems for Enhancing Multiculturalityen


Files in this item

Thumbnail

    Show simple item record