Design and Validation of a Novel Tool to Assess Citizens’ Netiquette and Information and Data Literacy Using Interactive Simulations
Loading...
Identifiers
Publication date
2022-03-14
Authors
Advisors
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Until recently, most of the digital literacy frameworks have been based on assessment frameworks used by commercial entities. The release of the DigComp framework has allowed the development of tailored implementations for the evaluation of digital competence. However, the majority of these digital literacy frameworks are based on self-assessments, measuring only low-order cognitive skills. This paper reports on a study to develop and validate an assessment instrument, including interactive simulations to assess citizens’ digital competence. These formats are particularly important for the evaluation of complex cognitive constructs such as digital competence. Additionally, we selected two different approaches for designing the tests based on their scope, at the competence or competence area level. Their overall and dimensional validity and reliability were analysed. We summarise the issues addressed in each phase and key points to consider in new implementations. For both approaches, items present satisfactory difficulty and discrimination indicators. Validity was ensured through expert validation, and the Rasch analysis revealed good EAP/PV reliabilities. Therefore, the tests have sound psychometric properties that make them reliable and valid instruments for measuring digital competence. This paper contributes to an increasing number of tools designed to evaluate digital competence and highlights the necessity of measuring higher-order cognitive skills.
Description
Publisher Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
Keywords
Digital competence , Computer-based assessment , Netiquette , Information and data literacy , Simulations , Digital competence , Computer-based assessment , Netiquette , Information and data literacy , Simulations , Computer Science (miscellaneous) , Geography, Planning and Development , Renewable Energy, Sustainability and the Environment , Environmental Science (miscellaneous) , Energy Engineering and Power Technology , Hardware and Architecture , Computer Networks and Communications , Management, Monitoring, Policy and Law , Funding Info , This research received no external funding , This research received no external funding
Type
Citation
Bartolomé , J & Garaizar , P 2022 , ' Design and Validation of a Novel Tool to Assess Citizens’ Netiquette and Information and Data Literacy Using Interactive Simulations ' , Sustainability , vol. 14 , no. 6 , 3392 , pp. 3392 . https://doi.org/10.3390/su14063392