Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework

dc.contributor.authorKolade, Oluwaseun
dc.contributor.authorOwoseni, Adebowale
dc.contributor.authorEgbetokun, Abiodun
dc.date.acceptance2024-02-05
dc.date.accessioned2024-02-13T10:58:31Z
dc.date.available2024-02-13T10:58:31Z
dc.date.issued2024-02-10
dc.descriptionopen access article
dc.description.abstractChatGPT, a state-of-the-art chatbot built upon Open AI's generative pre-trained transformer, has generated a major public interest and caused quite a stir in the higher education sector, where reactions have ranged from excitement to consternation. This paper therefore examines the potential impact of ChatGPT on learning and assessment, using the example of academic essays, being a major form of assessment with widespread applications of ChatGPT. This provides an opportunity to unpack broader insights on the challenge of generative AI's to the relevance, quality and credibility of higher education learning in a rapidly changing 21st century knowledge economy. We conducted a quasi-experiment in which we deployed ChatGPT to generate academic essays in response to a typical assessment brief, and then subjected the essays to plagiarism checks and independent grading. The results indicate that ChatGPT is able to generate highly original, and high quality, contents from distinct individual accounts in response to the same assessment brief. However, it is unable to generate multiple original contents from the same account, and it struggled with referencing. The discussion highlights the need for higher education providers to rethink their approach to assessment, in response to disruption precipitated by artificial intelligence. Thus, following the discussion of empirical data, we propose a new conceptual framework for AI-assisted assessment for lifelong learning, in which the parameters of assessment extend beyond knowledge (know what) testing, to competence (know how) assessment and performance (show how) evaluation.
dc.funderNo external funder
dc.identifier.citationKolade, O., Owoseni, A. and Egbetokun, A. (2024) Is AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework. Heliyon,
dc.identifier.doihttps://doi.org/10.1016/j.heliyon.2024.e25953
dc.identifier.issn2405-8440
dc.identifier.urihttps://hdl.handle.net/2086/23539
dc.language.isoen
dc.peerreviewedYes
dc.publisherElsevier
dc.relation.ispartofHeliyon
dc.researchinstituteCentre for Enterprise and Innovation (CEI)
dc.rightsAttribution-NonCommercial-NoDerivs 2.0 UK: England & Walesen
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/2.0/uk/
dc.subjectArtificial Intelligence
dc.subjectPedagogy
dc.subjectAssessment
dc.subjectChatGPT
dc.titleIs AI changing learning and assessment as we know it? Evidence from a ChatGPT experiment and a conceptual framework
dc.typeArticle

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Kolade et al 2024.pdf
Size:
1.52 MB
Format:
Adobe Portable Document Format
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description: