Reimagining university assessment in a digital world - book overview

 Browsed through this ebook from the Ara library over the last week or so. Bearman, M. Dawson, P. Ajjawi, R. Tai. J. & Boud. D. (2020). Re-imagining university assessment in a digital world. Springer. 10.1007/978-3-030-41956-1

The eidtors are based at the Centre for Research in Assessment and Digital Learning (CRADLE), Deakin University,  Melbourne, Australia. 

Notes are brief as I have access to this book through Ara library and able to look up content when required :) 

After an introductory chapter by the editors, there are 19 chapters sectioned into 3 parts. The introductory chapter provides a brief rational and overviews of the chapters. 

A second introduction with New directions for assessment in a digital world by M. Bearment, D. Boud and R; Ajjawi. Here, the chapter uses a ‘programmatic portfolio’ to example how technology can shift assessment beyond the usual. Included is a call to include co-construction of assessments into HE; assessments should be one avenue to help provide graduates with the digital skills required in the workforce; and the inclusion of social media profiles and digital profiles of students into assessments so that they are useful beyond under graduate studies.

Part 2 – The changing role of assessment in the digital world

Digitally mediated assessment in HE: ethical and social impacts M. Bearment, P. Dawson and J. Tai.

This chapter sets out the many social, ethical and pedagogical implications of conducting assessments in the digital world. The themes covered include ethical issues, feedback, AI and influences of digital practices and portrayals.

Cognitive off-loading and assessment with P. Dawson introduces the concept of cognitive offloading into notes, calculaors, spell checkers etc. and their effect on the underpinning expectations of assessments. Some ideas on how to incorporate cognitive offloading are suggested including issues of transparency, programmatic assessment, evaluative judgement and authentic assessment.

Preparing university assessment for a world with AI: Tasks for human intelligence with M; Bearman and R. Luckin. Overviews the uses of AI in assessment. Idenitifies the things humans do well – personal epistemology and evaluative judgement as key. Uses critical appraisal assessment as a means to focus on human aspects. 

Repositioning assessment-as portrayal: What can we learning from celebrity and persona studies? With R. Ajjawi, D. Boud and D. Marshall,. Introduces the interesting concept of applying authentic industry or discipline norms to assessments in the form of persona studies.

Towards technology enhanced dialogic feedback by E. Pitt and N. Winstone. Updates on the aspect of technology-enhanced feedback via video, audio and screencast. Uses Carless’s old vs new paradigm to unpack the advantages and pitfalls.

Catering for diversity in the digital age: reconsidering equity in assessment practices by L. R. Harris and J. Dargusch. An overview of the challenges of digital equity with regards to assessments. 

Assessments as and of digital practice: building productive digital literacies by M. O’Donnell. Argues for the use of assessments not only as a means to judge learners’ work but also to scaffold, develop and assess the digital skills integrated into the assessment.

Part 3 the role of big data in re-imaging assessment

Augmenting assessment with learning analytics by S. Knight. Introduces learning analytics and how this can transform the way assessments are developed and implemented and assessment practices. Suggesions are provided to improve how LA may be instrumental in supporting better assessment processes.

Are assessment practices well aligned over time? A big data exploration with J. Rogaten, D. Clow, C. Edwards, M. Gaved and B. Rienties. Uses big data to look at 20 years of assessments across 2 studies to find out if student assessments/grades were well aligned with the qualifications. Recommendations are derived to improve the longitudinal alignment of grading trajectories by ensuing consistemt grading policies are followed.

The bi-directional effect between data and assessments in the digital age by A. Pardo and P. Reimann. Digital tech affects assessments and feedback. Data collected important to be translated to yield actions and design aspects to further positive effects on student experiences.

Standards for developing assessments of learning using process data by S. Milligan. Provides background on shift from just testing knowledge to incorporation of ‘soft’ skills and competencies important to graduate attainment of graduate outcomes.

Part 4 practical exemplars

Re-imaging peer assessment in self-paced online learning environments with L. Corrin and A. Bakharia. Example of self-paced online learning environment which is flexible, customisable and scalble peer assessment and feedback.

The future of self and peer assessment: are technology or people in the key? By J. Tai and C. Adachi. Theoretical frameworks provided along with how digital could provide for better pedagogical goals and best practice self and peers assessment. 

Using technology to enable a shift from marks to outcomes-based assessments by A. Cain, L, Tubino and S. Krishnan. Introduces the web application ‘Doubtfire’ to allow for a task-orientated portfolio-based approach to assessment to scaffold and evidence different standards of achievement. 

Challenges with designing online assessment to support student task understanding with T. Apps, K. Beckmand and S. Bennett. Cases study of open-ended online assessment.

 Re-iimagining assessment through play: a case study of metarubric With Y. J. Kim and L. Rosenheck. Uses MetaRubric, a playful assessment design tool which creates rubrics for teachers and students and allows them to learn about assessments.

Sharing achievement through digital credentials: are universities ready for the transparency afforded by a digital world? With T. J. de St Jorre. Discusses the topic and the advantages/disadvantages of digital credentials.

Part 5 conclusion

Concluding comments: reimagining university assessment in a digital world by P. Dawson and M. Bearman, draws the book to a close, reiterating the need to not just replace current assessment practices with a layer of digital support, but to actually examine the actual purposes of assessments and to envisage how digital technologies may be useful in transforming assessment practices.