Agency by Design - Derek Wenmouth

 This book -  Agency by Design: An Educator's Playbook -by Derek Wenmouth with Marsha Jones, George Edwards and Annette Thompson, provides strategies to help provide learners with the skills to be self-directed learners. The book is free to download.

The book is pitched at the school context but many of the ideas and resources, are relevant across all education sectors. The book begins with a 'how to use the playbook' section, including an overview of the framework proposed to help activate agency in learners.

Then it moves to the implementation section which has 7 suggested conditions that can be created by teachers to increase learner agency and the characteristics (rubrics) observed in students which signal their learners' agency.

In a world of rapid and continual change, schools need to prepare their students, for a VUCA world. Learning the fundamentals are important (i.e. reading, writing and arithmetic). Beyond that, the real role of education, is to provide students with the confidence in their own abilities and to encourage and support the attitudinal qualities -resilience/ grit, curiosity, multimodal communication, flexibility and agility in learning and continual learning etc.

In all, a good summary, with practical examples for teachers, of not only encouraging, but building self-efficacy, leadership and continual adaptability in learners. 

Kick off sessions #8 - Students' and student advisors' perspectives

 

I assist with the facilitation of two sessions today at the Ara Institute of Canterbury Kick-off series of professional development workshops.

Firstly, session #8 with Marion Hale revisiting students perspectives on ‘distance learning’ and then session #9 with Alan Hoskin to introduce the concept of flexible learning - see later blog.

#8 ran from noon to 1 pm. We began with reiterating the importance of the student voice as it is part of Ara strategic focus to have the learner at the heart of learning.

3 vignettes from the session we ran in May were replayed. These were recorded statements from students on how their courses went. In the main, the students appreciated the pastoral support provided from their lecturers and the wider Ara team. They were happy with the many ways lecturers restructured their courses, the use of zoom to run synchronous sessions and access to zoom recordings and resources via Moodle. Challenges were individualised to the contexts of students. Finding resources for learning was difficult for trades student; students with young family found it very difficult to carve out time and space for their own study over the lockdown; most found there was too much communication from Ara coming their way – a balance would have been good.

Statements from student advisors were then played. Our student advisor team support students with outside of course pastoral care. Their perspectives were enlightening with respect to two important items. The first is the issue of digital equity. Many students did not own a laptop or have access to a PC. Mobile phones were not sufficient for distance learning structured around using a laptop or PC. Access to WiFi/mobile data was also difficult for some students. The other issue was the implication of withdrawal/deferment. Lecturers advised some students to defer or withdrawal last semester and these now impact on students’ eligibility for student allowance and entry back into programmes. These implication need to be better understood.

We then went through the common themes and discussed how Ara has responded and what needs to be still done to address the themes.

The themes indicate the need to be prepared by ensuring learners and Ara knew the types of digital devices learners had with them to access learning. Lecturers need to introduce the tools likely to be used if distance learning is required. Resources (videos, online quizzes, learning activities etc.) require preparation or finding before distance learning needs to be started up. 

Therefore prepareness are keys to ensuring the next time around (hopefully not!) the online learning experience is less stressful and more enriching for all. 

Reimagining university assessment in a digital world - book overview

 Browsed through this ebook from the Ara library over the last week or so. Bearman, M. Dawson, P. Ajjawi, R. Tai. J. & Boud. D. (2020). Re-imagining university assessment in a digital world. Springer. 10.1007/978-3-030-41956-1

The eidtors are based at the Centre for Research in Assessment and Digital Learning (CRADLE), Deakin University,  Melbourne, Australia. 

Notes are brief as I have access to this book through Ara library and able to look up content when required :) 

After an introductory chapter by the editors, there are 19 chapters sectioned into 3 parts. The introductory chapter provides a brief rational and overviews of the chapters. 

A second introduction with New directions for assessment in a digital world by M. Bearment, D. Boud and R; Ajjawi. Here, the chapter uses a ‘programmatic portfolio’ to example how technology can shift assessment beyond the usual. Included is a call to include co-construction of assessments into HE; assessments should be one avenue to help provide graduates with the digital skills required in the workforce; and the inclusion of social media profiles and digital profiles of students into assessments so that they are useful beyond under graduate studies.

Part 2 – The changing role of assessment in the digital world

Digitally mediated assessment in HE: ethical and social impacts M. Bearment, P. Dawson and J. Tai.

This chapter sets out the many social, ethical and pedagogical implications of conducting assessments in the digital world. The themes covered include ethical issues, feedback, AI and influences of digital practices and portrayals.

Cognitive off-loading and assessment with P. Dawson introduces the concept of cognitive offloading into notes, calculaors, spell checkers etc. and their effect on the underpinning expectations of assessments. Some ideas on how to incorporate cognitive offloading are suggested including issues of transparency, programmatic assessment, evaluative judgement and authentic assessment.

Preparing university assessment for a world with AI: Tasks for human intelligence with M; Bearman and R. Luckin. Overviews the uses of AI in assessment. Idenitifies the things humans do well – personal epistemology and evaluative judgement as key. Uses critical appraisal assessment as a means to focus on human aspects. 

Repositioning assessment-as portrayal: What can we learning from celebrity and persona studies? With R. Ajjawi, D. Boud and D. Marshall,. Introduces the interesting concept of applying authentic industry or discipline norms to assessments in the form of persona studies.

Towards technology enhanced dialogic feedback by E. Pitt and N. Winstone. Updates on the aspect of technology-enhanced feedback via video, audio and screencast. Uses Carless’s old vs new paradigm to unpack the advantages and pitfalls.

Catering for diversity in the digital age: reconsidering equity in assessment practices by L. R. Harris and J. Dargusch. An overview of the challenges of digital equity with regards to assessments. 

Assessments as and of digital practice: building productive digital literacies by M. O’Donnell. Argues for the use of assessments not only as a means to judge learners’ work but also to scaffold, develop and assess the digital skills integrated into the assessment.

Part 3 the role of big data in re-imaging assessment

Augmenting assessment with learning analytics by S. Knight. Introduces learning analytics and how this can transform the way assessments are developed and implemented and assessment practices. Suggesions are provided to improve how LA may be instrumental in supporting better assessment processes.

Are assessment practices well aligned over time? A big data exploration with J. Rogaten, D. Clow, C. Edwards, M. Gaved and B. Rienties. Uses big data to look at 20 years of assessments across 2 studies to find out if student assessments/grades were well aligned with the qualifications. Recommendations are derived to improve the longitudinal alignment of grading trajectories by ensuing consistemt grading policies are followed.

The bi-directional effect between data and assessments in the digital age by A. Pardo and P. Reimann. Digital tech affects assessments and feedback. Data collected important to be translated to yield actions and design aspects to further positive effects on student experiences.

Standards for developing assessments of learning using process data by S. Milligan. Provides background on shift from just testing knowledge to incorporation of ‘soft’ skills and competencies important to graduate attainment of graduate outcomes.

Part 4 practical exemplars

Re-imaging peer assessment in self-paced online learning environments with L. Corrin and A. Bakharia. Example of self-paced online learning environment which is flexible, customisable and scalble peer assessment and feedback.

The future of self and peer assessment: are technology or people in the key? By J. Tai and C. Adachi. Theoretical frameworks provided along with how digital could provide for better pedagogical goals and best practice self and peers assessment. 

Using technology to enable a shift from marks to outcomes-based assessments by A. Cain, L, Tubino and S. Krishnan. Introduces the web application ‘Doubtfire’ to allow for a task-orientated portfolio-based approach to assessment to scaffold and evidence different standards of achievement. 

Challenges with designing online assessment to support student task understanding with T. Apps, K. Beckmand and S. Bennett. Cases study of open-ended online assessment.

 Re-iimagining assessment through play: a case study of metarubric With Y. J. Kim and L. Rosenheck. Uses MetaRubric, a playful assessment design tool which creates rubrics for teachers and students and allows them to learn about assessments.

Sharing achievement through digital credentials: are universities ready for the transparency afforded by a digital world? With T. J. de St Jorre. Discusses the topic and the advantages/disadvantages of digital credentials.

Part 5 conclusion

Concluding comments: reimagining university assessment in a digital world by P. Dawson and M. Bearman, draws the book to a close, reiterating the need to not just replace current assessment practices with a layer of digital support, but to actually examine the actual purposes of assessments and to envisage how digital technologies may be useful in transforming assessment practices.

 

 

 

 

Applying SOLO to learning design of elearning #1

Attended a webinar this morning, offered by augmented learning on the John Bigg's SOLO taxonomy to inform effective e-learning practice. This was the first of 3 sessions on the topic. The next webinar is scheduled for Thursday 9/7. 

Webinar was presented by Stephen McConachie with Carl Condliffe. Recording is available here.

Notes taken below.

Began with overview of SOLO. Structured Observed Learning Outcome. 

What it is and how can it align to elearning. 

Ran through the advantages of ensuring learning outcomes are visible to both teacher and student. 

The Observed part is to be able to see if learning outcomes are met. And the structure refers to taxonomy (alternative to Blooms) which includes pre-structural (of the observed learning outcomes – where the learner does not have much understanding or skill), unistructural (able to complete parts of skills), multistructural (starting to get the connections), relational (able to make the more complex connections) and extended abstract (able to apply critical thinking/problem solving etc.). 

Check NCEA for links to how SOLO is applied in the NZ context. 

Connected SOLO to Depth of knowledge – e.g. surface/deep. Surface similar to pre-structural and unistructural. Deep implying multistructural etc. Procedural vs Conceptual knowledge – procedural implies able to do the skill and conceptual relates to ability to apply skill across wider contexts. 

Contention of ‘we measure what we value, and we value what we measure’. 

Important to understand SOLO is a continuum and students will move through different stages in different learning contexts. Using it as a scaffolding ‘tool’ is most important. Developing activities to address each SOLO provides for a framework for differential / personal learning environments. 

Check Pam Hook’s work – HookED on SOLO.

Uses of SOLO include planning of learning activity, frame discussions with learners about their own depth of thinking, to frame discussions on how skills and competencies relate across the topic with teachers, to evaluate the depth of learners’ thinking, and to evaluate our own practice as educators. 

Using SOLO to inform rubrics, check paper by Braband and Dahl

Proposed the use of SAMR as one way to connect SOLO to elearning design using types of coffee metaphor  - which may not be as good as the 'diving deeper' model.

Explained the SAMR model as a way to think differently about how to integrate technology and ensure technology is contributing towards being able to transform learning.  

Proposes placing SOLO on the horizontal axis and SAMR on a vertical axis to help organise learning design. Not sure how well this will work but look forward to the next webinar.  

Also identified limitations 

Other dimensions to consider include collaboration, creativity, student agency, authentic audience etc. 

SAMR + SOLO = elearning programme too simple. 

Adaptive learning - vocational education perspective

Adaptive learning is promoted as a form of personal learning, with opportunities to tailor learning to students’ understanding. It is perhaps most useful when students have to learn foundational principles or practice essential skills. Adaptive learning resources take a large amount of time to develop. The learning designer requires a good understanding and ability to unpack the tacit dimensions of learning. Adaptive learning is good for helping students learn the ‘canon’ required – especially foundational theory and discrete skill sets (e.g. basic maths) which have one ‘right answer or recommended way to solve. 

Adaptive learning has been around for some time, for example, 'programmed learning' 30 years ago was available mostly through text-based resources and I remember testing out very basic computerised versions. Basically, they were text books with small (usually multiple choice) quizzes and the results from these quizzes, directed you to another part of the text book. The approach was based on behaviourist theories which emphasised scaffolded learning.

Currently, adaptive learning is again and a response to standardised learning promoted in many countries - see previous blog for overview and return of adaptive learning to the list of currently recommended pedagogical approaches.  in the 'new' iteration, adaptive learning is defined as the ability of a learning resource to adapt to learners' performance. Edsurge reports advantages and particularly for online learning. Educause article also supports adaptive learning as a means to achieve successful learning. There is a good article by Kerr, P (2015) on the topic providing definitions for '‘individualization, differentiation, personalization’ with adaptive learning being the technology rather than the approach.

With the advent of AI, adaptive learning may be one approach to achieving economies of scale with blended / online learning. Education dive, lists many adaptive learning platforms, with many being publishers of text books and other forms of education resources. Forbes reports an upsurge in adaptive learning platforms with a more up to date list from tech advocate.

Commercial offerings include smartsparrow (free for up to 5 learners and up to 100 learners cost US$15 each); dreambox; knewton; and adaptemy. 

Open source platforms include a Harvard and Microsoft collaboration, alosilaps; grapple; and sagefy.

However, there are always other factors to consider. One being the lack of learner choice as the algorithm directs learners on pathways which the learner may not have envisaged going.

As proposed by Siemens, adaptivelearning may be constraining. Another approach is to perhaps offer learners sufficient support to understand the outputs of learning analytics and then for them to work out ways to address the data - see slideshare for 2015 presentation from Siemens, Gasevic and Baker.. The learner has to learn the skills to interpret and act on learning analytics, instead of being taken, without understanding why, down pre-programmed pathways laid out through adaptive learning platforms.

The other current challenge with regards to deploying adaptive learning with vocational education, is the prevalence and reliance on text based approaches. The advent of VR may provide an opportunity to move beyond adaptive learning based on text based responses but for the present, multiliteracies and multimodalities are not commonly included in algorithms for adaptive learning.

So, the main learning from undertaking the exercise of exploring adaptive learning, is caution. Adaptive learning offers advantages but can be constraining and may lead to learners being forced down the linear syllabi path via behavourist approaches. Balance needs to be sought, to provide learners with greater agency as to how learning pathways may be completed.