Day two dawns fine but cloudy, after a drizzly day yesterday.
The conference begins with presentations across three streams. I attend and present within the teaching and learning 2 stream.
First up, Bruno Balducci from Otago Polytechnic presents on 'meeting the challenges of AI and assessment security'. Aims to develop strategies for assuring the integrity of assessments. Control measures include preventing AI misuse through well-designed tasks. Used a pragmatic research design to find out what aspects were more vulnerable to AI. Research questions included - could AI be used to 'cheat' in selected assessments now and into the future. If so, in what ways? What are the common features. Semi-structured interviews with tutors (25), reviewing assessments (30+), checking AI use by students and running trials with ChatGPT to see what could be achieved. Identified strategies of specificity, practicality, process, personalisation and information flow to design and manage assessment tasks. Provided examples and discussed pros and cons. Good summary of how good assessment design is usefully deployed to ensure assessments are personalised, authentic and locally contextualised.
Then, Rehan Masood with Maria Grace, James Flanders and David Finnie also from Otago Polytechnic, on 'Are we prepared for assessing AI content?'. Presented an overview of AI including the differences between discriminative and generative AI. Summarised the ways in which AI could be used in education. In assessments, there is a need to move away from stop-test approach towards meaningful learning activities. Summarised the ways teachers can use prompts for AI content creation. Study investigated how to us AI to generate content for assessments (in a construction courses context). Summative, formative assessments and rubrics generated. Missing from AI is contextual understanding, creative innovation, common sense/intuition and ethical considerations. Therefore, assessing these is one way forward. When creating questions using Gen AI, prompt literacy important. Recommended framework to improve assessment and assessment submission design.
I then present interim findings from our AI@Ara project. Provide summary of the project including what each of the 6 sub-projects did to integrate AI into their learning activities as framed by Sharples, 2023 concepts of social Gen AI for education. Then, preliminary findings reported which include interim framework for embedding AI literacies and recommendations.
Lastly, presentation from Lesley Brooks with Michael Greaves, Megan Kitching and Leoni Schmitd (Otago Polytechnic) on 'alternative modalities of postgraduate research assesssment'. Questioned why there are limitations to written thesis. Māori and Pacific learners have strong oral cultures, learners with disabilities disadvantaged and professional practice uses a range of methodologies that do lend themselves to thesis format. Investigated alternatives, their issues and risks and to find and offer solutions wherever possible. Interviews with 29 stakeholders. Caveats included modality being grounded in existing research; documentation, timeline with gateways to manage risks, institutional supports and awareness of the equivalence across the different modalities. Delphi technique then launched into with survey to 49 stakeholders. A key concept was the definition of assessibility - including availability of suitable assessors, ability to assess to the criteria, ability of programme to support the process and approach - Schmidt, L., Greaves, M. Brook, L. abd Kitching, M. (2022). Modalities of assessment matrix workflow.
Recorded teaching and learning presentations follow morning tea. There were 10 recorded presentations across a range of disciplines.
After lunch, a series of short presentations in the communities and institutions stream. There are presentations on local food growers, cyber security, prompt engineering and ChatGPT, performance-based research funding on accounting academics, and virtual exchange programme in environmental management. Presenters are from SIT, OP, and Wintec)
Then attend the last group of Teaching and Learning 3 presentations.
Beginning with Ana Terry from Otago Polytechnic presenting 'the big picture: visual literacy in teaching and learning'. Defined visual literacy in teaching and learning as ability to design robust visually-led tasks and assessments, using visual thinking tools and methods, visual design principles to clearly communicate, select and /or create relevant graphics, and ethical, social and cultural issues in using and sharing visual media. Visual content often an 'add-on' and often not used to support the text, just as an aesthetic. Shared findings of a survey to find out how ITP teachers understand visual literacy and to use the findings to improve visual literacy professional development for teachers. Teachers generally confident with basic creation of graphics etc. but less so when integrating into the teaching objectives - support other literacies and discussing ethical and cultural issues. Indicates a text based biased to teaching and learning. As people progress through education, visuals reduce becoming dominated by text. In vocational education and training, graphics are more acceptable. Especially useful for diverse learners, to provide better representation across various media, rather than just text. Proposed the formation of a Visual Literacy community of practice to continue work in this area.
Followed by James Mackay and Helen Jeffrey with Hana Cadzow, Ema Tokolai & Rita Robinson reporting on progress of degree apprenticeships with 'the tale of two degree-apprenticeships: embedding work integrated learning degrees'. Two degree apprentices - one in Bachelor of Engineering Technology on Infrastructure Asset management (now in its fourth year) and Bachelor in Occupational Therapy (OT) (first delivery in semester 2 2024). Each shared the challenges. Both had skill labour shortages, and with OT there was a high demand for Māori occupational therapists. Generally, effective school and community liaison important, marketing and employer relationship development, collaborative programme development, developing institutional readiness and ongoing evaluation. Also, addressing local, regional and national skills shortages, institution has capability, clear employer demand, career progression pathway and the institution must have competitive advantage. Differences in each criteria between each degree apprenticeship. see guidelines - Gorb, E. (2022). Guiding principles for Degree apprenticeship - Manchester Metropolitan University.
Last up, Danny Friburg with Amy Benians and Kath Danaher presented on 'Communities in the mist: Exploring CoP model for professional development. Reports on phase 3 on -neurodiversity CoP outcomes, established in 2022 with teachers working in the context. Defined CoPs (see Wenger & Snyder, 2000 and Alison Viskovic's 2005 work). Study to understand the value of CoPs to individual PD; what are the percieved benefits and how to better support CoPs. Check Kennedy, 200f on increasing capacity for professional autonomy from transmissive (training, award bearining, cascade), to transitional, standard based, coaching, CoP) and transformative (action research and transformative). Surmised that 6 year threshold signals a shift from transmissive to more transitional teaching approaches. 98 participants in pre-survey and 96 in post-survey. Shared findings. In general, teachers saw value in partcipating in the CoP. Awareness, knowledge increased including ability to find solutions , develop community and profesisonal networks and contribute to equity across the institution and meeting institutional values. Correlation between years of teaching and confidence in teaching neudivergent ākonga in post-survey but not in pre-survey.
Video played of Jamie Smile - who is the recently appointed Ragahau and Research Director for Te Pūkenga.
Various conference awards close the conference.
