Showing posts with label e-assessments. Show all posts
Showing posts with label e-assessments. Show all posts

Friday, October 21, 2022

eAssessment in vocational education and training (VET)

 Here is a link to the European Union site on e-assessments for vocational education and training. Information on the project and its partners provide the background and rationale for the project. The primary aim of the project is to provide guidelines, tools etc. to support the development and implementation of eassessments into vocational education contexts. The blog  provides reports from the various partners as the project progresses.

Toolkits developed so far include overviews on the pedagogical approach, the types of approaches possible (including eportfolios) and the needs for continuous professional development for VET practitioners. 

Overall, a good port of call for information on eassessments as they pertain to VET with many examples, some guides and relevant resources. 






Tuesday, October 20, 2020

CRADLE 2020 - Day two 'morning' presentations

 

Day two begins with presentations on assessment in a post digital world. The presenters are Associate Professor Phillip Dawson, Associate Professor Rola Ajjawi and Professor Margaret Bearman (researchers from CRADLE at Deakin). The discussant is Professor Michael Henderson from Monash University.

The symposium began with Michael acknowledgement of Country. Each of the presenters shared their work – which are chapters in the book – reimagining university assessment in a digital world.

Rola begins by presenting on ‘assessment as portrayal and the strategic negotiation of persona’. Began with the impact on digital technology on work – permeates everything, blurring professional and private life, careers becoming more fluid and greater portrayal of digital identities. Assessments are for certification, guide learning, help with employability and learning how to make evaluative judgements. Completing the qualification recognised with award and transcript but does that portray who the graduate is?? Proposed assessment-as-portrayal to enable students to portray their achievements in public ways, communicate directly with others. Examples include the use of graduate learning outcomes through portfolios/credentials etc. Another pathway may be through persona studies used by celebrities. Persona can be considered as a strategic identity (Marshall & Henderson, 2016). Five dimensions of persona include the public, mediatised, performative, collective and intentional value and reputation. Reimagining assessments using persona studies involves introduction of a subjective dimension to assessment practices, a rethink of how we judge the quality of portrayal for future work; and encouragement of student agency. Concluded with some important questions on how portrayal may work.

Margaret covered the topic ‘assessment for an AI-mediated world’. What does AI do well? – identify patterns more accurately than humans, faster and at scale. However, this is a myth. Automated essay grading is available but restricted to appropriate topics and tasks. The systems are bounded by the quality of the original data set! If a machine is able to grade a task, then it can do the task. Therefore assessments need to be centred around unique human capabilities – evaluative judgements, deployment of meta-intelligence (i.e. knowing about how you know). Assessments that promote EJ is not just about identifying but the ability to construct their own sense about quality withing a unique practice environment. Assessments can promote EJ through cycles of self, peer and educator assessments. Assessment should develop personal epistemology. Deliberately call attention to the EJ process. Use example rubrics to form powerful epistemic artefacts. Ask learners to question the role of rubrics (Bearman & Ajjiwi, 2019). Assessment tasks should prompt students to answer questions on – what qualities make this a good piece of work? If I were to set the criteria for success, what will it look like? How do we know we have achieved?

Phillip presented on ‘surveillance and the weaponization of academic integrity’. At the moment, Higher ed (HE) assessment has a surveillance culture, this may be OK but we should fear the weaponization of surveillance on academic integrity’. Drones, webcams and other tools collect data on student learning. Argued that presently, a surveillance culture pervades society and this is seen as acceptable by many ‘for our own good’. Surveillance culture’s effect on assessments include the creation of a culture of distrust; frames students as being in need of monitoring; students and their data become a product; academic integrity becomes a game of submitting to or subverting surveillance; and there eventuates an acceptance of the surveillance. There needs to be a balance between surveillance and academic integrity. Assessment security may be adversarial, punitive and evidence based but academic integrity is positive, educative and supportive.

 

Session one DAY 2: Learning through and for work is with Associate Professor Gloria Dall’Alba from the University of Queensland. She presents on ‘toward a pedagogy of responsive attunement in educating for the professions’.

Rhea Liang introduces the session.

Placed the presentation in the current context, where ‘fake news’ is of concern. Society relies on truthfulness. When fake news disrupts the standard discourse, it causes frustration and disillusionment. Proposes responsive attunement as a means to ensure professional are able to evaluate information in a studied and evidence based approach. Therefore, it is important to ensure our ‘way of being-in-the-world’ (Heidegger, 1962) is anchored in the ability to evaluate and respond to information. Advocated for ‘the capacity to care’ (Noddings, 2005) as a mark of personhood. Need to listen to the multiplicity of perspectives, and to be able to assess their importance. Learning incorporated what we know and do (epistemological) but also how we are learning to be (ontological). Being attuned allows professionals to work through complexities and ethical dimensions. Responsive attunement is responding on the basis of tuning in to others and things, with reflexivity. Responding includes sensate, motile, emotional – i.e multimodally. Education needs to begin the process so professionals are prepared for the challenges posed at work. Implications summarised as – highlighting tuning in and responding, focus on programme goals, reward in assessment, address embodied learning, have well-integrated program and ensure epistemological and ontological dimensions addressed.

Then a session with Dr. Emma Scholz from Charles Sturt University on ‘Professional identity development : Implications for sustainable assessments’. Presents on work with Franziska Trede.

Emphasis on professional identity development in the workplace and the bringing in of Bloom’s taxonomy to assist the process. Presented the concept of locating professional identity in a practice theory framework – in the context of first year of practice for new graduate veterinarians. Research focus needs to be grounded in ‘individuals in their social practice’. Detailed sequential analysis process to thematically analyse interviews and field notes. Themes than taken back to the data to construct key stories. These underwent dialogic analysis to provide for the narratives. Theme on practice capability, the learning professional, striving to become a capable practitioner, and mobilising criticality within capability, shared with interview vignettes. A screen shot of a key story presented. Proposed implications for practice.

Monday, October 19, 2020

CRADLE conference 2020 - Welcome and Keynote #1 - Associate Alyssa Wise on learning analytics

 Attending the sessions for the CRADLE (Centre for assessment and digital learning) conference today and tomorrow. There is a two hour difference in time (NZ is 2 hours ahead) so It will be a late finish today 😊

The conference begins with a welcome from Professors Liz Johnson and David Boud, Deakin University. First CRADLE conference (over 900 participants!!) but the fifth year CRADLE has been running. Professor Boud provided background and rationale for the conference. Professor Johnson provided formal welcome to country and to the conference.

The first keynote (introduced by Phil Dawson) is with Associate Professor (of educational technology and learning science) Alyssa Wise from New York University on ‘The data intensive university in a post-digital world: New directions in teaching and learning.

https://steinhardt.nyu.edu/people/alyssa-wise

Defined learning analytics (LA) as the use of data science methods to generate insights into teaching and learning that lead to direct, impactful action. Important to use LA purposefully to inform how learning is designed, developed, supported, taught etc. Argued that data informed decisions are more important than ever given how online, blended, hybrid etc have moved to mainstream overnight, no longer digital vs traditional.

Shared recent survey across large number of universities. Unfortunately, pre-covid online better experienced than post-covid ‘remote learning’. However, experiences did improve (slightly) over time. Clear structure for learning important but needs to be balanced with flexibility. In general, videos of ‘lectures’ positive but online lectures themselves had mixed reviews, along with online discussions. Important to provide ‘active engagement’ for students.

How can learning analytics help? Begins with instructors design with intention to engage learners, who generate data, provide analytics, read as human insights and feed back into instructors design.

Data can be catergorised as activities, artifacts and associations. It is not only the data, but how is it analysed and applied? Sense making from analytics need to be supported with pedagogical response.

Provided a series of examples. Are my students preparing? When are my students preparing? Are my students engaging? Collected data on activity and used this to inform the  ongoing development of activities to increase engagement. Qualitative data also important – for instance to find out ‘who are my students engaging with? Where is the student spending the most time (asynchronously)? What does the student engage with – content related or non-content related discussion posts?

For instructors, important to find out how they are going. In general, professor responses which are to all levels of queries, providing coahing and supporting and social presence cues have greater engagement with professors who only respond to ‘top level queries which are straight forward.

Another example of how to find students who are struggling using diagnostic assessment with LA used to build a better model of how to identify and support students. However, relationship support (i.e. caring tutor) still most effective!

Interrupted by phone call!! So did not get to follow the last 5 minutes and the Q & A.

Monday, December 02, 2019

Design of Technology-enhanced Learning - Integrating research and practice - book overview


Bower, M. (2017) published by Emerald Publishing Company.

After the preface (rationalisation for the book and summaries of chapters), acknowledgements and foreword (by J. Hedberg), there are 12 chapters.

1)     Technology integration as an educational imperative
Begins with setting up the broader context for the need to design learning with supporting TEL. Introduces, rationalises and details the role of ‘design thinking’ and the field of learning design and argues that teaching is a design science (as per Laurillard’s work). The work of Laurillard, Siemens and Conole are compared, discussed and critiqued. The six approaches of learning design are introduced – technical standards, pattern descriptions, visualisations, visualisation tools, pedagogical planners and learning activity management system.

2)      The Technology Pedagogy and Content Knowledge (TPACK) framework and its implications
Here the TPACK framework is introduced and critiqued. Provides examples of TPACK in practice and recommendations on how teachers are able to develop the capacities for applying TPACK. There is a comprehensive literature review of TPACK as well.

3)      Pedagogy and technology-enhanced learning
Provides an overview of the relevant pedagogies. The pedagogies include the usual – behaviourism, cognitivism, constructivism, socio-constructivism and connectivism. Pedagogical approaches are also overviewed, including collaborative learning, problem-based learning, inquiry-based learning, constructionist learning, design-based learning and games-based learning. Each is described with examples and brief critiques. The role of the teacher in applying the relevant pedagogical approaches is summarised.

4)      Technology affordances and multimedia learning effects

In this chapter, the two frameworks applied to the use of TEL – affordances and the learning effects from multimedia are introduced, detailed and discussed. The focus with ‘affordances’ is to understand the potentialities of the multimedia with relevance to the learning objectives to be achieved and matching both to maximise learning. With learning effects, the different ways for using text, images, audio, video etc. and their impact on understanding and learning are introduced and discussed.

5)      Representing and sharing content using technology
Applies the taxonomy of learning, teaching and assessing (Anderson & Krathwohl, 2001) towards how technology may be used to represent and share content. The representational requirements of core subject areas – English, maths, science, history, geography, IT) are presented.

6)      Design thinking and learning design
Introduces and substantiates the principles of design thinking, design science and learning design as ways forward to integrate TEL into teaching and learning. The educational design models of Laurillard, Siemens and Conole are revisited.

7)      Design of Web 2.0 enhanced learning
Reviews the work on Web 2.0 and its impact on teaching and learning. Defines, Web 2.0, defines opportunities and presents a typology to assist with matching the benefits to learning outcomes. The advantages and challenges are also presented. Two case studies are provided to underpin the typology.

8)      Designing for learning using social networking
A review of social networking in education from a design perspective us provided. The various benefits, issues and implications for using social networking are presented through the chapter.

9)      Designing for mobile learning
Mobile learning is rationalised as one forward to engage learners. Examples in school and higher education are provided. Benefits are summarised along with issues. Recommendations are synthesized towards the development of mobile learning. Examples from school and higher education are provided and recommendations for learning design, implementation are provided.

10)   Designing for learning using virtual worlds
Virtual worlds are defined and contrasted. These virtual worlds include Second Life, Active Worlds, Open Sim and Minecraft. The benefits are distilled from the literature along with other forms of virtual worlds including 3D simulations, role-plays, construction tasks and immersive learning. Examples from school and higher education are provided and recommendations for learning design, implementation are provided.

11)   Abstracting technology-enhanced learning design principles
From applying learning design to the design of learning through Web 2.0, social networking and virtual worlds, design principles are synthesised.

12)   Technology-enhanced learning – conclusions and future directions
Brings the various discussions through the book together through presenting some future scenarios for TEL.

The book fills a gap and brings in academic research across the last two decades, to inform the deployment of TEL into teaching and learning practice. Research and teaching and learning inform each other and one should not take place in isolation from the other.

The book is well-structured and readable with pragmatic application of research towards the integration of TEL for the improvement / enhancement of teaching and learning.

Thursday, November 28, 2019

Talking Teaching - Day 1 afternoon presentations


After lunch, I run a session centred around the sociomateriality and the possibilities of supporting the learning of these withe-assessment approaches. Introduced the background conceptualisation of learning as becoming. In this workshop, we concentrate on the sociomaterial aspects of learning, required to attain occupational identity, a goal of vocational education. Digital tools may be useful in accessing, archiving nuances of and reflection on the learning of the sociomaterial. Matching the most effective tool to harness the feedback from others to help learn better the sociomaterial is an objective of the workshop.

Dr. Peter Mellalieu from Peer Assess Ltd. And Patrick Dodd from Unitec present on ‘digital tools for enabling developmental feedback and teamwork grading by peer assessment’. Defined teammate peer assessment. Demonstrated tool (Peer assess pro) – supported by Ako Aotearoa funding – from the student and the teacher viewpoint. Compared this tool to alternative tools in the market. Presented criteria for selecting peer assessment platform. Sprague, Wilson & Mckenzie (2019) advocated that students are less likely to take a ‘free ride’ when they know that their contributions are considered towards determining their grade. Propositions also that awarding all team members the same grade is not valid, fair or motivating. Students have to receive training in teamwork and the assessment practices they will use. An effective peer assessment platform identifies inflated self-assessment and outlier team ratings. There are 10 other similar platforms and each fits a distinct purpose. Discussed the criteria for selection. 

Then last session of the day with Dr. Angela Feekery from Massey University and Carla Jeffrey from Ngai Tahu/ Massey with ‘enhancing students’ information evaluation capability using the Rauru Whakarareevaluation framework'. She teaches a large class on 'strategic business communication for first year students and Carla is the project librarian. The course is to prepare students for the information context they are studying /working with. Information literacy is a requirement for all aspects of academic literacy, disciplinary literacy, digital and media literary, adult and professional literacy. Information literacy includes skills of research, problem solving, transition, ethics, critical analysis, study skills, search skill, evaluation, social media, connectedness, creativity and innovation. Therefore involves the processes, strategies, skills, competenxies, expertise and ways of thinking to engage with information to learn across a range of platforms to transform the known, and discover the unknown. Shared resources used with the course to assist students to attain the information skills. Overviewed the framework - Rauru Whakarare - to be used holistically rather than just as a checklist. 

Talking Teaching - Day 1 morning

In Auckland for the next few days for the annual Ako Aotearoa Academy symposium. Yesterday was an academy members only day, followed by two days of the Talking Teaching Conference 2019.

Academy day
The main objective was to move the strategic vision of the Academy forward. Initial document created by executive has been workshopped last year and this year, time to refine and complete. Also, an update on the year and changes occurring along with up and coming future changes through our relationship with Ako Aotearoa.

Day 1
Day one opens with a powhiri and the plenary address by AssociateProfessor Faumuina Fa’afetai Sopoaga from University of Otago – winner of the Prime Minister’s prize for teaching excellence last year. Spoke on the theme ‘our past shapes the journey into the future’. Began with a song, learnt in her childhood, followed by welcome in Samoan, Maori and other languages. Used her personal history to weave the theme into the challenges of today and the future. Articulated the collectivist Pacific culture and how these have influenced her. Used an example from her early days in NZ, to illustrate the challenges of adjustment into new culture expectations. These influenced her approach to helping medical students learn cultural inclusiveness through immersion into cultures they are unfamiliar with. Encouraged conference participants to ‘step up’ their efforts to help learners connect with and attain empathy with other cultures.

After morning tea, there are 6 streams. I stick mostly with the ‘technology’ stream as I am facilitating a workshop after lunch.

First up, Dr. Lydia Kiroff and Taija Puolitaival from Unitec, on ‘digital natives and digital technologies in construction education’. Presented the initial results from a action research to support students to transition from simple online apps to full professional apps. Defined digital natives (Prensky, 2001) with extensions on this to account for Gen Y and Z, and digital technologies. Overviewed the evolution of construction digital technologies from manual drafting to 3D / VR building objects. For purposes of study, Level 5 construction communication (emphasis on online/freeware) and Level 7 BIM (desktop apps for CAD/BIM) courses were selected. Pre and post diagnostic questionnaires were used, along with lecturer diary, assessment results and formal course evaluations.
Findings indicate younger students use more apps more often. Desktop apps familiar to all. Installation of online apps tended to be easier for younger students. Older students more confident with desktop apps but hesitant with experimenting. Initial thoughts on how to help students become familiar with app interface and encourage experimenting with the different functions. Perhaps through online tutorials and encouragement of daily use through exposure across all courses.

Then Kim Watson from Toi Ohomai, on ‘gamification of quality management’. An encouragement for the introduction / integration of gaming into tertiary learning. Shared his experiences in ‘gamification of a lesson’ and then opened up the session to a discussion. Encouraged the development of the approach and the game does not need to be digital, but a form of simulation of a process. Through ‘doing’ the process, concepts and deeper learning occurred.

Move across to a workshop / discussion led by James Patterson from Toi Ohomai and Adrian Woodhouse from Otago Polytechnic on the ‘review of vocational education’ ROVE – affecting all polytechnics as they will all become one entity come 1st of April next year.  The session's theme is 'more questions than answers'. James reflected on experiences from the formation of Toi Ohomai which was a merger between Wairiki (Rotorua) and Bay of Plenty Polytechnic. Stressed the importance of building good relationships between all partners. Adrian provided some background and challenged participants to 'construct the future' rather than allow ROVE to be done to them. Look to supporting learners through their work life, from novice to expert (Level 10 qualification). 
Opened up the conversation to the session to share opportunities perhaps provided by ROVE. Discussion revolved around the need to share practice from ITOs, be more formal about collaboration across the new entity, PTEs, employers, regional governments etc. There are experiences within the ITP sector of shared qualifications - exampled by the Bachelor in Engineering Technology and the NZ Certificates in Engineering - whereby innovations are shared and improved through collaborative efforts. Discussion then revolved around ways to record student learning so that learning becomes more transportable across NZ. Important to be cognisant of who will have the power - for instance the Work Developments Councils (WDC) whose role as standards setting bodies seems to also include the moderation and development of assessments.Important to value teaching and to put teaching and learning at the centre, not just as a service to industry. Definition of 'assessment' is important. Need to not take our eyes off the main goal, to be positive changeagents and supporters for learning.Important to keep in touch with the various working groups and to take the opportunity to provide feedback / submissions when they are invited.



Tuesday, October 15, 2019

NZ Vocational Education and Training (VET) research forum - DAY ONE MORNING


In Wellington today and tomorrow for the annual NZ VET research forum. This is the 15th year this conference has been convened and sadly the last. One of the outcomes of the NZ Review of VocationalEducation (RoVE) is the disestablishment of Industry Training Organisations (ITO). This conference has been organised by the Industry Training Federation (ITF) which has been a convening community of practice for the ITOs.

The day begins with a welcome from Josh Williams, the Chief Executive of the Industry Training Federation. Began with a video summarising the 15 years of the conference, the diversity of research topics, researchers from across the sectors (industry, polytechnics (ITPs), universities, ITOs, private training providers etc.) and the contribution from international experts. Called for contributions to provide ideas for ‘what shall we do next?’ Overviewed the challenges presented through RoVE but to park this and to make the most of opportunities presented at this conference. Presented a crystal ball recommendation to ‘learn from the past’ and some guidelines for skills learning moving into the future.

The first keynote is with the Honourable Chris Hipkins, Minister of Education. The minister began with how 15 years ago, the Tertiary Education Commission (TEC) was formed. The world has moved rapidly on and there are now many new challenges. Significantly, there is a need for all workers to continually re-train / develop their skills to keep up with shifts in workforce needs. Call to ensure school learning is not only focused on the 30% who will go directly into university but the 60% who will move on into VET or work. However, outcomes from attaining a degree are not always guarantees for continued material success or work satisfaction. Rationalised the key approaches as proposed through RoVE. Continual post-education development is now a standard requirement. Barriers to VET need to be broken to provide flexible and accessible opportunities where and when required. On and off job learning/training have to be seamless. Emphasised that the advantages in the current NZ system will be drawn on and supported. Encouraged continuity of VET research and the importance of application of findings / recommendations etc. to practice. NZ has to build a uniquely NZ solution to make work, work for all NZers. Updated on progress on RoVE including formation of the NZ Institute of Skills and Technology (NZIST), Work Development Boards (WDB) and Centres for Vocational Excellence (CoVEs).

Second keynote of the day is from Dr. Marco Paccanella, who is the Director of the Department for Education and Skills at the OECD. He presents on ‘the changing role of TVET in the international policy discourse’ as based on data from PIACC. Slight change of gear from the Minister’s address! VET across countries are often very different, so comparisons can be challenging. Covered the changing role of VET. Used to be something for (disadvantaged) youth, to upgrade from low to middle skills etc. – see 2010Learning for Jobs OECD report. However, skills beyond schooling are now of greater importance – see Skills beyond school OECD report. Therefore shift from VET to post education training (PET) to ensure continued education and training for populace as the future of work is impacted on by technology. Now, - see Future-ready adult learning systems 2019 OECD report. Shift from initial to continual training due to skill obsolescence (Deming 2017), skills displacement actually impacts predominantly higher-skilled workers McGuiness, Pouliakas& Redmond, 2019)! See Nedelkoska & Quintini (2018) who used PIACC date to look at variations between sectors with regards to impact of automation on industry sectors. High risk to manufacturing, agriculture and low skilled services but hard to automate include social intelligence, cognitive intelligence, perception and manipulation. Shared data of the mismatch between people who would like to participate in continual training and availability /access. The workers who need it most, are most likely to NOT participate! Shortage of time, lack of financial resources were main reasons blocking participation. Shared policy decisions that may assist. Foster mind-set of learning among firms and workers, lower barriers to training, make training rights portable, align to work skill needs. Presented on WHERE NZ stands. Employers unable to recruit staff with required skills at the going rate of pay. Shortage in hard to find skills but surplus of easy to find skills. Check Skills for Jobs indicators on the OECD website. Also shared the priorities for adult learning dashboard. There are 7 dimensions and 7 synthetic indicators. Urgency (NZ stands well), Provision (high from employers and organisations), inclusiveness (good), flexibility and guidance (more average), alignment (average), perceived impact (high for usefulness of training and average wage returns), financing (average – could be better support). In general, NZ performs pretty well but this is not a reason to NOT reform.

After morning tea, concurrent sessions begin. I attend the session with Associate Professor Jane Bryson from the Centre for Labour, Employment, and Work, Victoria University on ‘collective voice and access to training’. Workers in NZ do not actually have guarantee to the provision of training, unless it is stated in the employment contract or legislation requires (e.g. construction industry). Getting a say in training is impacted on power relationships present in organisations and workplaces. Relevant now as per need for workers to continual training to upskill for future of work requirements. See ILO (2019) –work for a brighter future and OECD (2019) Getting skills right – reports. Meeting learning opportunities for workers is usually low priority for employers. Collective voice may be one approach towards attaining on-going training and development opportunities. RoVE and update for Tertiary Education strategy are opportunities for workers to be upheld. Presented on recent research on whether collective workers’ voice would impact on access to training. Studied the collective contracts database to find out if training provisions written in. Then analysed if the entitlement was meaningful. In 2015, 87% of collective employment agreements have training of skill development provision. Public sector workers more likely to have training. Industries with fewer collective agreements, tend to have less provision for training. Did workers who had training provision entitlement, use them or were satisfied with the provisions. Used Fuller and Unwin expansive vs restrictive approaches to workforce development as a way to compare collective agreements 25% were expansive and 75% restrictive!! Interviews with union officials to establish a deeper understanding. Identified key conditions for success expressed by the officials and strategies they used to try to make training provisions in collective agreements more expansive. Important to ensure that entitlement and opportunity also includes supporting workers’ agency to access and making use of the potentialities.

Then I present on details of the seven sub-projects from the e-assessment project. Presented overview of the project including the research methodology and how the guidelines were derived from the inquiry cycles undertaken to develop and deploy e-assessments for learning. 

Wednesday, July 17, 2019

Ara Kick off day -


Ara’s ‘Kick-Off’ day brought together all the staff of the Academic, Innovation and Research (AIR) division to launch the creation of the new entity- which was formed late last year through combining all the teaching departments with the academic division.

The day begins with welcome and key messages. Formal karakia and the Ara waiata begin the proceedings with George Nelson – Deputy CE and the Ara management team leading the waiata. Hemi Hoskins, Head of Department explains the significance and meaning of the karakia.
George provides the welcome and details on the day’s activities. Plans for the event to continue into the future at the beginning of each semester. First activity based around the AIR theme from Araport with learners on a journey on the AIRplane. Vision shared on the way forward for the Ara education ecosystem. Overviewed the current and proposed the future, using airports as a metaphor. Need to move beyond what we currently offer, to be more flexible and agile – meeting needs for the working population to continually develop their skills and knowledge as the future of work evolves.  Ecosystem includes shifting to supporting enterprise / entrepreneurial opportunities, seminars and workshops from staff after professional development participation and as ‘thought leaders’. Detailed some of the current and planned activities going forward into the next few years.
Executive team updates follow through a series of ‘pods’ to be worked through. Tracey Berry our customer experiences DC provided an overview of her team’s work to support successful students. The involvement of students as co-creators of various processes and systems is the main approach. Then Tony Grey our CE provides summary of strategic direction through building and support of climate and culture, moving from good to great, forming and continuing community and belonging, increase responsiveness, innovation and sustainability. Belinda DCE for People and culture than summarises the stategy to empower our people for tomorrow’s world. Dean our Chief financial officer summarised his role in resourcing the many current and future initiatives. Te Marino Lenihan, Ara kairahi used the harakeke bush as the metaphor for the importance of supporting the improvement of success for Maori students.

Then a series of workshops 7 workshops convene. The workshops centre around AIR activities including assessment, programme evaluations, programme development, teaching and learning plans, and online teaching and learning.

I participate in the session on assessments, with Glynnis Brook, manager for portfolios and assurance and facilitated by fellow educational developer Jane Bates. The session was an opportunity to review the development of powerful and authentic assessments. Began with reiterating that assessment is for gathering information and also evaluation as the interpretation of the information gathered. A good discussion eventuated around the difference between summative and formative assessments and the need to explain the importance of formative assessments to students. Overviewed the principles of assessment and practice.

After lunch, two sessions of workshops of 45 minutes each follow.

In the first round, topics include developing cultural capability, getting started with research, AR/ VR, innovation, inquiry base teaching and the students’ portal MyAra App.
The second round of sessions include getting research published, e-assessments for learning, neuroscience of emotions, agile development of programmes, Microsoft tips.

Firstly, I joint facilitate the session on getting started with research with Dr. Isabel Jamieson from Nursing. We collect questions from the participants, sort them into ‘themes’ and workshop the answers, using the available institutional resources.

Then, facilitate the session on eassessments for learning  - as an output of the Ako Aotearoa and NZQA funded project. The session workshops using templates for designing assessments of learning and how to match the learning outcomes to the types of digital tools which are relevant to provide the most useful forms of feedback.

The event closes with a wrap up with George. Thank you to all the presenters and the planning team.

A good opportunity to network with colleagues from the different campuses and catch up progress on various projects completed over the last few years. Also important to reinforce the organisation messages and policies so that the institution is in a good position to connect with or critique the outcomes of the coming NZ Review of Vocational Education (ROVE) announcements.

Monday, December 17, 2018

2018 review


Another busy year is about to close. Despite there being a smaller number of educational developers this year, programme development has proceeded well.

The programmes I have supported through the programme design process, have all attained approval from NZQA. These include reviewed degrees in Computing, Midwifery, a brand new Master in Sustainable Practice qualification and reworked Level 5 and new level 6 diploma in Interior design. Added to these have been ongoing support of the Construction Management degree and the development for a Post Graduate qualification in Building Information Modelling (BIM) which will be going to NZQA early next year.

The National project funded by Ako Aotearoa on e-assessmentsfor learning has officially ended. The report has been peer reviewed and should be up on the Ako Aotearoa website next year.

Publications have been less this year due to the work in completing the large e-assessment project. There have been 2 book chapters – one on work integrated learning in the book –Integration of VocationalEducation and Training Experiences: Technical and Vocational Education and Trainining: Issues, concerns and prospects, published by Springer.

The other, a chapter on perspectives of beginning trades tutors on teaching and learning in the book – Teaching and Learning forOccupational Practice: A Multi-Disciplinary and Multi-level Perspective – published by Routledge.

Apart from presenting at the Ako Aotearoa projects in progress colloquium, there have been presentations on the findings and outcomes of the e-assessment project at two Australian conferences (AVETRA and NZVET and NCVER nofrills) and at the Ako Aoteroa Academy Talking Teaching conference.

I look forward to another busy year next year.

Friday, November 30, 2018

Talking Teaching 2018 - DAY 1 afternoon



After lunch, another round of parallel sessions.

First up, a session with James Oldfield from Unitec with ‘empowering collaborative learning through technology’. James used www.mindmeister.com as a platform and polleverywhere - pollev.com as a platform to obtain initial understanding of collaborative learning from the participants. Provided rationale for his approaches for creating ‘a living curriculum’ and his role in transforming teaching practices, spaces and tools at Unitec. Interactive activity to populate a mindmap on ‘collaborative learning’. Participants populated and discussed mindmap.

The support Lyn Williams from Ara Institute of Canterbury in her campfire session on ‘teachers observing teachers. Lyn introduces the process (the background, the why and how) and shares the presentation with the teacher observers, Mandy Gould (hospitality) and David Weir (computing) who share their perspectives. A discussion session ensued with regards to the items presented.

I then run my workshop on ‘e-assessments for learning – matching digital tools to enhance e-feedback’. Basically to try out templates for the development of aligned e-assessments for learning which support e-feedback.

The day closes with drinks and dinner, Professor Phil Bishop provides the dinner presentation with ‘how to survive in the jungles of Borneo with a bunch of undergraduate students’, music with Jane Nevis and there is the return of the academy quiz game. A late finish to a busy day. 

Thursday, November 08, 2018

Ako Aotearoa National funded projects (NPF) 2018 Colloquium

Yesterday, I presented at the annual hui of the researchers involved with Ako Aotearoa Nationally funded projects held in Wellington. Each project reported on work in progress with several who are close to or have been completed, providing overview of their projects

Colloquium begins with welcome and powhiri with Dr. Joe Rito. Helen Lomax, Ako Aotearoa Director then sets the scene. Dr. Beatrice Dias-Wanigasekara, research projects manager, also extended her welcome and MCed the colloquium.

First presentation is with Adelaide and Doug Reid from Community Colleges NZ on ‘learner access and pathways: youth guarantees, educational outcomes. Project started in 2015 and presentation covered the surveys of youth guaranteed students. The project sought to find out the profiles and longer term effects of the programme. Focus groups and individual interviews also collected perspectives. Themes identified include: the need for self development; having control; fitting in and belonging; the importance of networks and supports; and provision of direction and stability. Identity development was a significant part of transitions (there were multiple transitions), which were complex and context dependent. Skills (communication, collaboration, self-management, learning to learn and job attainment skills), not qualifications assisted in young people staying and progressing in employment and education. 3 interim reports are on project website.

Next up, ‘Set for life – best practice guidelines for vocational education and training for NZ’ presented by Ken Eastwood, Nigel Studdart and Sarah Rennie from Skills Organisation. Project was commissioned by the Tertiary Education Commission (TEC) and co-funded with Ako Aotearoa. Studied transition in Northland / Auckland. Ran for a year from mid 2016 to mid-2017. Hands on action research with focus on support of young people into work in the electrical and plumbing and the primary industries. Summarised progress to date detailing the complexity of transitions and disconnect between needs of employers / industry and schools. The project bought together the range of networks, industry and providers to improve the transition of school leavers into work. Learners appreciated ‘someone who cares’ and assistance in ‘finding my way’. Families were powerful influencers. Needs for engagement in learning were context specific. Transport to work was a defining factor with regards to continuance. Employers’ viewpoints were collated and included the importance of matching the learner to the right workplace. Schools’ needed to make sense of the transition space which was congested and complex, with some schools focusing more on NCEA credits rather than the learning required to achieve employment success. Funding was an issue for providers and ITO as to how completions could be recognised. ITOs are not funded to work in the transition space but may be effective if this occurred. Developed ‘tools’ including Set4 life navigators and the development of a co-designed programmed between iwi , PTE, Northtec, BCITO, Kaitaia College and the Far North Community.

Then, Pania Te Maro and Liz Kohonui from Te Whare Wananga oAwanuiarangi on ‘Ka nanakia hoki ‘ki’ te numeracy: better than expected’. This project studied the design of a tool to assist with modelling the teaching and learning of numeracy. Objective to test the approach of tapping into learners’ personal experiences to assessments to provide a holistic perspective towards progressing further. Traced akonga’s maths education histories and maths identities and help them to work out what they need to learn and how they can learn these. Pilot investigated so the project is in its first stage.

After morning tea, 7 presentations!! Presentations are 15 minutes each with questions after 3 presentations.

Neil Ballantyne (Open Polytechnic) and Dr. Jane Maidment (University of Canterbury) on enhancing the readiness to practice of newly qualified socialworkers. Currently undertaking the 3rd phase of this project. Phase 1 was a curriculum mapping exercise to find out what was taught from students and educators. Gaps were identified in health as greater emphasis placed on child welfare. Phase 2 then surveyed newly social workers and managers to find out what when well and what did not occur to prepare them for work. Knowledge of mental health was identified by both recent graduates and managers as a requirement. Phase 3 is to construct an inventory of candidate capability statements through workshops with stakeholders. Used the world café approach to gather perspectives of participants on a draft. Feedback and negotiation on the draft capabilities framework through consultation with key agencies will then be undertaken.

Followed by Anne Greenhalgh from Workforce development Ltd. With Dr. Lesley Petersen on ‘establishing communities of practice: a pedagogy development mechanisms for teachers in the NZ private training establishment (PTE) environment’. Worked with tutors in 3 PTEs teaching youth guarantees students. The project assisted tutors to share teaching practice and to develop more effective teaching. Meetings every 4 months to engage in critical reflection on their practice. Used reflective competence as a framework. The aim is to produce a COP implementation guideline which will be useful within the PTE context, COP training workbook and session guide, and reflection template.

Then ‘a cross disciplinary comparison of the approach todeveloping work ready plus graduates’ with Dr. Qilong Zhang and Meghan Ruha from Toi Ohomai Institute of Technology. This is a project that started 2017 and completes mid-2019. Disciplines involved are Health study, creative technology, early childhood education, management and carpentry. Currently looking into implementation of models as they pertain to each discipline. Focused on finding out HOW the models can be operationalised. Emphasis placed in each discipline area on different skill sets. There is importance in making the expectations visible to learners and in providing teachers with opportunities to reflect on what the actual skills define their discipline.

Mark Williams from BCITO on ‘how employers have influenced the participation and success of women in the trades where they are traditionally under-represented’. This is the second part of a three part project. This phase sought to identify the characteristics of employers who have or have not employed women; the enablers and barriers to participation; and resources that may be useful to break down barriers to participation. Benefits of having women in the trades include ability of women to pay attention to detail, more care with equipment and tempering blokey behaviours. Barriers included lack of physical strength, may become pregnant and not enough women apply. Found the presence of unconscious bias and recommends some changes in employer behaviours and beliefs. These include advertising online, offering work experience, identifying supporters in the workplace, flexible work options, train and mentor staff and embracing both gender and ethnic diversity. Shared video developed to support the recommendations.

Dr. Eruera Tarena, Dr. Porsha London, Sharon Armstrong and Piripi Prendergast from Tokona Te Raki – a Ngai Tahu initiative working on establishing equity for iwi - present on Hutia te punga (lift up the anchor). The project works with 3 providers to co-construct and implement Cultural Responsiveness Professional Learning and Development (CRPLD). Project began this year and is half way through the process. Presented on the frameworks informing the work which is to work at the deeper causes then to just ‘fix the symptoms’. Co-construction involves bringing values and beliefs of students and their tutors to address poor retention of Maori students in their programmes. Need to confront practices as what we say we will do, is often different from what actually takes place. Provided details of the CRPLD programme, initial themes and reflections on what has been achieved and what still needs to be done.

Followed on by Laloifi Ripley from Careerforce and Dr. Nicky Murray and Anne Alkema from the ITF on ‘Hinatore: upskilling Maori and Pasifikaworkplace learners’. The project investigates the teaching and learning processes in workplace learning literacy and numeracy programmes that support successful outcomes for Maori and Pasifika learners. 10 workplaces base in Auckland are involved along with 5 providers. The project works with the tutors. Pre-programme data already collected and now collecting post-programme data. Supporting tutors as researchers to enable them to use evidence to improve their practice. Workplace programme details provided. Discussed the need to be respectful of the data and to not impose pre-negotiated data analysis framework on it. Draft framework introduced to honour the data based on ako, mahi and whanau.

Completed project presentation with Associate Professor Leonie Pihama’s and team from University of Waikato project ‘he tatua o kahukura’ is undertaken. Provided a quick overview of the project which is to support Maori scholars’ post-doctoral pathways. 7 sites participated. Then shared the findings and recommendations.

After lunch, I present on the e-assessment project. The guidelines, derived from case study of the seven sub-projects are summarised, along with the research approach and the frameworks informing the project. The final report is in peer review and discussions with regards to dissemination have commenced. In essence, digital tools provide opportunities to gather, collate and work through feedback for learning, assisting learners to progress their learning. Feedback may be from digital tools, the learners, their peers, and their teachers / other experts.

Four more projects presentations follow.

Firstly, Professors Lynne Taylor and Ursula present on their project ‘the making of a lawyer: a longitudinal study. This is a 5 year study with 5 universities to work out the work readiness of NZ law graduates. Across the years, no difference in motivations and values but drop in levels of interest in pursuing a legal career. Drop in lecture attendance but increase in participation in active learning activities. Less time spent in self-study that expected and little change in self-study approaches. There was a low level of f2f contact with teachers outside class. At the end of year 4, very few students reported their tutors knew them. Students reported good grades, increasing levels of confidence of passing over time. Shared interventions put in place to address the findings from the project.

Then, Professor Cherie Chu from Victoria University and Janice Ikiua-Pasi from Weltec/Whitirea present on their project ’10 habits ofphenomenal educators for Pasifika learners’. Used appreciative inquiry to change practice for tutors to engage with and work well with Pasifika learners. Study sought to understand better, how Pasifika learners learn best. Then to apply these towards informing teaching and learning practices that will support Pasifika learners.

Followed on with Dr. Emma Wolfgram-Folaki and Dr. Hinekura Smith from Auckland University present on ‘He vaka moana: navigating Maori student and Pasifika student success’. Reports on a support project which connects beginner academic and professional leaders in teaching, learning, assessment and research at Auckland University and Unitec. 8 fellows (including support staff and academic) supported across this year. PD workshops covering ethics application, writing etc. provide ongoing support through the year.

The Pasifika learner success theme continues with presentation from Sam U’tai from Ara Institute of Technology and Ashlyna Noa (University of Canterbury). An evaluation was undertaken of a Pasifika Resource kit developed through a joint project with Lincoln University and University of Canterbury. This is the 3rd project completed in March this year. The 2nd project recommended change in academic spaces; student services; and Pasifika visibility and the kit was developed to put into practice, the changes recommended in the 2nd project. Found the kit assisted with transforming teaching and learning; improved support for Pasifika students; promoted and celebrated Pasifika diversity; and provided support for staff to increase cultural responsiveness through implementation of specific strategies.

Summing up and reflections is presented by Ian Rowe.

Farewell and poropoaki follow.

Before the colloquium ends, here is a celebration of 2 completed projects (Taikaka with Professor Jenny Lee-Morgan from University of Auckland and Te Whaihanga with Professor Dory Reeves also from the University of Auckland).

All in, a day packed with many and varied presentations. There was a sense of camaraderie across the researchers. Also, always good to catch up with work in-progress which represents teaching and learning across the NZ tertiary sector. Projects were led by Wananga, ITPs, provide providers, ITOs and Universities with several cross sector projects. 

Monday, September 10, 2018

Exploring the theory, pedagogy, and practice of networked learning – book overview



Published by Springer 2012 - so already somewhat dated, as technology enhanced learning and networked learning has shifted. However, the salient principles still apply. 


Introduction and conclusion with 5 other parts – developing understandings of networked learning; new landscapes and spaces for networked learning; dynamics of changing tools and infrastructure; understanding the social material of networked learning; and identity, cultural capital and networked learning through 17 chapters.

The introduction, by the editors, provides ‘a brief history and new trends’ in networked learning’.
Provides a summary of various initiatives from the 1980s to the present including the shifts in understanding and supporting learning. The emphasis of the overview is on various efforts to create platforms for collaborative work and learning. Sets out the pedagogical framework for networked learning as: openness in the education process; the affordances for self-determined learning; a requirement for a real purpose in the collaborative process; a supportive learning environment; collaborative approaches to assessment of learning; and assessment and evaluation of the ongoing learning process. Then provides a summary of the various sections and chapters.

Part 2 – developing understanding of networked learning continues the theme from the introduction with two chapters

C. Jones writes on ‘networked learning, stepping beyond the net generation and digital natives’. Begins by critiquing the premise of current students being different from previous due to their exposure to digital technologies. The study supporting the various recommendations in the chapter were completed almost 20 years ago, so the current advances in mobile technology, were not tested. However, the chapter recommends that an open mind is important in any future work. Depending on informal observations i.e. that digital natives exist, distracts from the important emphasis on learning.

An important chapter by T. Ryberg, L. Buus and M. Georgsen, discusses the ‘differences in understandings of networked learning theory: connectivity or collaboration?’ Discusses the many nuanced and individually constructed meanings of connectivism, collaboration, communities, negotiation of meaning, social practice, etc. Makes links between networked learning and connectivism. Networked learning is used more by European researchers and connectivism by North American, evidencing the roots of these two concepts. Clarifies what networked learning refers to. Networked learning is not only about elearning but about the connections made between people and between people and resources. Learning is a social endeavour, with knowledge and identity being constructed as interactions are undertaken through dialogue and interchange of ideas and perspectives. Networked learning is about the connections and interaction. There are many similarities between networked learning and connectivism. However, connectivism focuses much more on the individual and how they connect with the world outside of their own purview. Knowledge is related more to content than to connections and is seen to be outside of individuals’ minds but accessible when required. There is a good critique of both networked learning and connectivism.

Part 3 has 3 chapters around the theme of ‘new landscapes and spaces for networked learning’. This part provided examples and their empirical outcomes.

Chapter 4 by D.D. Suthers and K-H, Chu is on ‘mediators of socio-technical capital in a networked learning environment’. Example of using wikis and discussion forums, framed by concepts of using these to bridge socio-technical capital challenges.

Then a chapter on ‘collectivity, performance and self-representation: analysing cloudworks as a public space for networked learning and reflection by P. Alevizou, R. Galley and G. Conole. Cloudworks have been around for some time and is a LMS developed to support collaborative learning. The platform is anchored by core learning activities which support constructive and socio-cultural learning approaches. Instead of resources, there is emphasis on using ‘situations’. Students bring their collective experiences and learning to the courses and engage in ‘expansive learning’. The indicators of community are participation, cohesion, creative capability and community identity.

J. E. Raffaghelli and C. Richieri contribute the next chapter on ‘a classroom with a view: networked learning strategies to promote intercultural education’. This is another important chapter. It provides a case study of a programme, to introduce and support intercultural study across several countries. Envisages networked learning as a means for equal-but-diverse people to meet, connect, collaborate and complete projects. Used the concept of ‘a matrix of knowledge’ to frame the sense-making approach for building intercultural dialogue. The metaphor of the ‘networking platform’ as a window into and reflection of one’s own and others’ cultures was seen to be supportive of the process.

Part 4 is on ‘dynamics of changing tools and infrastructure’ with 2 chapters.

There is P. Arnold, J.D. Smith and B. Trayner on ‘the challenge of introducing “one more tool”: A community of practice perspective on networked learning’. Uses 2 case studies of the Workbench A- a community of practice in the Agricultural development field and Workbench b- community of distance learners in higher education as examples. Finds it is just not ‘changing a tool’ or ‘adding another tool’ but the many other parameters. These include how the tool changes whose voice is heard, whose voice can be legitimately brought forward, how competence is negotiated and overall, what matters in the community the tool is being used in. So, many agendas are impacted when a tool is changed as the change brings about a re-negotiation of what constitutes the community.

Then, T. Nyvang and A. Bygholm on ‘implementation of an infrastructure for networked learning’. Human centred informatics, which updates the work of Vygotsky to be relevant to contemporary practice, is used as a framework for implementing infrastructure to support networked learning. Dilemmas had to be unpacked depending on whether goals and technology were certain or uncertain.

Part 5 also has 2 chapters on the theme of ‘understanding the socio material in networked learning’.

T. L. Thompson contributes to the discussion with ‘who’s taming who? Tensions between people and technologies in cyberspace communities. Advocates for the use of Actor-Network theory (ANT) to help understand how aspects of materiality, impact on how people use, relate to and work with technology. Network effects may be unravelled through each of the four ANT concepts – passages, translation, socio-technical constructions and black boxes.

The second chapter in this section is from L. Creanor and S. Walker on ‘learning technology in context: a case for the sociotechnical interaction framework as an analytical lens for networked learning research. Argues for the use of sociotechnically in understanding how networked learning –pedagogy, technology and agency, may be constituted.

Part 6 has 6 chapters around ‘identity, cultural capital and networked learning.

Chapter 11 is by J. Ross on ‘just what is being reflected in on-line reflection? New literacies for new media learning practices. Uses blogging as the basis of study and argues for the need to ensure that new literacies and part of networked learning approaches. In part, due to the ways in which blogging is undertaken.

Then, L. Czerniewicz and C. Brown with ‘objectified cultural capital and the tale of two students’. Uses Bourdieu’s framework – field, habitus and capital – to explore and contrast two cases. The digital elite and the digital stranger.

The next chapter is on ‘how do small business owner-managers learning leadership through networked learning?’ by S.M Smith. An evaluation of the Leading Enterprise and Development (LEAD) integrated learning model for SMEs.

Chapter 14 is on ‘innovating design for learning in a networked society’ by K. T. Levinsen and J. Nielsen. Presents the re-working of Dorso’s model – modes of working across relational and complexity axis, to understanding innovative design for learning. Identified the sharing and uncertainty barriers of an approach (role-play scenario used as an example) and the challenges posed to roles / actors including tacit/qualified knowledge / rhetorics ‘sweet point’. Rationalised the choice of interactive design life cycle model – starting with identification of specifications and needs, design, physical design and test / evaluation.

Next chapter is with J. L. Nielsen and O. Danielsen on ‘problem-oriented project studies: the role of the teacher as supervisor for the study group in its learning process’. Identifies and discusses teacher roles – teacher as expert and instructive supervisor; process supervisor; and social mediator. Uses a case to unpack the nuances of each role.

Last chapter in this section is on ‘life behind the screen: taking the academic online’ with S. Boon and C. Sinclair’. Reports on the experiences of academics, shifting into the on-line environment. How language, identity, engagement and time shifts and how this aligns with the students’ perspectives of projection, performance, audience and content.

The last part, is the chapter concluding the book by the editors titled ‘the theory, practice and pedagogy of networked learning’. Focused on the ontology, epistemology and pedagogy of networked learning. Summarises the pedagogical values that underpin networked learning. Including implications for learning, teaching and the assessment process. There is a bringing together of the themes presented across the various chapters in the book.

Overall, the book provides background and rationale for networked learning. The various chapters, report on the ways networked learning is contextualised across different cultures (albeit, Western perspectives); school / tertiary institutions and workplaces; and technology approaches. The importance of the book is in setting up frameworks for networked learning, including defining the term and suggested models for practice.



Friday, August 17, 2018

NCVER no frills and NZ VET research forum day 3 afternoon

Four concurrent session themes today, apprentices and trainees, young people, policy and skills needs.

First up, I catch up with Kylie Taffard’s (BCITO) women in trades project. Project funded by Ako Aotearoa and came about due to high demand for trades people. Covered how women have succeeded in non traditional trades. Focused on the women supply scope and undertook to understand how women engage in trades. Presented rationale, background and the qualitative research process. Interviewed 34 women across industries and at all stages of training and work. Thematic and inductive analysis to identity themes. Characteristics of women entering the trades included range of ages, ethnicities, location but the main similarities were affinities to active and physical work and job satisfaction. Many fell into the trade, had to do their on research to find out about the work. Many experienced low pay or poverty and trades provided good income. Some followed a passion and male relatives were role models. Schools not always supportive of trades pathway. 
Need to make trades training more visible to young women. Pre trade programmes were useful as a start. Mixed programmes provided initial introduction to work in male dominated work environment. Work experience especially important to consolidate career paths. Finding work post pre trade programme was a challenge. On job support from employers and ITOs similar to other apprentices. 
Recommendations were shared. Developed persona to help characterise the women. 

After lunch. I present, with  Cheryl Stokes from Ara Institute of Canterbury, the guidelines from the eassessment project. In essence, summarised briefly the project rationale and underpinning framework of connecting graduate profiles to the aspect of becoming. Overviewed the importance of feedback in contributing to vocational education and the  affordances conferred by digital tools to assist with the process. The guidelines that are distilled from the project also presented. In particular, the need for digital fluency from both tutors and learners and to make learning overt in the learning activities.

Stayed  in the same room with Deniese Cox, Griffith University, on  pedagogically framing VET online. Started with personal background and presented on PhD study. Provided rationale including VET not having much research on online learning. Teaching online is different from teaching f2f. Defined teachers, online learning and pedagogy. Project investigated how online VET teachers teach and if knowledge of online pedagogy will support developing of improvement strategies. Pedagogical orientations are from teacher to student centred. Often pedagogical orientation may not align with their pedagogical practice. This gap may occur for many reasons including logistical, organisational and technological. Shared findings including participant demographics, personas developed to illustrate the pedagogical approaches and survey showing actual pedagogical practice. Used Berge’s model of instructor rules and Bain’s what the best college teachers do, as questions to establish participant pedagogy. Influences on matching pedagogical orientation to practice include class size, units of competency resources which are not developed for online and workload. Teaching seen to be sidelined to assessments. 

After afternoon tea, with Geoff Crittenden from Weld Australia, on the future of technical training focused on Augmented reality training for welding. Explained link between TAFE and Weld Australia and the importance of VET. Welding learning similar now as 100 years ago. Video of Boxford augmented reality welding simulator. Specifications for Soldamatic augmented reality training. With AR, learners can do 10 tries compared to 4 in a TAFE welding workshop. Gamification element in the exercises based on analytics from each run. Health and safety not an impediment. Learning from mistakes also less costly as no physical materials used. Peer learning possible as peer can watch process on the screen to provide feedback. Advantages are accelerated learning, savings with consumables and higher completion rate. 

Last presentation with Dr. Karen Vaughan from the NZCER and Andrew Kear from the Building and Construction ITO, on Analytics and insights: developing a tool to support building and construction apprentices’ completion. In conjunction with the BCITO, a tool is being developed to provide predictive analysis on apprentices’ completions. The presentation focuses on the identification of factors influencing non-completion and evaluative data from apprentices, employers and training advisors, used to improve each iteration of the tool. Karen provided context and information on NZCER and Andrew on the BCITO. Shared statistics on completions and withdrawals and non-completions. Large numbers of withdrawals are in the first year. The learner success project is to develop a health profile tool to focus on likelihood of completion. Needs to also allow for different ideas of success and provide advise for learner support. Project seeks to identify influences, collect data and refine and calibrate. Discussed challenges including methodology, ethics and data integrity. 


A busy but informative conference. Official sessions closed with award for best poster and handover to the 2019 hosts in Adelaide - July 10 - 12. 

Monday, July 16, 2018

Cork dork – book overview


This book, the Cork Dork by Bianca Bosker, came via GoodReads recommendation. There is a positive review from Decanter - wine industry magazine; overview from the NYTimes; and a less glowing report, here - which surmises the book encourages wine noobs to ignore the snobs, just drink cheap wine! 

I tracked the book down at the local library and read it over a wet weekend. One of the sub-projects from the recently completed e-assessment project, was to help cookery students learn how to taste. As tasting was deemed to be something ‘everyone is able to do’, the cookery teaching team did not place much emphasis on overtly teaching students how to taste. Learning how to taste like a chef, was therefore chiefly learnt through modelling from the chef tutors.

The chef tutors only realised that students were unable to articulate the sensory evaluation of dishes when students were required to reflect on the cooking process of dishes as part of the evidence gathering towards collating eportfolios. The researcher for this sub-project, is a food and beverage tutor, who had come from the tradition of being taught how to taste wine. Part of the project, was therefore to try to make overt and structured, the ways food tasting could be described. Mindmapping and notetaking apps were introduced to assist with learning the ‘language of tasting’. These apps were to facilitate the sharing of dish descriptions and evaluations to assist students to widen their sensory evaluation vocabulary.



Back to the book, which has 11 chapters, tracing the journey of the author, from novice / layperson to practicing sommelier. The author was able to make a head start using her contacts as a tech journalist and with the rationale of the book as a lever into the rarified world of professional wine tasters. Being a sommelier entailed not only being able to taste wine, but also to sell it, provide good service in fine dining restaurants and gain a foothold into a challenging but well-paid occupation (when compared to other hospitality work).

To begin, the author managed to gain an entry level job as a ‘cellar rat’, assisting with the storage and re-stocking of a wine cellar in a prestigious restaurant. She was able to make friends with several well-known sommeliers and join them for their tasting sessions. This led her to prepare for the first level of accreditation to become a sommelier through eligibility to take the Certification exams.
By the end of a hear, the author was working as a sommelier in a wine bar, had passed the first of a series of professional exams, and also established, through a fMRI scan, that her brain reaction to wine, was similar to experts. So the year of hard graft, tasting many wines and learning the esoteric knowledge components of wine making, had triggered a change in her brain structure.

The perceived method towards training the brain therefore, begins with training to smell. ‘Stocking the sense memory’ was essential to being able to connect the descriptive wine terminology, with tasting and identification of wine. The patterns of taste has to be organised, so the patterns connect with wine types, grape varieties, regions etc. Apart from learning how to taste wine, service of wine required skill training through repeated practice and an understanding of the psychology of people’s social relationships.  In short, sommeliers really have to work for their pay.

Overall, the book provides a good insight into how a novice, learns a complex set of skills, connects the sensory sensations to a large bank of knowledge, and utilises these in a demanding occupation. A sommelier, is the sum of all of these and each, brings into the job, their own personality and characteristics as well.

All in, a good read and a relaxed way to learn much about the world of wine.


Monday, December 04, 2017

Reflection - a week of conferencing

Two conferences last week provided some time away from the usual busy work routine. Importantly, the week allowed for time to catch up with others practitioners, passionate about helping learners. Always energised after a week away by presentations on applying precepts of good learning, to various approaches and strategies to assist learners.

Things that would be helpful for my own practice as an educational developer and researcher include:

- need to understand the exigencies of teaching from the experiences of teachers and students. For teachers, is to be empathetic with time-pressured and resource lean situations. To build good relationships with teachers and to provide possible solutions which are doable. Thinking through, together (teacher and ed.developer) to agree on a goal and to work towards the objective in small achievable steps. The 'inquiry cycle' as small interventions, each informing another cycle, has been a major plus for the e-assessment project.
For students, it is important to 'make the learning visible'. Too often, students do not know WHY they are having to engage in a learning activity or assessment. Learning outcomes require iteration throughout a course, not just at the start when the course outline or equivalent is waved in from of them, or they are told that the course outline is to be found on the institution's learning management system! Students are time jealous and will only do what is required to 'pass', but many do not actually learn, let alone change behaviours, attitudes or perceptions.

- There is still limited understanding across the ITP and ITO sectors, of the implications of NZ qualifications being graduate profile based. To some, the graduate profiles just add another layer to a complex schedule of atomised and siloed assessments! Moderation, in particular post - moderation of assessments, is still seen to be the checking of content covered :( Hence 'consistency arrangements' whereby qualification deliverers have to rationalise how their graduates meet the graduate profiles, are seen to be another assessment moderation process (aargh).

- Still confusion as to WHAT are assessments FOR learning. Calling them formative may not always be correct. Requirements to have summative assessments for courses, makes it difficult, in time poor courses, which are filled with content, to 'fit in' assessments for learning. There needs to be more work done, to help teachers understand how to 'design' and develop assessments for learning which provide benefit to learners. Exemplars across various discipline areas may be helpful.

So, much work still to be done. However, above provides a tighter framework to report on the e-assessments for learning project. the project 'guidelines' will need to provide:
- connection between assessments for learning and qualification graduate profiles
- examples of assessments for learning across several discipline areas
- comparison of assessments for and of learning for these discipline areas
- approaches to learning appropriate to required knowledge, skills and attitude learning
- links the above to constructivist (intra-psychological) and socio- cultural / socio -material (inter-psychological) learning
- templates for decision making  / design of assessments for learning as connected to approaches to learning
- Learning 'activities' suited to meeting holistic attainment of graduate profiles i.e. problem/inquiry- based, projects, portfolios etc.
- how to match these with appropriate technology to enhance student learning

Above provides a way forward for thinking through over the summer :)