Showing posts with label critical thinking. Show all posts
Showing posts with label critical thinking. Show all posts

Monday, May 18, 2026

AI is not the answer, it is how it is used to support learning which is the key

 Some learning from chalkbeat, reporting on why the Khanmigo chatbot has not yet met its promised goals. 

Three years ago, an AI chatbot was launched in Khanmigo. Uptake by students has been lukewarm. The Khanmigo chatbot was used by students to find answers, rather that as a 'study buddy'. The key seems to be, as always, to educate students, rather than for them to just try things out. 

A recent German study to evaluate the relationship between AI-chatbots, student assessment performance and learning outcomes in Higher Education,  The findings indicate that students may be able to complete tasks faster, but not better or lead to higher grades.

Again, it is important to plan carefully, the objectives of using AI to support students. Are the chatbot/agents used to support learning? If yes, what are the specific learning objectives? Is the chatbot/agent 'ring-fenced' sufficiently to actually support the attainment of the learning outcomes? In our current projects, we need to be very clear about how and why the chatbot/agent is being utilised. This helps delimit the range of the chatbot and to ensure that it stays on task and does not deviate from its assigned objectives. 


Monday, May 11, 2026

AI in education - reading the literature with a critical eye

 The numerous publication around AI in education has made it somewhat challenging to keep up with. My Google Scholar alerts collates around 10 articles every day. Other sources of reading include recommendations via various LinkeIn posts, blogs I follow, news articles and other media, and alerts from various journals. There is therefore an avalanche of material on the topic!

However, there is still a distinct gap in work from the vocational education sector. The book 'Artificial Intelligence in Vocational Education and Training' which I edited, has had over 4000 downloads. A favourable book review in the International Journal of Training Research has helped with bringing the issue of applying and leveraging AI into the specialised context of VET. More can be done, and I have put forward another proposed book to publishers, to record how the sector rises to the challenges posed by AI. VET cannot ignore AI, given its primary goal is to prepare its graduates for the world of work. All VET needs to cover Core AI literacies to ensure that VET graduates lead their industries into the ethical, principles and careful use of AI across occupations. 

There is also a need to draw on the current corpus of work on AI in education. Code Acts in Education blog warns of being circumspect with regard to publications, often spread through the blogsphere and other social media. There are also many pre-print articles being disseminated through various channels which are in the process of peer review. Recent recantation of articles due to faulty methodology also raise flags. The blog is worth reading through for the many ways in which fast, rapid publishing, is detrimental to the credibility of sound research.

Therefore, it is important to carefully evaluate articles, be patient and wait for articles to have cleared the peer review process and be published, and keep an eye on article retractions! 




Monday, January 27, 2025

Developing curriculum for deep thinking - book overview

In this 'age of AI ascendence'  more than anytime perhaps in human history, the importance of how we learn knowledge and what is required to learn it, is more important than ever.

This Open Access Springer brief - Developing curriculum for deep learning:The knowledge revival has chapters written by authors from Europe (T, Surma, C. Vanhees, M, Wils, J, Nijlunsing, N. Crato, D, Muijs, D. Wiliam, P. A. Kirschner) Australia (J. Hattie) and New Zealand. (E. Rata).

Although the chapters have the school context at the forefront, the many concepts introduced and discussed has relevance across the all educational sectors. The books main premise is that it is important to ensure curriculum is 'knowledge-rich'. In doing, the attainment of knowledge helps to drive the learning (acquisition and practice) of crucial cognitive or thinking skills. 

There are five chapters.

After a short introductory chapter the following chapters discuss:

- How knowledge matters

- knowledge and the curriulum

Then two chapter - concluding remarks and an executive summary close the book.

Therefore the book is a short treatise (less than 100 pages) presenting the argument for the importance of ensuring that knowledge is made visible across the curriculum, and the need for content richness, coherence across the curriculum, and clarity of purpose for learning knowledge. 


Monday, October 07, 2024

Critical Thinking and Ethics in the Age of Gen AI

 A report from the USC Centre for Generative AI and Society on Critical thinking and ethics in the Age of Generative AI in education

Brings together perspectives on Gen AI and its impact on critical thinking and ethics.

After an introductory chapter by Pedro Noguera, there are seven chapters organised into three sections.

Section 1 - supporting college students' critical thinking in the age of AI

3 chapter discussing the promises and perils of using AI in college classrooms and a chapter on undergraduate perspectives on AI

Section 2 - AI in K12 classroms - ethical considerations and lessons learnt has 2 chapters.

Section 3 - building the next generation of generative AI tools - with two chapters.

William Swartout on 'Generative AI and education: deny and detect or embrace and enhance and Benjamin Nye on 'authoring by editing and revising: considering Gen AI tools.

Short, practitioner focused chapters provide good overviews and discussion of the fundamental challenges brought in by the rapid rise of Gen AI. Pragmatic perspectives on adoption, introduction and utilisation are discussed. A resource to start conversations and utilise in workshops. Has American slant but many applications are generalisable. 

Monday, March 13, 2023

Ai and what it does to our critical thinking

 A cartoon on Planet Warriors sparked this blog post. The cartoon shows pedestrains, all concentrating on their phones whilst on the side, two robots read and learn. The cartoon reinforces contemporary life (see 2017 article by NY Times 'Hooked on our Smartphones) whereby people check their phones over 100 times a day and live a life which revolves interacting with the various messages and items delivered to their phones.

With the ascendency of AI and the present hype around platforms exampled by ChatGPT, it is important to understand the many challenges still faced by AI to 'replace' the essence of humanness. In particular, the ways individuals, with their knowledge-bases collated through life experience and how they comprehend and apply 'research' off the internet to their daily lives (see this techradar commentary for one example). Almost a decade ago, I read Matthew Crawford's book - The world beyond your head - (see here for overview) warning about how the distractions available and bombarding us through various media, creates a barrier for us to have time to reflect, ruminate, and think. The concepts in the book are even more relevant now, as we need to be even more cognisant of what we read, hear and see.

Critical thinking is now, more important than ever. Leveraging off AI is one way to draw on the advantages presented, but with the caveat of always carefully evaluating information presented to us through contemporary media. Cult of Pedagogy  recommends the use of ChatGPT as an 'example machine' to help students learn how to critique information gleaned off the internet. Instead of relying on AI to generate content for completing assignments etc. teachers should use AI to generate various versions of content, and use this to help students learn how to evaluate/judge what is valid and the quality of writing. This approach helps learners to contrast and compare 'good' and 'poor' writing helping them discern 'truth', accuracy of information, track back on assertions to locate collaborating references, learn how to write within disciplinary genres, and attain critical thinking skills which can be generalised to other aspects of their learning.

As usual, it is not the tool to be blamed but how we use the tool which is the important aspect to follow through. 

Monday, March 21, 2022

The foundation for critical thinking

 Preparing resources for research writing workshops and one topic we will be sharing is on the concepts underpinning critical thinking and how to apply this to academic writing.

This site on 'Critical thinking, where to begin'  is provided by the Foundation for Critical Thinking. It is a non-profit US of A organisation which provides resources, workshops/webinars, conferences, online courses etc. to promote the practice of critical thinking. Membership provides access to the entire range of resources but the site itself, provides good overviews and some guides.

The model provided is traditional and 'tried and tested'. The 'elements or reasoning' are defined along with the 'elements of thought'. These provide the 'process' for thinking through challenges and perspectives. 


Monday, November 30, 2020

Model thinkers - resource with infographics of many approaches to thinking/critical reasoning

 Via LinkedIn this morning, a link to a good resource on 'model thinkers'.

The resource provides infographics on a large number of 'mental models' as guides to be 'smarter, faster'.

The infographics are categorised into themes: 

Learn and achieve, collaborate and lead, make better decisions, deliver value, live well, industry knowledge. Each is further broken down into sub-themes, for example for industry knowledge into - creative, design, education and training, engineering, military, sales, science, technology, project management, finance, economics, entrepreneurship.

Some of the infographics are only accessible for members only but most of the 'mainstream' models are available for all.

Models include ADKAR change model, deliberate practice, hero's journey, prisoner's dilemma, SCARF, 5 whys etc.

Therefore a good 'one-stop' shop if you are keen to try other approaches to nutting out problems and challenges. 

Each model (when accessible) provides a brief overview explaining the origins and precepts of the model; a list of 'actionable takeaways'; and a 'toolkit' or worksheet/template to assist the carry through of the 'actions'.

Overall, useful for moving out of the rut and providing resources of 'pick and mix' problem solving.

Monday, September 14, 2020

Project Zero (Harvard University) thinking routines toolbox

 One of the aspects of the shifts in educational direction and strategy cased by the pandemics, is the need for all to be more circumspect and develop deeper critical thinking skills.

Without 'looking outside the box' we are doomed to repeatedly rely on the known when the current situation may require new ways of doing and being.

Alan Hoskin introduced our educational developer team to the thinking routines toolbox developed by Harvard's Project Zero. These thinking routines arise from a series of projects run through the Harvard Graduate School of Education for sharing with the wider educational community.

Although many of the projects are focused on school contexts, the learning from the many projects are applicable across all educational sectors. The entire website is always worth a look through for updated resources. 


Thursday, November 29, 2018

Talking Teaching 2018 - Ako Aotearoa Academy symposium - DAY 1 morning

This year, the Ako Aotearoa Academy symposium  - Talking Teaching 2018 - is held at the University of Canterbury. There is a larger than usual gathering due to the event being held in a larger city and an influx of a number of Australian Learning and Teaching fellows.

Yesterday, was an academy only day. The various workshops and discussions centred around the role and impact of the academy and its members on quality teaching and learning. The day concluded with dinner with the Australian Learning and Teaching fellows.

Today and into tomorrow, the main symposium carries through.

The event begins with a mihi whakatau (traditional Maori welcome). Professor Charles Fleischmann who is on the conference committee provides us with the safety and housekeeping briefing. Following on there are welcomes from Professor Catherine Moran, Assistant Vice-Chancellor of the university and Professor Marc Wilson, president for the Ako Aotearoa Academy of Tertiary Teaching Excellence.

The keynote address is presented by Professor Juliet Gerrard, academy member and recently appointed as the Prime Minister’s ChiefScience Advisor, She presents on ’beyond the tyranny of content – reframing our teaching using inclusive practices and critical thinking as essential foundations for learners in the 21st century’. Covered the parameters of her new role; the context of a teacher; and the connection between the two. Her current role is to be a trusted, accessible bridge between scientists, society and government. Needs to provide advice on a useful timescale which is rigorous, inclusive, transparent and accessible (from Nature, June 2018 – four principles to make evidence synthesis more useful for policy). Objectives include shifting society to be excited by science; had advice that is distilled from a diversity of thought and approach; earn trust; be proactive; accessible and view science knowledge and approaches to increase opportunities. Summarised her journey as a teacher to shift from content-based to application in a context. From her portfolio, distilled learning as being a ‘coach’, coaxing students out of their comfort zone, and creating a room in which questioning is encouraged. Used demonstrations to engage students and then made use of situated / contextualised learning. Facilitated an interactive Q & A session to work through the main challenges in learning. The challenges were how to create learning environments that support students to constructively challenge everything (using creative thinking); and Inclusive learning.
Parallel presentations then being. There are 6 streams.

I select the ‘technology’ stream, which actually focusses on digital learning and assesments.
First up, Associate Professor Cheryl Brown and Niki Davis from University of Canterbury with – engaging students in blended learning – UC student perspectives. Presented work for the team which also included Valerie Sotardi and William Eulatth Vidal. Began with the difficulty of defining engagement. Although there is a lot of literature and engagement is on a wide spectrum. Resolved to investigate the students’ perspectives. On-line engagement even more difficult to track. Two items are presence and performance. For online – learning analytics are visible but can be misleading. Clicking on a reading etc. does not mean they will have read the paper! What about the invisible. Provided distance student’s viewpoints. Flexibility makes synchronous attendance onerous, especially if presence requirements are required (attendance, forum participation etc.). What is not visible is the reflective learning; peer communications through social media; physical meetings amongst some students; etc. How to bridge the gap between pedagogical design and students’ learning needs and strategies. Suggested ensuring there is space for students to interact with their peers; undertake their individual learning; and work out what works for them from a range of suggested ‘pathways’ from which they can select and be guided through.

Then, Associate Professor Selene Mize from University of Otago with her experiences with computer-based examining. Presented preliminary findings. Ran through reasons for adopting computer-based examining – learner preference; sustainability; occupational health and safety around ‘hand fatigue’; and unreadable writing. Essay based exams are inauthentic as lawyers will never discuss ‘quotations’ in writing at work. Covered potential advantages and disadvantages. Summarised some of the studies around computer-based exams including the aspect whereby written examinations seem to score lightly better than word processed scripts. Detailed the staff and student surveys – law, anatomy, surveying, info science, tourism, political science. Low numbers of students opted in! Presented responses on perceived advantages and challenges of writing vs typing.

Next up, Associate Professor Jo Coldwell-Neilson from DeakinUniversity with ‘digital literacy – a driver for curriculum transformation’. Context is ophthalmology – which is a ‘self-contained’ programme with all courses being compulsory. Defined digital literacy in this context. For example – the ability to understand and use information in multiple formats from a wide range of sources when it is presented via computers (Gilster, 1997) –which needs to be updated for the current and future needs. Shared work defining digital skills expectations – digital muggle 9none), citizen user to find info, communicate and purchase), worker (complex platforms) and maker (programmer). There is work from UK JISC (6 elements – ict proficiency, digital creation, problem solving, communication and collaboration, learning and development and info data and media literacies – building an identity and welbeing), Belshaw’s 8 Cs (cultural creative, constructive etc.) and Beetham and Sharpe’s pyramid (I have, I cam I do, I am). Another model from Ireland – www.allaboardhe.com
To assess digital literacy, needs to be in context, can be assessed if integrated well – where it is taught, applied and assessed. Need to match what is required – explicitly assessed when it is an implicit requirement but not ‘taught’ e.g. use video to communicate.

Followed on by Renee Stringer - hospitality lecturer from Otago Polytechnic on ‘assessing assessment – challenging the system by giving students agency to assess themselves’. A focus not only on competencies but to help them become better learners beyond the Level 3 food and beverage students. over 50% move on to further study but have had little experience with tertiary education. Introduced the need to shift students from a standards based system to taking ownership of their learning and assessment. Needed to encourage students to engage with the marking criteria and to develop learning to learning skills. Authentic assessment (practical) was followed by a reflective process to evaluate their performance. Based on Mason Durie's 3 Ws or Es. Whakapiri / engagement, whakamarama / enlightenment to achieve whakamana / empowerment. When through each part of the model. Whakapiri / engagement involves setting up boundaries, be flexible and student accommodating and be in a safe and supportive environment. Whakamarama / enlightment focuses on providing information that meets students' needs by working with the whole person - physical, mental, spiritual etc. This then provides for whakamana / empowerment to be achieved along with participation within society, the Maori worldview, enjoy positive relationships and become self-managing. Discussed challenges including time required to negotiate grades with students and written reflections being less rich than f2f interactions with tutor. 

Tuesday, April 08, 2008

Critical thinking: what is it and how to assess it, a case for eportfolios

Late last week, attended a workshop convened by our staff development team and facilitated by Jan Kent.

I needed to work my through the various definitions of critical thinking and to update my knowledge on the role of critical thinking in applied vocational education. I had read Stephen Brookfield’s book on critical thinking as part of my M Ed studies and have dipped back into the book whenever I have found the need to clarify my understanding of how critical thinking applies to my own learning and research.

Jan used work by Stephen Brookfield and also the work of Jenny Moon to work through a definition of critical thinking and in particular provided examples of how critical thinking could be broken up into levels and types. Examples from Jenny Moon’s handout include a focus on Baxter Magolda’s (1992) epistemological development which identified four domains or stages. These are absolute knowing, transitional knowing, independent knowing and contextual knowing.

The group worked through several exercises to try to sort student comments and student work into the various stages of epistemological development. We also had a good discussion leading on from these exercises as to how to best assess ‘critical thinking’. There was agreement on the importance of sharing our understandings of critical thinking within our own teaching teams. There was also a need to ensure that students are then prepared for the level of critical thinking required from their programme of study.

From the point of view of my mlearning pilot, an eportfolio contains many aspects of critical thinking related to the collation of the portfolio. However the depth of critical thinking required is not unachievable by the majority of the apprentices who are constructing their eportfolios. I have provided guidelines on what is expected so the next step is to evaluate what we now have in the collections and to find out how I can nudge apprentices on to the next level. Which is to view their collection as evidence of their growing skill and knowledge as they become bakers and to then present their evidence in a way that shows their learning trajectory.