Sino NZ TVET educational research forum - proceedings

Proceedings, edited by John Clayton, from this year's Sino NZ Vocational Education and Training (TVET) conference are now available via this link to my paper which provides access to the entire document as well. The conference was held in Tianjin at the Hai He educational Park, visited last year.

I was unable to join the contingent this year but paper on using video to improve learning of skills and dispositions was presented by Debby Taylor, the hospitality tutor who has worked on honing the process over the last 3 years. Debby presented a 'demonstration workshop' of how the process worked, using videos of hospitality students learning how to check-in guests, the app coachs' eye and the feedback cycle.

The papers in the proceedings provide a good overview of adult educators' and vocational educators' work, with representation from across the NZ institutes of  technology and polytechnics (ITP) sector.

Papers cover a range of pedagogical approaches applying learning centred teaching across a range of discipline areas. Of note are:
- Project / problem based learning (PLB)(Mary-Jane Duffy and Richard Finn; James MacKay and Clifton McKenna)
- related to PLB are papers on role play (Richard Finn), using videos (Selena Chan et al.), self-review (Kaye Jujnovich et al.), learning contracts in the form of 'living consensus' (Julia Bruce) and reflective frameworks (John Clayton and Sarah-Jane Saravani).
- On-job training had papers from Jenny Gibbs and Competenz (William Wang et al).
- technology enhanced learning featured in papers by Competenz on case study of elearning programme design with engineering apprentices, using videos (Selena Chan et al.), and reflective frameworks (John Clayton and Sarah-Jane Saravani)

Cath Fraser provided an overview of the excellent Ako Aotearoa resources Signposts and Goalposts pitched at beginning ITP tutors and also the posters produced by the South Island Educational Developers group.

Important topics on cross cultural education (with Brenda Saris and Deb Donnelly) and sustainability (Mary Panko and Rashika Sharma) round off the selection of papers.

In all, a worthy collection of papers, showcasing some of the best of NZ VET practice.

reviewing 2014

This year has been quieter that some others, but also productive in many ways. I have been able to improve my understanding of a range of topics, notably, in the ways neuroscience may be able to inform us on how humans learn. See here for summary and here for neuroeconomics MOOC notes.

Publishing still moving along with one article published and one published open access and awaiting assignation to a volume/issue next year. My learning is that articles take up to a year or beyond to go through the peer review process and publication. I usually peck at constructing ideas, collating thoughts etc. over the year and then have a concerted writing focus in January / February to ready articles for submission by March / April. This year, I have tried to push things forward so that articles are closer to being complete by Christmas. I hope to get the articles ready for submission by end of February, so articles will be published within the year, rather than carried through into the year beyond.

My educational developer role has centred on project surfacetablet. Some project teams have progressed beyond their planned objectives but several projects have been slow to start due to the need to concentrate on building staff capability before launching the tablets into courses. The need to learn how to operate the tablets windows 8 OS has taken some people time to get to grips with. We have also had major technical challenges incorporating some technology tools into tablets. The main issue has been the slightly different operating system operating on the RT surface tablets and the non-mobile configurations of our existing suite of technology tools. All good learning for the institution, but frustrating for tutors and students if things do not work.

Apart from the above activities, my role has also involved evaluation of some of the technology tools we currently use. The findings have provided a better understanding of the institutions current deployment of web conferencing and learning management systems. Therefore, next year, will need to come to grips with the implications of learning analytics (see workshop notes from Ascilite) and how LA can be deployed to improve learning opportunities for students.

As the year closes, the institute is reviewing the academic division, of which the centre for educational development, is part. We should find out early next year, how the division will be re-structured. Early indications are that the centre will be disbanded and resources distributed to three functional units. Always good to review what works and what doesn’t and will await what transpires when we return to work after the Xmas/new year seasons.

Ako Aotearoa academy symposium

At the end of last week, I was at the annual meeting of academy members held in Wellington at the Brentwood hotel. Largest symposium with over 60 members participating.

Symposium opened with mihi from Ngahiwi Apanui. Academy president, Phil Bishop provided update on the last 12 months and work between academy and Ako Aotearoa board. 

This year, the symposium was open to non-academy members for the afternoon. The theme of the day - tackling tertiary teaching challenges, retaining and developing capable graduates not just for today but for tomorrow. Tomorrow we work on the theme - leadership in education.

Symposium welcome followed by official welcome to the academy of this years excellence in teaching awardees into the academy. Then the hub managers introduced themselves. The objectives of the symposium was introduced by Eric Pawson. Professor Geoff Scott provided an overview of what he would like to see is achieved over the next day and a half. 

After lunch, a welcome from Dr. Peter Coolbear, Ako Aotearoa director who also read out a letter from the Minister for Tertiary Education, Hon. Steven Joyce. Peter provided background and reminded academy of their leadership role on the direction taken by government for tertiary education. 

Following, the first keynote from Professor Geoff Scott from the University of Western Sydney who is leading the afternoon's sessions. He presented on retaining and developing capable graduates not just for today but for tomorrow. Updated on what is happening around the world, to frame the discussions for the afternoon. Covered key themes on how learning can be enhanced to engage students. What can the graduate do after they have graduated?  Retention needs to be whole system, before tertiary, in transition, orientation and during and following. Backward mapping to find out if programme is working. Is it the right assessment, grading, calibration, learning design and resources. Change does not happen but has to be planned.

Measurement and funding for tertiary education tied to outcomes- not only enrolments but retention, completion and impact post graduation. Shift to quality of inputs to outputs, value added, employability, competency-based assessment, work ready plus graduates. Multiple reference points to validate programme level outcomes. Growing. focus on learning and assessing personal and interpersonal capabilities. Common searchable good practice clearing houses eg. MERLOT. 

Framework for quality is learning design, aligned support and infrastructure, delivery and impact. With aligned governance, policy, strategy, quality management and resourcing system.   Ensure everyone understands important vocabulary of standards and education.   Used case study to illustrate comprehensiveness of approach to ensure effective transition and retention strategies plus strategies to make sure graduate developing capabilities that count. 

Then break out sessions occur for participants to work through key themes from the keynote. Groups shared topics that were helpful and a topic they wanted to know more about. Geoff responded to the topics requiring more information. 

Dinner in the evening enlivened by songs and skits from members and a quiz, hosted by James Patterson and Kelly Pender. Good to meet new members and several who were awardees several years ago but at the symposium for the first time. As usual, diverse viewpoints and good opportunity to find out what has been going on at other ITPs over the year.

Day 2

Dr. Peter Coolbear provided a 'state of the nation' presentation followed with question and answer session. Covered themes the government level and Ako Aotearoa's reading of response. NZ priority areas include Maori , Pacifica success, NEETs, outcome, employability, literacy and numeracy, STEM, opportunities with new technologies, impact of NCEA on learning, impact of social media on learning, learning analytics, international students' experiences. Some congruence between government and providers but also some items missing. Missing from conversations include assessment, learner voice / information for learners and re-evaluation of what it means to be a professional tertiary educator. Themes from Ako Aotearoa perspectives include how projects are framed perhaps, important to use an approach that identifies success, understand why and sharing; need to be clearer about values related to tertiary education e.g. Cross cultural referencing; changing dynamics of tertiary teaching and learning - away fro content; and helping students how to learn. Tertiary education is complex, how do we assist developing, promulgation and socialising accessible ideas and tools to enhance learning. 

Second keynote from Professor Geoff Scott on 'turnaround leadership in tertiary education'. Presented analogies of being a leader in their institutions. Revised dimensions of capability from yesterday- personal, interpersonal and cognitive capabilities and role specific and generic competencies. Personal involves self awareness regulation, decisiveness and commitment. Interpersonal requires influencing and empathising. Cognitive includes diagnosis, strategy, flexibility and responsiveness. Competencies to manage, operate, self organise etc. shared the top ranked capabilities by learning leaders. Effective leaders not at top or organisation need more interpersonal capabilities. Change capable culture is built by change capable leaders. Pick your battles, prioritise and listen, link then lead.

Groups discussed the topic presented which they found most useful and the topic they wanted to find out more about. 

Closing presentation on constructing and testing a change leadership framework. A response to the Ministers invitation to report on outcomes to the symposium worked through. 

Symposium ended with field trip to Zealandia for last opportunity to catch up with academy whanau. 

Resound linx hearing aids - user review

I have started to struggle with poor hearing, so took the plunge and went to the audiologist a couple of months ago for a hearing test. Results did not come as a surprise. Moderately severe high frequency neuro-sensory hearing loss in both hears. I suspect its partially genetics as my eighty plus mother is very hard of hearing and when my son started school his hearing lost was picked up. High noise levels while working in bakeries and teaching baking for almost 30 years probably didn’t improve things. Cake mixers and other bakery machinery can run very loud and the sound reverberates through all the hard surfaces in the bakery.

Over the last year or so, I noticed difficulty at meetings and when running workshops with hearing people who were a meter or so away. Also, nearly impossible to hear people talking in the car when I sit in the back seat but recently, also difficult to hear someone seated in the car next to me, due to the noise of traffic and car mechanical noise. Ditto in restaurants and anywhere where there is lots of background noise. Sometimes even difficult to hear someone sitting right next to me when the environment is buzzing with extraneous sounds.

The audiologist recommended a few options, all expensive and all digital. So, decided on the resound linx hearing aid as you are able to connect to an iphone or ipad through Bluetooth - see cnn review and review from uk. The hearing aid can then be adjusted to suit different conditions – outdoors, restaurant etc. Audio from the phone can sent directly to the hearing aid and the phone can also act as a microphone. So the techie in me decided to shell out the $$ and become part of the wearable computer brigade.

There is a $1022 subsidy from the NZ Ministry of Health which is helpful and one is eligible for the subsidy every six years after making the first claim. Technology in the hearing aid field must move quickly as friends of mind who have had hearing aids ‘installed’ all have different models which all claim to be the best at the time. So six years is quite a long time to wait between hearing aids. It will be interesting to observe how the wearable computer trend develops with regards to hearing aids.

During the first two weeks, I found out how much I was missing out on with regards to sound!! However, noisy meetings / places were very intimidating as the hearing aid magnifies all sound and my brain had to try to learn again, how to filter out the things I needed to hear and everything else. I persevered by having the hearing aids on at last 10 to 14 hours a day and only by the end of about a month, did the noise level become manageable. Even then, I turn off my hearing aid at scrabble tournaments where I only need to have one on one conversations and do not need to be distracted by other noise.

Connection of the hearing aids via Bluetooth to an ipad mini was straight forward. Especially handy to have music / audio books etc. beamed directly into the hearing aid as you cannot also use ear buds when the hearing aids are in. Adjustments to the hearing aid can then be made via the resound linx app. So, all in, this aspect works well. Have now listened to a backlog of podcasts and a couple of audio books while gardening or walking the dog. Bluetooth has to be turned off during flights, so still need to bring ear buds to watch videos on the ipad mini.

iPad mini 2 - review

Purchased an ipad mini (32G Wifi model)while in Oz for a family wedding a few weeks ago. Last week, all the Ascilite notes were taken using the ipad mini with no peripheral keyboard. So this is a brief review of use to date. I agree with isource.com about typing on the ipad mini. At first, I was a little hesitant as to how the small screen would cope. However, being blessed with small fingers means typing on the ipad mini has not been difficult. I used the notetaking app and copied across via blogger app. All straightforward. As usual, good to follow up a week or so after a conference to tidy up the conference blogs as it leads to actions lists and other connections that arise from various presentations.

On the way back from Perth, I flew Virgin Pacific. There were signs in the waiting room to download the Virgin Pacific app which I dutifully did. On the plane, it was just a matter of opening the app and selecting what you wanted to watch. Screen was a tad small for watching video and you need to ensure you have your ear plugs or similar with you. However, beats not having any video to watch at all when on a flight and you have not paid for seat that comes with entertainment.

One of the reasons for the purchase of the mini was to run the resound linx hearing aid app (more on this next week) and the Bluetooth pairing worked without any hassles. All sound from the ipad mini is now bluetoothed to hearing aids, which is great when I am out walking the dog or catching up with gardening. Over the last three weeks, have been able to catch up with a backlog of podcasts and audiobooks.

So overall, happy with the ipad mini. Its lightness and size are a real advantage compared to the acerswitch 10 or the surface pro. iOS is still superior in terms of user friendliness. The real advantage being the way all apps work in a similar way and ease of use. On signing up for the itunes account on unwrapping and powering up the mini, all the apps, music, books etc. from my previous ipad was ported across. I just had to select the ones I wanted to access on the mini and download of the selected items was straightforward. Ditto for kindle app, Seamlessness just has to be the way to go when you move from an older device to another. 

Access to the cloud is especially important as ipads have no usb port. The ability to link easily to dropbox similar is essential, along with the function of downloading files from the cloud to reside on the ipad so there is access to files when there is no WiFi. All in, happy with the small size of the mini. It is perhaps not the ideal device for a business road warrior but works well enough for those who need a device to surf the web, take notes, upload photos and read.

Ascilite day 3

Third day of the conference dawns fine and sunny. After the best poster, paper awards, we are on to the keynote of the day with Professor Carmel McNaught from Chinese University of Hong Kong on technology supported innovation. Do we have adequate evidence for claims of success. Are core principle from one's own ontology transferable? Why, when we have so many tested tools and strategies, is the uptake of educationally sound learning designs limited? Presented on changing contexts, evaluation research and evaluation research, paradigms and mixed methods, LEPO framework and innovation life cycle, project examples, implications for institutional policy and processes and summary of principles. Recommended new media consortium annual horizon report for 2014. Need for continual evaluation and research to cope with fast pace of technological change. 

See McNaught(2011) on evaluation as part of blended designs. Philips, McNaught and Kennedy (2011) types of evaluating research (book-2012), the LEPO framework.McNaught, Cheng and Lam (2006) on good evaluation research. Reeves (2006) on design based research instead of predictive research. 

LEPO framework is on learning environment, processes and outcomes within an educational context. LE facilitate LP lead to LO which determine LE. Consider also the innovation life cycle, project management evaluation for baseline,messing, formative and effectiveness. 

Provided 5 examples. As overview see Lam, Lee and McNaught (2010;2011) found positive experiences for elearning if used to meet student learning needs. Examples from eportfolios with students learning English - needed buy in from teachers.

Use of forums across 13 courses - use SOLO to analyse quality of postings, forums worked if structured but student centred.

Mohan and Lam (2005) investment banking working on peer learning evaluation and assessments. 

Teachers using social media 

Implementing collaborative interdisciplinary scenario inquiry tasks in large science classes. University of Queensland and Australian learning and teaching council project. 

Interactive collaborative assessment system called IS-IT to allow group tasks and peer assessments to take place.

Implications - encourage students to do the work; reward through policies and processes. 

After morning tea, I pick up the learning analytics theme its associate professor Cathy Gunn's from University of Auckland paper on defining the agenda for learning analytics. Broad context of educational data mining, web analytics,ml earning analytics, recommender systems and business intelligence. Connect educational design research to learning analytics contribute to evidence based educational practice. McKenney and Reeves (2012) on educational design research. Potential of LA to add to data and achieve linking of assumptions about learning and learning design intent to the learner behaviour , learning processes and outcomes it produces in meaningful and reliable ways. Not just asking students but using LA in non invasive ways to find out similar things. Thing through what can really achieve with LA and we must do to exploit potential. How can we translate data to be meaningful to teachers? Can we convince our institutions we have a duty of care to use LA? 

Next presentation is on exploring students' interpretation of feedback delivered through learning analytics dashboards with Dr. Linda Corrin and Paula de Barba from the University of Melbourne. Current focus seems to focus on retention and providing data to academics. Need to provide data to students and support them with how to interpret and progress from data. 2000 plus students across 2 first year and 1 second year courses. LA needs to consider differences in learning design of courses. Pilot consisted of survey to capture demographics, think aloud interview in week 3, week 11 and final survey on motivation to study. Dashboard provided for access, learning activities, quizzes etc. themes were reflection, study strategies, motivation, class average, consolidated view and interpretation. Students could work out strategies but could not explain why. Motivation improved for most students. Consolidated view appreciated. Interpretation weak. Positive outcomes mostly. 

Last paper on the development of an application with process feedback to enhance student centred learning with Sudhakaran Edathil, Christopher Chin, Stephanie Zank, Dev Ranmuthugala and Susan Salter from University of Tasmania. Presented by Christopher Chin. Reinforced efficacy of timely feedback and examples of assessment and feedback tools available. Desire2learn but can be shifted across to other LmS. Learning mode is fully guided, assessment modems partially guided and assessments itself is not guided. The guided path scaffolds students with revealing each step in the algorithm and each step also has a hint to assist self learning. Student feedback positive on the process feedback tool. 

After lunch, comes the drive back home to Christchurch.

Next years Ascilite is in Perth hosted by Curtin University. 

Ascilite day 2 afternoon

After lunch Wayne McIntosh updates on OER university The OER foundation is a non profit organisation providing support for OER. oERu made up of an international collection of educational institutes. At the moment, NZ has 6 plus 2 none teaching organisations and Australia has 6. Made links between OER and sustainable business models. So how does OER contribute to the sustainability of your institute? Discussed copyright and absurdity in present world. Updated on Creative Commons licensing. BIG vision for institutions not provide only 2 courses to OERu and provide free learning opportunities to any learner. Assessments could be offered on fees for service model. OER provides support and technology services, content provided by institution and assessment and accreditation through fee for service. OER based on personalised learning environment with content on wiki educator and an aggregator to link other cloud based tools. Provided example presented by Niki Davis this morning on a course also linked to Moodle. So where do MOOCs stand? The university of Canterbury post grad course with 121 participants from 14 countries. Retention rate was good and integration of quality. Parallel modes of delivery with full fee paying students and open also to OERu courses raising international awareness of home institute and providing cross cultural experiences for students. OER is low cost and high impact. 

After the keynote, I attend the learning analytic SIG. Carolyn Steel provides parameters for SIGs. Shane Dawson is the leader but unable to be here, so Leah MacFadyn assist to gather objectives of the group. Ethics of data and data governance comes up as something everyone is interested in progressing. Need to share practice and use SIG site to collate resources. Collate various research projects completed and in progress. Group prioritised 4 activities to work towards. 

After afternoon tea, I catch up with Stephen Marshall and Jonathan Flutey's (from Victoria University) work on turning a digital vision to reality. Shared process of building support for technology and learning. Challenges identified in 2010 with a reactive unstructured adoption of technology, misuse of LMS as DMS, technology as admin rather than pedagogy etc. vision and strategy for 2012 to 2018 on university website. Focus on learning design and provision of a seamless service across all support and teaching learning. Technology facilitated student experience in terms of physical and digital facilities for formally scheduled learning, informal learning invited by student, individual learning supported by campus facilities and social community scholarly activities which are campus and public. Jonny provided example of introducing technology in specialised teaching areas and need to set up experimental rooms. Virtual innovation incubator to allow academics to play. Building capability is organisational with a start by stocktake of digital skills required. Goal orientated capability building eg. Flip classroom defined for process, pedagogy and technology with badges attached to each goal. Mentors identified to form distributed learning network.

Then a concise paper with John Clayton and Sarah-Jane Saravani on creating digital self reflective frameworks to encourage learner autonomy in post graduate courses. Shift from knowledge acquisition to how students learning. Move from knowledge management to portfolio focus. Critical skill for learner is reflection. Students provided framework to develops critical reflective skills. Tool build to provide students with needs analysis to self identify in 4 domains. Traffic light indicators provide information for student and tutors and assist start of conversation on student responsibility and support. The learner knows and needs scaffolding to work towards own learning goals through learning project. 

Attend SIG on  innovations in tertiary education delivery summit led by Peter Guerin from the NZ Ministry of Education. Peter provided background. Last year MOE provided a paper on MOOCs which led to conference on the broader range of innovative tertiary education. Out os the conference came issues like accreditation plus current system as not supporting students to move seamlessly through. Group discussed questions. How can providers design delivery to achieve consistent results and best support learners? What sorts of issues could arise from new models? What will happen for teaching and learning? Output and outcomes?

How will new technologies cater for different kinds of learners? What are differences as learners between young people? Older students? Those with high learning needs? Those in employment or with other commitments? 

Conference dinner in the evening rounds off another busy day. 

Ascilite day 2 morning

Day 2 begins with a keynote from Professor of elearning Niki Davis from the University of Canterbury. Niki presents on 'prizing' open eduction as in getting to grips with and with treasuring. We are good at doing new things and seeking new ways but we are not so good at finding out whether what we do is any good. Call to revisit the trends scenarios set up after the DEANZ conference in 2009. Shared notes are on Google doc http/tinyurl.com/ascilite2014

Four scenarios are articulation, supermarket, self determination and quality brand consortia. 

Provided example of development of a MOOC on technology diffusion and models of change in education. In conjunction with Wayne McKintosh as MOOC deployed OER. Course in 2013 as a micro MOOC alongside a normal course with OERu.

Challenge of open journals as resource for the MOOC and ease of access to journals by DEANZ and ASCILITE.

Has technology improved education for all? Digital equity gap not diminishing. New project elearning for adults with literacy and numeracy needs. Need to ensure elearning is relevant to and useful for adults with literacy needs. Re engage and motivate students in a variety of ways to suit individual needs - truck drivers with low literacy and mobile work, use mobile computing as focus. More communication and tutors feedback suited to device ownership and work context. Family communication, grand parents digital literacy. Culturally appropriate with informal and familiar environment. Numeracy in authentic situated learning. Application of games where relevant. 

Elearning needs to think about global and equity aspects. 

Ascilite awards made for innovation and excellence to University of Queensland flip classroom, Macquarie University and Auckland university for work in portfolios in health science.

Life membership to Gregor Kennedy. 

After morning tea, concurrent session begin and I chair 3 papers. First up, Jo Lander from the University of Sydney on the role of the interpersonal in online knowledge construction. Reports on investigation on asynchronous discussions potentials and challenges. Importance of building an online discussion community but student tend to not be able to reach higher level of critical thinking through learning based on asynchronous discussions. In 3 context on communicable disease, obesity and tobacco control. Used linguistic discourse (systemic function) to analyse discussions to establish interpersonal, ideation/ knowledge building and textural / mode/genre. Provided examples from the data to study how community building proceeds, instruction giving. Expectations for knowledge construction include bring in prior knowing, a synthesis  or transformation, opinion or argument etc. need for moderators to open space for other voices. Interactions between moderator and students and between students were rarely challenging, negative and / or critical. Online discussions become blends of conversation and academic, fragmented, incomplete and jointly constructed. So, academic writing not practiced and discussions do not use language of academia. Implications on social media Type relationships and disconnect to academic discourse. 

Second session with Salome Meyer from EIT with blended learning: student experiences. Blended learning of 5 Batchelor degrees through merger of 2 institutes in 2011. Evaluated student experience with BL with focus on development and delivery across skills. Study in 2012. Prior to start of BL most students who completed the survey had not experienced online learning. When BL started, majority of students expressed positive engagement with online learning. Students felt support for shift to online learning was insufficient but most other including taking responsibility for learning and flexibility. Staff capability was an issue which students picked up. Recommendation to develop comprehensive plan to support BL initiatives. 

The third session is with Penelope Rush from the University of Tasmania wide open listening: what is it really like to be a distance student? Survey undertaken to improve support services to students and raise awareness of support. Survey of 1000 plus students a 17% response rate. Themes through grounded theory included enables self determinism, flexibility, necessity, location and positive. Highest responses in flexibility with the second in necessity. Worse aspects included isolation, resources responsibility, unconsidered balance/ travel. Distance learning improvements included improvement of resources, contact, consideration, communications. Flexibility needs have to be balanced with synchronised sessions by webinars or similar. 

Ascilite day 1 afternoon

The keynote after lunch is with Associate Professor Shane Dawson from university of South  Australia on what are we learning from learning analytics? Student data can be used to track academic, social and personal. LA actually around for many years but called different things like intelligent tutoring etc. but now ease of data mining creates too much information. lA still focused on what rather than why. Personalisation of learning possible but mainly concentrated in key skills and foundational content with drill and revise approaches. Examples of cognitive tutor include knewton and knowillage. Education management like analytics assisting with retention and identification of at risk students e.g. Course signals feedback (Tannes, 2011). Focus on learning process is still missing. Most projects still based on small scale and tends to be very context specific with guidance lacking to help further adoption.

National project now in progress to benchmark LA across 39 Australian universities and with 30 experts. Find out how to focus on learning process, broad range of data and recommend how to implement LA. Gap between how education administrators and researchers understand purpose of LA. plus most institutions still stuck at level 1 (Goldstein and Katz) of LA implementation. Two models, solutions focused or process focused. Solutions focus are it or industry or learning and teaching. Process on individual faculty or networked/ integrated. Discussed pluses and minuses of each and how moving solutions or process towards higher relevance. Currently a solutions model is usually it driven presenting data in dashboards etc with success being whether staff access the data. 

Cross organisational groups need to be used to develop LA. Needs to be problem focused. For LA to work staff capacity a key along with organisational buy in and support. Remember education, learning and organisation are complex. Complex leadership theory (Ulh-bein et al.) recommended as a method to manage complex tasks with complex teams. lA is not a technology, dashboard or one individual. @LA is team based and dynamic and requires planning and thought. 

 In the after lunch sessions, I chair 2 sharing practice sessions. The first one is with Stanley Frielick, reporting on progress on the Ako Aotearoa national project on mobile learning. The project involves 6 institutions with a diverse range of discipline areas. Each team presented briefly on their work to date.  Twitter #np14lmd. Stanley introduced the overall project objectives and encouraged catch up at poster session as each team has a poster on their project. Kathryn from EIT presented members of their communities of practice and approaches exampled by student ebook creation. Objective to build skills outwards from original team to increase institutional capability. Vickel from AUT presented examples of what has been worked with audio of tutor reflections and how student learning was changing to become more reflective and meta cognitive. Sam from Otago Polytechnic presented on designing for student success institutional project with example of carpentry collecting evidence of house build and use of Squawk which is LMS with ability to capture informal learning and offers feedback. Adrienne presented Auckland University use of Google + community to record thinking and learning while teacher trainees were out on school experience. rena presented on use of Pinterest to form eportfolios. James from Unitec showed examples of early childhood students and augmented reality with students embedded augmented reality content to digital resources. 

Then Michael Sankey and Helen Carter from USq report in 'benchmarking your capacity for technology enhanced learning. Presented on the ACODE initiative involving Australian and Nz universities and polytechnics. Formalised benchmaking provides opportunities for institutions to share practice. Overviews the revamped technology enhanced learning ACODE. Places institutions within broader sector wide context. ACODE meets 3 times a year. ACODE investigates, developing and evaluating new initiatives and developments to assist best practice. First developed 2004, revised 2007 and reviewed latest version 2014. 8 benchmarks. Latest revision better aligned with learning and teaching, planning around innovation and emergent technologies, sustainability and quality fro externally sourced systems. In June, 24 institutions from 5 countries participated in latest benchmarking exercise. Overview of process, self assessment within each institution involving internal stakeholders to decide on where institution stands with each indicators and collection of evidence and writing rationale; then all indicators compared to find if self assessment accurate; providing sharing of practice. 

After afternoon tea, attend 2 sharing practice session. First one on 'bringing digital literacies to students without Internet access' with Helen Farley from the Australian Digital Futures Institute at USQ. 61% of worlds population do not have access to the internet! Check http://bit.ly/without Internet to share experiences of teaching without the internet. 44% of students on foundation students in 2012 did not have Internet access but USQ moving towards all resources being digital and accessible online. Some students do not have access to electricity. Presented learnings from projects set up in correctional centres to think through how to better cater for learners without access to Internet. Still important plan. Determine context of your learner. If there is some Internet identify core resources so students download when they are able to and get resources up early. Investigate mobile interconnectivity and keep things simple. Use ePub, self marking quizzes and keep download files which are small. Recognise that collaboration is difficult, have alternatives to digital assessments. Sometimes not able to offer in offline environment. 

Second session on digital learning thresholds for whole institution with Romy Lawson fro University of Woollongong. Shared experience of move from blackboard to Moodle with tools like mahara, echo360, Equella, edublogs, turnitin, parature and other tools. Task and finish groups were formed to complete projects, consultations with stake holders and endorsements by relevant committees. Started from work of others to inform project and match to local context. Discussion and and sharing of what others have done. 

Then poster sessions where I present poster on CPIT project surface tablet, work to date and in progress.

A visit to the settlers museum and dinner out with CPIT staff closes a longish day.

Ascilite day 1 morning sessions

Ascilite day 1 morning

After yesterday's workshop on learning analytics, decided to attend the learning analytics stream through the conference. So apart from chairing one session of 2 or 3 paper presentations, I will try to get to various learning analytics papers.

The conference was opened by the vice chancellor of University of Otago, professor Harlene Hayne and the CE of Otago polytechnic, Phil Ker. Official welcomes from Ascilite president Dr. Caroline Steel and conference organisers, Drs. Bronwyn Hergarty and Jenny McDonald.

The conference keynote is with Professor Sara de Freitas from Murdoch University on educational games: negative rhetoric and the future reality? Some research showing effectiveness of games in helping the learning process but still negative perceptions from media. Need for defining difference between entertainment games and learning games. Covered trends in learning, play and games with generation z coming in, growth in mobile and social interaction. pervasiveness of gaming especially across tablets and mobiles and growth of serious game play including simulations, online learners now in mid 30s, open data, metadata contributions to learning analytics.

Negative perceptions of Gaming despite the research findings on efficacy of game based learning. Presented on importance of social interactive,play and role of learning analytics. Used Triage Trainer' simulation as an example of game set up to test critical skills to prepare doctors, nurses and paramedics for emergency medicine. Comparative evaluations reveal simulation enhanced learning through opportunity to practice skills and apply knowledge and personalised feedback. Neuropsychology approaches possibility for studying why games are engaging. Posit thinking as based on physiological and cognitive functions requiring sensory memory, attention selection cognitive short term and long term memories. Discussed importance of play in brain development. For instance all mammalian infants have a sensitive period where intensity if learning takes place. Play taps in to this sensitive learning period and games may be effective later on through connections to original patterns setup to learn from play. Detailed study In 2011 dunwell, de Freitas Jarvis on four dimensional consideration of feedback in serious gamers, modelling feedback through learning analytics. 

Provided examples of gamification and linking to exploratory learning models, challenge based pedagogy, using games for retention and engagement and using Khan academy as a case study. 5 common mechanics of games are points, badging, levels, leader boards, challenges and main ways to drive engagement as accelerated feedback cycles, clear goals rules, compelling narrative and challenging but not impossible and attainable with effort. 

Example used of mobile game to learn cross cultural dispositions called Maseltov funded by the EU. Then case study of Khan Academy which now as millions of views with 4.4 million visitors a day and uses challenge badges as a core gamification approach. To design content to promote engagement with example of Uniplay. Studying syndicated game content in mine craft, eco challenge, mobile apps, pervasive games and engaging challenges games. Need to map systems more closely against human behaviour. Map learning, theory,interactivity, feedback and adaptivity to learning design and pedagogical modelling, multimodal and experiential learning, adaptive used modelling and educational systems and platforms. Unpacking what is play and what is learning, where are the overlaps, commonalities or differences. 

Shared vision of how new learning is about social interactivity which is immersive, engaging and personalised. New pedagogy socially focused and active. Need to catch up on the concepts presented as there are commonalities with my learning a trade project.

After morning tea, I attend the session with Colin Beer, David Jones and Rolley Tickner from central Queensland university CQU and university of southern Queensland on 'three paths for learning analytics and beyond: moving from rhetoric to theory'. Increase in interest of LA. Again reports on much interest but no many actual implementation. lA has affinity with business intelligence so attractive to educational management. 3 paths do it to, do it for or do it with. Used LA developed system early alert student indicators. Brings information from sms and lms. Creates traffic light based indicator to provide information on students who may require a nudge. Nudges can be created using mail merge, f2f meeting, shared notes etc. signals for nudge can be customised by lecturers. Launched 2012 and evaluations indicate acceptance. Project began 2008 with learning to avoid the do it to or do it for approaches. Adopted the do it with approach by working with teaching staff. Need to drop the language of planning and management but acknowledge  complexity of system.

Then paper from Shane Wohler from eastern Institute of technology and John Jamieson on 'what in me is dark, illumine' developing a semantic URL learning analytics solution for Moodle. Presents on big data and learning analytics, experience with an analytics solution with Moodle and how it is being used and what worked and what did not. Pragmatic solution to setup by leveraging free tools like google analytics, do a macro level trends and behaviours, minimise ethical and security issues, keeping it simple and developed to be shared for benchmarking. So installed Google plugin for Moodle 2.0 and above with ability to manage role specific data. Translate Moodle url to meaningful URLs with moodlesite, school, course, activity etc. linked to google analytics to find out time accessed, where and what accessed with etc. able to map use of tools like turnitin. Due to macro level data, data used to inform strategic governance it strategy and direction, resource allocation. Next steps to work on data governance, policy and procedures, empowering staff to use data to make decisions, focus on actionable intelligence. 

No learning analytics paper in this slot, so stay in the same room and attend the session by dr. Julia Thornton from RMIT on 'deficit theories in the educational technology adoption literature'. Presented on how discourses impact on perceptions through the literature review section of her phD thesis. Approaches to digital literacy include the cookbook/ recipe book approach with deficit as a technical skill, technique or information; information literacy approach with emphasis on competencies and learning to plug a gap; novice expert developmental approach; Digital natives/immigrants approach and diffusion theory approaches.

Lunch follows with opportunity to talk o various people about my poster on the Cpit project surface tablet deployment with findings from the first semester evaluations.

Ascilite 2014 workshop on learning analytics

Learning analytics workshop with Dr. Leah Macfadyen and Dr. Shane Dawson at Ascilite 2014 held at Otago Polytechnic.

An introductory session. Leah is from university of British Columbia and Shane is from university of South Australia. Handouts from http://bit.ly/11HnjmH

Overall a good overview acknowledging challenges and potentials.

Unedited notes which I will augment when I return to office.

Current LA implementation 

1 extraction and reporting of transactions level data

2 analysis and monitoring of operational performance 

3 what if decision support - such as scenario building

4 predictive modelling and simulation 

5 automatic triggers and alerts - interventions (Goldstein and Katz, 2005)

Most institutions have not progressed beyond stage 1.

Introduce and review field

Cooper 2012 " the process of developing actionable insights through problem definition and the application of statistical analysis.

Solar - measurement collection analysis and reporting of data about learners and their contexts for purposes of understanding and optimising learning and the environments in which learning occurs. 

La draws from business intelligence, web analytics, academic analytics fro 2005, educational data mining 2000 , action analytics 2008 onwards.

Academic analytics on recruitment, retention etc. learning analytics focused more on teaching and learning. 

Drivers of la include socio political, educational and technological. 

Need to move beyond number crunching. EDM laid groundwork for computation and modelling. Interdisciplinary collaboration required technical analytic on statistics, data visualisation and visual analytics, educational data mining, computer science, machine learning, natural language processing, human computer design, etc. 

Systems thinking may be one way to look at la. A system is perceived as elements which are inter connected and inter dependent ISON in Ray and bradbuRy, 2008. 

LA investigates information of educational system information flows and feedbacks in an education system.

Offered examples.

What kind of information? Where students come from, achievement of students, information from student engagement through LMS or similar MOOCs, student monitoring and success tracked by learners, student satisfaction from course evaluations etc., 

Purdue signals project 

Student led system to feedback to students progress through courses. Gathers student demographics. 

University of Maryland Baltimore 'check my activity' tool. 

Austin Peay university's degree compass tool. More of an academic analytic looking at students pass achievements and recommends future courses. 

University of South australia - analytics dashboard. Student learn online engagement ratio. Mainly frequency of access to various Moodle resources and activities. Then calculate at risk on quadrant student current engagement vs student current grade. Low engagement often related to low grades. Link to predicting performance and retention through identifying no risk, low, medium and high. Found intervention with high risk students too late, so shifted intervention to earlier in course, just post orientation. Risks identified as low social economic status, low entry qual. And distance to travel to uni. Students contacted via crm which is used by student services to support students. 

Shane also shared uniSA work on video analytics and annotations. Collaborative lecture annotation system, allows YouTube video to be annotated with student notes. 

Other enterprise level la tools include cavitas, design 2 learn insight, knewton adaptive learning system, blackboard analytics. 

Barriers to adoption  (ferguson et al., 2004)

Review key steps in implementation

Rapid outcomes model approach 

Define and redefines your policy objectives

Map political framework (young and mandizabal, 2009)

Identify key stakeholders 

Identify desired behavioural changes

Develop engagement strategy

Analyse internal capacity to effect change

Establish monitoring and learning frameworks 

Stages include

Define a clear set of overarching policy objectives

Map the policy context 

Identify key stakeholders 

Identify desired changes outcomes

Develop a plan

Ensure engagement team has competencies required to operationise

Establish monitoring or evaluation

What does your institution would like to achieve through implementing LA?

Clarify and prioritise purpose

Plus identify range of skills systems and processes to assist implementation. 

Issues with ethics - purpose, ownership, informed consent, privacy, de-identification, how data handled, who has access, ethics of surveillance, but in parallel with changing attitudes to privacy and self disclosure. Need policies on data governance. 

Workshop closed with session on ethics.

Issues with ethics - purpose, ownership, informed consent, privacy, de-identification, how data handled, who has access, ethics of surveillance, but in parallel with changing attitudes to privacy and self disclosure. Need policies on data governance. Recommended to check slade and prinsloo 2013 for principles of learning analytics and ethical use of student data for la policy (2014) by uk open university.