Category Archives: education design

Ed Tech must reads – Column 14

First published in Campus Morning Mail on Tuesday 16th November 2021

Professional Development Opportunities in Educational Technology and Education via Stephen Downes

Stephen Downes has been a go-to source for information and opinion about online learning for decades. He is also one of the originators of the idea of the MOOC. In this post, he shares a comprehensive Word doc list (147 pages) from Clayton R Wright of Ed Tech/Education conferences, seminars and workshops of note between now and 2024. (I did still manage to find one that isn’t on the list – that’s at the end of this column – but you had better believe it is comprehensive)

Teaching like a Master(Chef) – Using MasterChef as a model for effective and ineffective lesson design from Medium

Reality TV shows provide us with hours of content every week of ‘real’ people engaging in challenging practices right at the edge of their capability for our viewing pleasure. In some cases they are thrown into a task cold but more commonly they are supported in different ways that can offer us insights into wider learning and teaching practices. James Bullous explores (UK) Masterchef in this engaging post, ranging over Discovery learning, Cognitive Load Theory, feedback, modelling, motivation and more.

25 more real-world examples of Virtual Reality from E-Learning Provocateur

This post is a couple of years old now but given recent buzz about Augmented/Virtual Reality (AR/VR), it’s worth revisiting as a handy source of exemplars of innovative uses of the technology in education/training, healthcare, marketing, gameplay, ‘travel’ and storytelling.

Brain Implant Translates Paralyzed Man’s Thoughts Into Text With 94% Accuracy from Science Alert

Something that is a little further down the road from practical application in the classroom but nonetheless fascinating is this story that draws on an article from Nature. Researchers have been able to capture thought-to-text at a rate of ~18 words per minute with high accuracy. The mind boggles.

EdTechPosium 2021 – Canberra, Friday December 10th

EdTechPosium is a one-day conference with a practical bent covering innovative uses of educational technologies in ACT universities, TAFE and schools. Once known as MoodlePosium back when Canberra education institutions were collectively a Moodle shop, it is a great opportunity to connect with the dynamic local Technology Enhanced Learning community. Keynote speakers include chief Moodler Martin Dougiamas, ANU PVC Education & Digital Prof. Maryanne Dever, Ed Tech guru Natalie Denmeade and Astrophysicist Brad Tucker. For $90 including dinner, it’s hard to go wrong.

Ed Tech must reads – Column 10

First published in Campus Morning Mail, 19th October 2021

Watch Party Lectures: Synchronous Delivery of Asynchronous Material from Journal of Learning Development in Higher Education

Something that I’ve noticed recently in online conferences is an increased use of pre-recorded presentations. My initial response to this was a sense of feeling somewhat ripped off, but in better sessions I have realised how well this can work. Presenters are freed up to engage in simultaneous chat as the video plays, answering questions and following the audience down new discussion paths that would not be possible in a synchronous session. Emily Nordmann (University of Glasgow) is one of the leading lights in scholarship of lecture capture. This paper with her colleague Carolina Kuepper-Tetzel describes their recent use of this innovative approach with lecture “watch parties” with students. Once lecturers get past the strangeness of watching themselves, they and the students report real benefits from this mode of teaching.

Platinum (LMS) picks for 2021 from Craig Weiss

I’ll preface this with a large caveat that I am wary of anyone who describes themselves as “the most influential person in the world for learning systems” and whose evaluation criteria include being signed up to their own business’s “Customer Excellence Pledge”. That said, this list of 30 Learning Management Systems (LMS) recommended by Weiss offers a handy resource for anyone exploring options in the LMS space and it covers a range of organisational contexts. I recognised just one name on this list, D2L.

Troll farms reached 140 million Americans a month on Facebook before 2020 election, internal report shows from MIT Technology Review

It’s no secret that Facebook has an oversized grasp on the world’s psyche but this report from the MIT Technology Review still manages to chill in terms of how effectively this is misused. In 2020, 19 of the top 20 “American” Christian pages in terms of views were based in troll farms in Eastern Europe with suspected ties to Russian Intelligence. These aren’t even pages that people have signed up to, simply those that Facebook presents as ‘related content’. More than anything, stories like this highlight the urgency of embedding digital and media literacy and critical thinking in every level of the education system.

12 ideas to refresh your teaching in less than 10 minutes from The Educationalist Alexandra Mihai draws on a range of resources in cognitive psychology and faculty development to provide 12 brief activities (and wider practices) to bolster student learning in classes. Ranging from keeping the lesson plan visible for signposting/contextualisation to retrieval practices and activating prior knowledge, these are all things that can be picked up with minimal preparation.

Ed Tech must reads – Column 9

First published Campus Morning Mail 12th October 2021

This Former English Prof Built and Sold a Company: Here’s What She Learned from Roostervane

One thing commonly discussed about education technology companies is how well they understand the experiences and needs of teachers and students. One thing commonly asked of academics is how applicable their skills and knowledge are to ‘the real world’. This quick read from Roostervane, a Higher Ed oriented careers site talks through some of the experiences of someone that moved from academia to ed tech and offers suggestions for those interested in this path.

Discussion on consistency in online course design from Neil Mosley (Twitter) 

Ideas of ‘academic freedom’ in terms of how courses should be designed and taught often butt heads with usability principles and institutional priorities when it comes to online learning. This debate is well captured in a tweet from @neilmosley5 and the subsequent string of responses that cover ground include standardisation of courses, Geocities, cognitive load, Pink Floyd’s The Wall, and some rather tortured analogies. Well worth a read to tour the many perspectives.

Student Guide to the Hidden Curriculum from the Quality Assurance Agency for Higher Education

Starting tertiary study can be a confusing experience for students, particular those who are first in family. There are labyrinthine systems to navigate and new terminology and concepts that are often treated as assumed knowledge. What is a PhD, a journal article, peer review? This guide, while UK-centric, offers clear and well-written explanations designed to support new students in this new world. I absolutely wish I’d had something similar when I started uni. (Thanks Thao for sharing)

Call for contributions – Innovation in Higher Education Assessment in COVID19 from JUTLP

The Journal of University Learning and Teaching Practice is an open publication hosted by the University of Wollongong. They are currently calling for contributions to an upcoming issue relating to innovation in assessment in the time of COVID19. Abstracts are due by Nov 1.

The Dreambank from University of California, Santa Cruz

Most of the time, hearing people recount their dreams can be a little tedious. They don’t fit conventional story structures and the details can be somewhat liminal. This site however, from psychology researchers at UCSC, captures brief (~100 words) retellings of more than 20,000 dreams from people aged between 7 and 74 over decades. It also includes discussions between the researchers and dreamers about the dreams. I spent way too long trawling through these one evening but it is a marvellous window into the minds of people we’d never otherwise hear.

Thoughts on: Practicing what they preach: A case study exploring the experiences of Instructional Designers as educators of an online teaching certificate program (Uibelhoer, 2020)(Thesis)

lightbulb in thought bubble

Of all the theses that I’ve read recently, this one has been the most valuable – for several reasons. Chiefly, it fills a gap in several areas of the literature around edvisors relating to edvisor perceptions of how they are supported by their institutions (and the support they need), the impact of having faculty/college based and centrally based edvisor units, faculty autonomy/academic freedom, the pedagogical and design frameworks used by edvisors and the ways that organisational structures and reporting lines impact edvisor effectiveness.

Which is a lot.

I’ve had two opposing reactions to this – panic about how I will now find something new to say and appreciation that when I put my ideas out there, I can at least say “well Uibelhoer thinks so too”. (Honestly I’m not that worried and it has been fantastic to see how universal some of the challenges and possible solutions are)

A few other things that I’ve liked – just the clean readability of the thing. Uibelhoer doesn’t tie himself up in linguistic knots trying to sound clever, he simply tells the story in engaging, clear and direct language that moves the ideas forward and progressively builds a compelling case for them.

Personally there were a number of helpful new ideas and theories that I will be able to draw on and use to expand my thinking. I haven’t really given much consideration to faculty autonomy/academic freedom, there’s some nice stuff on collaboration and Collaboration Theory, and there’s also some valuable ideas on the impact of organisational structures, which draws on a thesis from Drysdale (2018) that I also have sitting in my to-read pile.

One other thing that I do need to flag is that there is a stellar overview in the lit review of the various pedagogical approaches in the last century and how they are applied in instructional design. From Behaviorism to Connectivism and beyond, this is something that I will highly recommend to anyone looking for a crash course in educational theory and its practical application.

There are a handful of areas where we have different perspectives – most significantly would be that where I see three distinct (though overlapping) edvisor type roles, the approach in the U.S. seems to be more of instructional designers as kind of a one stop shop for everything these people conventionally do. He does touch on specialisations though and the whole thing has got me wondering whether it is madness trying to foster understanding of 3 separate roles when we have problems doing it with just one.

I’ve glossed over the body of this thesis, which is a case study of development and delivery of pedagogical PD to academics in an institution. As a topic, I suspect this is stronger than my own because it starts from something that seems fairly straightforward but allows for wide exploration of many factors that shape this work and the people that do it. I’ve had an internal resistance to case studies for some reason (which I’ve been rethinking in recent months), possibly because it feels too small for the ideas that I’m trying to bring together. More thinking to do on this I’d say.

One final thought – I do think it would be great to have a global network of the edvisors (and academics) doing research on edvisors. This partially feels like one of those procrastinatory rabbit-hole ideas that I have in place of doing actual work but it’s at the very least something for the backburner.

Uibelhoer, D. (2020). Practicing What They Preach: A Case Study Exploring the Experiences of Instructional Designers as Educators of an Online Teaching Certificate Program [Ph.D., Seton Hall University]. http://search.proquest.com/docview/2469533673/abstract/F0172862CA4E48BBPQ/1

Research update #51: Been a long time Been a long time Been a long lonely lonely lonely lonely lonely time*

Actually it hasn’t been that lonely at all, life is pretty good on that front, but it certainly has been a long time since I last posted here – coming up to 3 months.

So why is that? Well, I moved cities and changed jobs for one thing. After 16 years in Canberra and three at ANU, I’ve finally returned to Melbourne to work as a Senior Learning Technologist at Swinburne University of Technology. It’s a step up in many ways and it also gives me an opportunity to develop some insights about how a centralised TEL support unit works.

In the times that I have found to work on revising my thesis proposal, which my supervisor has assured me can be a little late because life changes are factored in, I’ve been looking at some significant structural issues and fleshing out the core areas that have been a little thin or overlooked. Conducting more empirical research on edvisor numbers, origins and edvisor unit structures absolutely makes sense, given the paucity of existing data – it’s virtually all feelpinions, the closer I look at it – and I’m also starting to realise that while I like Bourdieu’s ideas about power and belonging, I have nothing to say that smarter people haven’t already said about it or used it for.

I’m also trying to work out how this research can dovetail with the wider objectives of the TELedvisors SIG and how both can inform the other. It hadn’t occur to me that this was something that I could talk about in my research proposal but Peter sees it as a strength, so that sounds good to me. This does mean that I need to explore some new ideas (such as Participatory Design and Development) to see if that can give this a framework but my ducks are now all in a row and I’m well into the process of actually rewriting draft 2.

There is a mountain more to learn in my new role – far more management and operational responsibility than I’m accustomed to – and we’re in the midst of some massive projects (transitioning from Blackboard to Canvas, rolling up Echo360 ALP upgrades and training, looking for an ePortfolio, looking at badges, developing an education technology evaluation pipeline) but I’m incredibly glad to be here.

Yesterday’s TELedvisor SIGs both look like they could be particular helpful in both work and study as well. Check them out below.

 

Research update #38: Proposal writing Day 2 – more on edvisors, less on edvisors & institutions

I’m kind of just staring at the screen now with 27 different tabs open across two browsers so I guess it’s time to take a mental break at the very least. Going by my schedule, I was meant to have knocked out 750 words on the relationship between edvisors and institutions – or my precisely I guess institutional management/leadership. I currently have 129.

But that’s because I only wrote about 500/1000 yesterday on edvisors more broadly. I think part of my challenge is that, first draft or not, I still like to try to turn out a moderately elegant sentence that flows smoothly into the next one and advances the story or idea. What I need to do is worry less about this and just get the brutish ugly ideas down so that they might be prettied up later.

The bigger issue though is that I didn’t put enough time into getting all my sources, quotes and ideas into a single location before I started writing. I’ve spent enough time with the literature to know broadly what it says and how I want to bring it together and I know I have the citations to support this but I didn’t put them all into the notes document. They are instead, scattered through this blog, Zotero and assorted stacks of paper with pencil notes scrawled all through them. The point of blogging about many of these papers was to create a searchable archive of these ideas but with the way that the question has changed over time, the way that I have tagged these posts has not quite kept pace.

I’m still enjoying the writing and being forced to commit to particular ideas and language, I’m just slightly up in the air about whether it would be more beneficial to stop and spend the time assembling everything before I proceed or if I should just press on, write what I can as a first draft and then come up with a much improved second draft by bringing all the stray elements together. The latter seems the way to go as I’m well versed in the fine arts of procrastination and preparation, endless preparation is absolutely one of my go-tos in this regard. The other advantage of just writing is that it will let me work out the structure a little better which should make the process of searching for and gathering the quotes and citations a lot simpler.

I hit the 1000 word target for the edvisors section just before lunch but later felt that a discussion of the place of credentialing might sit better in the edvisors and institutions section. I was also a little concerned that I was discussing literature without really explaining why or what I was looking for in particular, so once more I spent a little more time than planned on that section. I had initially planned on 2000 words for my discussion of edvisors in the literature but revised this to 1000 on advice from Lina. I have a feeling that I could probably hit the 2000 without too much trouble as I dig deeper into the tensions between academic and professional edvisors.

Most of my thinking until recently revolved around the bizarre love/hate triangle between academics, institutional management/leadership and edvisors and how this impacts upon collaborative relationships. I’d kind of put aside the internal tensions both between academics and professional staff – particularly in the academic developer space where there’s a big question about where scholarly research fits into edvisor practices – and also between variously located teams within institutions. Most commonly central vs college/faculty based but there is also some toe-treading that occurs between rival disciplinary teams. The good news is that it’s all just more material to work with.

So while I’m not hitting my perhaps ambitious writing targets yet, the ideas are flowing.

 

Thoughts on: Reconceptualising academic work as professional practice: implications for academic development (Boud & Brew, 2013)

I’ve been really struggling to process my thoughts on this paper for the last week. I’ll read a few pages, furiously scribbling notes all over it, and then need to step away to deal with my responses to it.

Now this isn’t particularly uncommon for me as it helps me feel that I’m part of a discourse and I try to create action items for future followup, particularly with citations. It often also feels like the most convenient place to jot down other ideas, like the spectrum of edvisor practices that I’ve started on the bottom of page two there. But I think I’ve probably written more on this paper than most because while I agree with most of the broad principles, the lack of understanding that it demonstrates of the practices of academic development and the capacity of academic developers to effect significant change in the institution undercuts much of what it has to say. Which surprises and disappoints me, particularly because I’ve spoken to one of the authors on several occasions and have great respect for his other work and I’ve read many of the other author’s papers and hold her in similar esteem. She has also, according to her bio, worked as an academic developer and co-edited the academic journal that this paper appears in, which makes it even harder to understand some of the misperceptions of this kind of work.

Which leads me to question my own perceptions. Am I overly defensive about what feels like an attack of the competence and professionalism of my colleagues and I? Is the environment that I work in uniquely different and my attitudes towards the development of academics that far out of the norm suggested by this paper? Perhaps most importantly am I taking this too personally and is my emotional response out of proportion to the ideas in the paper?

I suspect that part of my frustration is that the paper begins by talking about something which sounds like academic development but which ends up being a call for a complete revision of all aspects of academic practice and an implication that academic developers should really do something about that.

Assuming that academic development or academic developers are even actually necessary in the first place. There are a couple of telling remarks that, to me at least, strongly imply that academic development is a cynical exercise by university management to impose training on an academic staff that doesn’t need it – they did a PhD after all – in the interests of ensuring compliance with organisational policy and being seen to do something.

Or to put it another way (emphasis mine):

The development of academics is based on the notion that institutions need to provide opportunities for their academic employees to develop across a range of roles. Any initial training (e.g. through undertaking a PhD) is not sufficient for them to be able to meet the complex and increasing demands of the modern academy. Their development is an essentially pragmatic enterprise aimed at making an impact on academics and their work, prompted by perceptions that change is needed. This change has been stimulated variously by: varying needs and a greater diversity of students, external policy initiatives, accountability pressures and organisational desires to be seen to attend to the development of personnel. (p.208)

“Varying needs” almost seems to be used as a get-out-of-jail free card for those apparently rare instances where an academic might benefit from some additional training to be able to meet their responsibilities in teaching, research, service and potentially management.

There’s another section where the authors discuss the challenges of academic development. It’s close to a page long – 4 solid paragraphs, 22 lengthy sentences – yet it lacks a single citation to support any of the assertions that the authors make. The main argument made is that academic developers (and their units) don’t provide academics with the development that will help them because the developers are beholden to the agendas of the institution. The same institution, I should mention, that is governed at an executive level by senior academics who presumably have a deep understanding of academic practices.

Like most forms of education and training, academic development is continually at risk from what might be termed ‘provider-capture’, that is, it becomes driven by the needs of the providers and those who sponsor them, rather than the needs of beneficiaries’ (p. 210)

The main objection that the authors appear to have is that the institution takes a simplistic approach to training – because, reasons? – that implies that academics don’t already know everything that they need to.

…academic development has a tendency to adopt a deficit model. It assumes that the professionals subject to provision lack something that needs to be remedied; their awareness needs to be raised and new skills and knowledge made available. The assumption underpinning this is that without intervention, the deficit will not be addressed and academics not developed. (p.210)

Correct me if I’m wrong but I suspect that this is precisely the attitude that lies at the heart of the teaching practices of many academics. The students need knowledge/skills/experience in the discipline and its practices and the teacher will help them to attain this. Is the implication that academics deserve to be developed better than their students? Does it suggest a deficit in the pedagogical knowledge of academics? I would argue that this description undervalues the sophistication of work done by both academics and academic developers. Which the authors hypothetically note but then immediately discount based upon…? (Emphasis mine)

Such a characteristation, many developers would protest, does not represent what they do. They would argue that they are assiduous in consulting those affected by what they do, they collect good data on the performance of programmes and they adjust what they do in the light of feedback…they include opportunities for academics to address issues in their own teaching, to research their students’ learning and to engage in critical reflection on their practice. Developers undoubtedly cultivate high levels of skill in communicating and articulating their activities for such a demanding group. Nevertheless they are positioned within their institutions to do what is required of them by their organisation, not by those they claim to serve.  (p.210-211)

It’s hard to go past “those affected by what they do” as an indicator of the attitudes towards academic developers. I’d also make the point that I’ve come across few institutions with a comprehensive, practical strategy on teaching and learning and it generally falls on academic developers to use their extensive professional knowledge and experience to offer the best advice and support available in the absence of this.

The other significant point that I feel that the authors have completely missed – again perhaps surprisingly given their experience – is that, in my experience at least, academic professional development is almost never mandated and simply getting academics to attend PD is a task unto itself. The authors must certainly be aware of this, having written a recent paper (2017) that I found invaluable about academic responses to institutional initiatives. (Spoiler alert, it’s like herding sleeping cats). Academic developers are painfully aware of this – imagine spending days preparing a workshop or seminar only to have two attendees – and this if nothing else necessitates design of PD activities that are as relevant and attractive to academics as possible. I won’t dispute that the further away academic development teams are from academics – e.g. centralised teams – the harder it can be to do this and the more generic content becomes but even these areas have a deeper understanding of academics and their needs than is implied. (And I still have more to say about the practical realities of delivering PD that can wait for now)

Now that we’ve gotten past that – and it was something that I evidently needed to say – we start to get to the nub of what the authors would prefer instead of this ‘deficit model’.

The authors draw on Schatzki’s (2001) work in Social Practice theory, which is an area that I’ve spent some time looking at and which I see the value of. My introduction came through the work of Shove et al (2012) who present a slightly different perspective, a more streamlined one perhaps, but fundamentally the same. Where Shove et al identify three major elements to practice – meaning, materials and competences, Schatzki is a little more granular and includes elements such as emotions/moods, projects, tasks and ends. Arguably these could sit in the three elements of Shove et al but there might be something in looking more deeply at emotions/moods particularly. Maybe I’ll end up taking a Shovezki based approach to practice theory.

At the risk of oversimplifying it, from what I can see practice theory necessitates taking a more holistic perspective of being an academic and recognising that the different practices in the bundle of practices (or is it a complex – one or the other) that make up “being an academic” all occur in a specific context involving the practitioner, time, space and the larger meaning around what is being done. These sub-practices – such as teaching, research, service – can be in competition with each other and it is necessary to factor them in when providing PD training that relates to any other of them. Now this is an avenue of thinking that I’ve been pursuing myself, so obviously I’m pretty happy with this part of the paper. When we look at why an academic doesn’t undertake an activity to enhance their teaching, the current research rarely seems to answer – ‘well it was partially because they had to put together an application for research funding and that took priority’. This much I appreciate in the paper.

Where I think the paper runs into trouble though is that it makes a case for a slightly hazy approach to re-seeing academics practices as a whole, taking into consideration the following six factors that shape them:

  1. Embodiment – “It is the whole person who engages in practice, not just their intellect or skills… Desires, emotions and values are ever present and cannot be separated out” (p.212)

  2. Material mediation – “Practice is undertaking in conjunction with material arrangements. These may include objects such as raw materials, resources, artefacts and tools, physical connections, communication tools, organisms and material circumstances (Kemmis, 2009). These materials can both limit and enable particular practices” (p.212)

  3. Relationality – “Practice occurs in relation to others who practice, and in relation to the unique features a particular practitioner brings to a situation. Practice is thus embedded in sets of dynamic social interactions, connections, arrangements, and relationships” (p.212)

  4. Situatedness – This I’d call context – “…in particular settings, in time, in language… shaped by mediating conditions…” that “may include cultures, discourses, social and political structures, and material conditions in which a practice is situated” (p.213)

  5. Emergence – “Practices evolve over time and over contexts: new challenges require new ways of practising” (p.213)

  6. Co-construction – “Practices are co-constructed with others. That is, the meaning given to practice is the meaning that those involved give it” (p.213)

In my personal experience, I don’t believe that many academics give their practices, particularly teaching, anywhere near this level of reflection. It’s probably fair to say that few academic developers would either, at least not consciously. The authors believe that using this new practice frame

“…moves academic development from a focus on individuals and learning needs to academic practice and practice needs; from what academics need to know to what they do to enact their work” (p.213-214)

Maybe it’s just my professional background but I think that I pretty well always frame learning objectives in terms of the tangible things that they need to be able to do. On the other hand, my experience with academics is largely that many of their learning outcomes for their students begin with “understand x” or “appreciate the concept of y”. It’s not my job to be a discipline expert and I have no doubt that these are important learning outcomes to the academics – and I might still be misinterpreting how the authors are thinking about practices and learning design.

They go on to make an important point about the value of situated learning in professional development – conducting it in the space where the teacher teaches rather than in a removed seminar room in a building that they never otherwise visit. This makes me think that it would be valuable to have a simulated workspace for our students to learn in and I’ll give that some more thought but the logistics seem challenging at the moment as we undergo massive redevelopment. (This also acts as a pretty significant barrier to providing situated professional development, as teaching spaces are occupied from 8am to 9pm every day).

There’s an additional idea about the format of assessment conducted by ADs and what more beneficial alternatives might be considered.

“Learning is driven by, for example, by encountering new groups of students with different needs and expectations, or by working with a new issue not previously identified. Success in learning is judged by how successfully the practice with the new group or new issue is undertaken, not by how much is learnt by the individuals involved that could be tested by formal assessment practices” (p.214)

I completely support this approach to learning but I cannot see how it could ever be implemented with current staffing levels. If we’re going to think seriously about practices in an holistic way, perhaps a wider view needs to be taken that encompasses all of the participants in co-construction of the practice. This is probably where I think that this paper falls down heaviest – there seems to be a wilful blindness to ability to enact these new approaches. I also don’t see any academics ever moving to this kind of approach in their own teaching for the exact same reason.

This brings me to my larger challenge with this paper – from here (and perhaps in ignoring the logistical issues of situated learning in teaching spaces), there seems to be an expectation that it is up to academic developers and/or their units to make a lot of these significant changes happen. I can only imagine that this comes from the openly held perception that ADs are tools of ‘university management’ – which I will stress yet again is made up of academics – and that ADs are able to use these connections to management to effect major changes in the institution. I’m just going to quote briefly some of these proposed changes because I think it is self-evident how absurd that would be to expect ADs to implement any of them.

We suggest that a practice perspective would thus place greater emphasis on the development of academics:

(2) as fostering learning conducive work, where ‘normal’ academic work practices are reconfigured to ensure that they foster practice development; (p.214)

And this

“Working with individual academics to meet institutional imperatives, for example, curriculum reform, comes up against various stumbling blocks where academics complain that they are overworked, that there is too much to take on and that their colleagues are not supportive of what they are trying to do. Practice development means working with how that group juggles various aspects of their role and their attitudes and beliefs in relation to that. It is about how the group interacts in pursuing its practice, how and where interpersonal relationships are take account of the being of its members, how power and authority are negotiated, whose ideas are listened to and taken up and whose are denied” (P.215)

So, I’ll change the entire culture of academia and then after lunch… I know that sounds cynical but if the VC can’t enact that kind of a mindset shift…

I don’t disagree with any of these changes by the way but even in my relatively short time in the H.E. sector I have had it made painfully clear to me that the expertise of professional staff is basically never considered in these processes, so this paper is wildly misdirected.

The paper wraps up with a few more achievable suggestions that I think ADs have known for a long time already and try to enact when possible. Offering training or advice about something (e.g the grading system in the LMS) is going to be more valuable in some temporal contexts (weeks of semester) than others, learning more about academics and their particular practice needs – again, generally teaching as I suspect there is hierarchy of things that academics never want to have their knowledge questioned on – discipline knowledge, research skills, teaching and then technology. I might look into how often academics go to research training after they finish PhDs. I suspect it will be rarely – but I don’t know. (I should probably know that)

The authors also suggest that ADs might take a project based approach, a consultancy one or a reflective one to their development work and I would consider that communities of practice probably sit well with the latter.

Ultimately, while I am broadly supportive of many of the approaches and the more holistic viewpoint put forward in this paper, expecting ADs to implement many of the larger changes seems to demonstrate a lack of awareness of the powerlessness of people in these kinds of roles. What is proposed would largely require a significant cultural shift and to be driven from the top. Of course, the latter paper by Brew, Boud et al (2017) shows the utter folly of expecting that to succeed.

 

 

 

Thoughts on: The Herckis research in progress into barriers to TEL in Higher Ed

L. Herckis, personal communication, July 10, 2017

I’ve been banging on about this a bit here recently but that’s only because I’m enjoying the new perspective on this issue, which is kind of at the heart of my day to day work and my own research. Unlike most if not all of the other research that I’ve read in this space, this comes from an anthropological background and seems far more interested in looking beyond what academics say to explore what they actually mean when it comes to talking about their teaching and learning (and particularly TEL and innovation practices).

I don’t think that people often go out of their way to be deliberately deceptive in the way they discuss or think about their teaching practice (we have committees and office politics for that – zing) but I think we all also like to consider ourselves as the heroes of our own narratives and this can get in the way of truly understanding what (or who) gets in the way of innovation and iteration. (I don’t believe in change for change’s sake either, just to be clear – I think it’s just as important to identify and celebrate the things that we do that works and support them, but that’s a matter for another day)

As a baby researcher (no, that sounds weird, let’s try pre-researcher – presearcher?) and one with minimal knowledge of anthropology, I won’t presume to comment on the methodology, suffice to say it seems sensible  – mixed method including an ethnographic observation, surveys and interviews – and appears to already be yielding interesting results in the early phases of the work and analysis.

Given that this is research in progress, I’ll just highlight what I’ve found to be key points so far.

The author mentions ‘refinement’ as a stage in the innovation process – which I would take to be an evaluation and iteration/modification process – which is nice but it seems to be so rarely implemented formally that it might be nice to break this into these two parts. More than anything though, these challenges indicate to me that there might need to be support from someone (or a team) that is able to offer a more holistic perspective on an innovation process – I would suggest, unsurprisingly, working collaboratively with an education design support unit (TEL edvisors if you will), so that some of the issues relating to the transitions to different stages of the process are mitigated because there is constancy of people involved.

Some nice stuff about the needs for a more collaborative model of teaching innovation. Getting this message across (for me at least) is one of my challenges – I was told pretty categorically this week by a senior member of the exec that teaching is an individual endeavour and that a community of practice is probably a waste of time (that’s paraphrased)

Overall it seems as though this work aims to lead to solid, practical and applicable outcomes. One of my greatest concerns about entering research is whether it might have a practical application, beyond just being a contribution to the wider pool of understanding. Some have told me that the latter is the primary purpose of research, which feels limiting to me so it’s nice to see a different take.

Many factors identified that impact of the success of an innovation project, including the very hard to untangle political and psychological. Interestingly, many issues seem resolvable far more simply than one would expect if there are visible career benefits or opportunities to work with respected peers, which makes me think that some of the barriers raised and emphatically identified as insurmountable are largely made of bluster.

Coming back to my earlier comment about the difference between what people say and what they think, Herckis uses techniques from her discipline to cleverly swerve around this. Framing questions in terms of ‘what would your (very similar to you) colleague think about this issue?’ lets people filter out their own personal biases and answer a question more objectively. Perhaps it lets them move past the need to be the hero of their own story and be consider it from a slightly more critical perspective.

I might just summarise the rest of what I’ve found to be the most interesting and revealing findings to date.

After surveying participants about their attitudes to SoTL (and SoTEL) and their perceptions of their institutions attitudes to the same, it emerged that the gap between these attitudes worked in different ways, depending on whether you are an early career teacher or a senior one. I have to note that different institutions have different organisational structures for their academics and there is more to this than simply being an early or late career teacher. Being more research oriented or having tenure, for example, are obviously going to shape attitudes and behaviours as well and there are always going to be a raft of local cultural factors at play too. That said, the fact that there are differences in outlook based on this seems like a pretty big deal.

When early career teachers feel that the institution values teaching less than they do (significantly), they are less inclined to innovate. With senior teaching academics however, in this instance they are more likely to do so, perhaps because they see it as their duty to help the institution raise the bar. This sounds somewhat like a question of power or privilege – don’t want to rock the boat vs not having to care – and probably more than anything else in this paper has started me thinking that different approaches need to be taken in my teaching/TEL edvisor role with junior and senior staff.

A couple of final factors come to play more than I had considered – and this is perhaps a disadvantage of my outsider role. While the ever-present time, capability and resourcing issues are at the forefront of academic resistance to revising their approaches to teaching and innovation, the prospect of working on this with an esteemed colleague, of future professional opportunities or of receiving good press can push these concerns to the background.

An overemphasis on student satisfaction measurements was identified as a major barrier, the fact that many (untrained) teachers lean very heavily on how they were taught, misalignments between institutional change and teaching needs and a belief that there is little to be learnt from teaching approaches in other disciplines also all crop up. Almost all of which I put down to issues surrounding culture, ultimately.

Definitely looking forward to the next phases of this particular research and working out how to make use of it in practice.

 

 

 

 

 

Research update #20 – Language language covfefe

Nothing like using a word that will be terribly dated in a week’s time in a title to anchor it in space/time. Language has been a particular interest in the last few weeks and months as I have worked with my TELedvisor co-convenors to explore the different role types and practices of TEL edvisors – notably academic developers, education/… designers and learning/… technologists. I presented about our work yesterday at our TELedvisors webinar – if you’re interested, I’ll add the video at the end of this post. The last 20 mins is discussion but it was a pretty interesting conversation. Dom McGrath from UQ was the other presenter and (happily) his work took a slightly different approach but I think we arrived at largely the same conclusions.

Language was still a challenge even as we discussed final touches on the paper this morning – the nature of design vs develop and what these practices really mean and also what the develop in Academic Developer really means. (My take is that it helps to see that mostly as a training role and keep ‘develop’ to the practice of building things like learning resources or curriculum but I don’t think we’re all 100% on the same page – which is fine because this is representative of the bigger issue around the lack of clarity in this language in our sector)

I’ve forgotten to look at my list of Pat Thomson PhD blog questions for a little while but here’s this week’s.

Am I too hard on myself?

Maybe? Probably? I hope that it’s more about an attitude of continuous improvement but I’m much more interested in the bits that can be better than the bits that are working – I’m happy to just leave them be. I know that perfect is the enemy of the good and I think I’ve made strides in accepting when things are good enough but I also like to think that I have high standards, so it’s a toss-up. My bigger worry is less that I am hard on myself but that this normalises being hard on others – by being open to (ideally constructive) criticism and perhaps trusting it more than praise – childhoods, ugh – I suspect that I might think everyone has the same attitude and is more accepting of criticism than they actually are. I guess it’s probably mainly a matter of walking more confidently on that fine line between helping and offending.

Thoughts on: The Dynamics of Social Practice; Chapter 6 Circuits of Reproduction (Shove et al, 2012)

This chapter seemed to take forever to work through, possibly because a bit of life stuff came up in the interim but it’s also at the more complex end of the discussion. It concludes the overall examination of the dynamics of social practice and in some ways felt like a boss level that I’d been working up to. Most of the chapter made sense but I must confess that there is a page about cross-referencing practices as entities that I only wrote “wut?” on in my notes. Maybe it’ll make more sense down the road.

The good news is that there was more than enough more meaningful content in this chapter to illuminate my own exploration of practices in my research and it sparked a few new stray ideas for future directions. There’s a decent summary near the end of the chapter that I’ll start with and then expand upon. (The authors do great work with their summaries, bless them)

In this chapter we have built on the idea that if practices are to endure, the elements of which they are made need to be linked together consistently and recurrently over time (circuit 1). How this works out is, in turn, limited and shaped by the intended and unintended consequences of previous and co-existing configurations (circuit 2). Our third step has been to suggest that persistence and change depend upon feedback between one instance or moment of enactment and another, and on patterns of mutual influence between co-existing practices (circuit 3). It is through these three intersecting circuits that practices-as-entities come into being and through these that they are transformed. (p.93)

So let’s unpack this a little. There are a number of reciprocal relationships and cycles in the lives of practices. The authors discuss these in two main ways – through the impact of monitoring/feedback on practices (both as individual performances and larger entities) and also by cross-referencing different practices (again as performances and entities)

Monitoring practices as performances

A performance of a practice will generate data that can be monitored. It might be monitored by the practitioner (as a part of the practice) and it might also be monitored by an external actor that is assessing the performance or the results/outputs. (This might be in an education/training context or regulatory or something else). This monitoring then informs feedback which improves/modifies that performance and/or the next one/s and so the cycle continues. In some way, potentially, in every new performance, the history of past performances can help refine the practice over time.

This isn’t all that evolves the practice; materials, competences and meanings play their part too, but it is a significant factor.

Monitoring, whether instant or delayed, provides practitioners with feedback on the outcomes and qualities of past performance. To the extent that this feeds forward into what they do next it is significant for the persistence, transformation and decay of the practices concerned… self-monitoring or monitoring by others is part of, and not somehow outside, the enactment of a practice (what are the minimum conditions of the practice?) is, in a sense, integral to the performance. Amongst other things, this means that the instruments of recording (the body, the score sheet, the trainee’s CV) have a constitutive and not an innocent role. (p.83-4)

So far, so good. This also makes me think that many practices are made up of elements or units of practice – let’s call them steps for simplicity. The act of monitoring is just another step. (This does take us into the question of whether it is a practice or a complex/bundle of practices – like driving is made up of steering, accelerating, braking, signalling etc – but nobody says they’re going out accelerating)

Monitoring practices as entities

Looking at a practice as an entity is to look much more at the bigger picture of the practice.

the changing contours of practices-as-entities are shaped by the sum total of what practitioners do, by the variously faithful ways in which performances are enacted over time and by the scale and commitment of the cohorts involved. We also noticed that practices-as-entities develop as streams of consistently faithful and innovative performances intersect. This makes sense, but how are the transformative effects of such encounters played out? More specifically, how are definitions and understandings of what it is to do a practice mediated and shared, and how do such representations change over time (p.84)

An interesting side-note when considering the evolution of practice is the contribution of business. This example was in a discussion of snow-boarding

As the number of snowboarders rose, established commercial interests latched on to the opportunities this presented for product development and profit (p.85)

This ties back to the influence of material elements (new designs and products in this case) on shaping a practice.

Technologies are themselves important in stabilising and transforming the contours of a practice. In producing snowboards of different length, weight, width and form, the industry caters to – and in a sense produces – the increasingly diverse needs of a different types of user… Developments of this kind contribute to the ongoing setting and re-setting of conventions and standards. (p.85)

This in turn brings up back to one of the other key roles played by monitoring (and feedback) in terms of practices as entities, which is describing and defining them. The language that is used to describe a practice and its component parts and also to define what makes good practice is of vital importance in determining what a practice is and what it becomes.

…if we are to understand what snowboarding ‘is’ at any one moment, and if we are to figure out how the image and the substance of the sport evolves, we need to identify the means by which different versions of the practice-as-entity relate to each other over time. Methods of naming and recording constitute one form of connective tissue. In naming tricks like the ollie, the nollie, the rippey flip and the chicken salad, snowboarders recognise and temporarily stabilize specific moves. Such descriptions map onto templates of performance- to an idea of what it is to do an ollie, and what it means to do one well… in valuing certain skills and qualities above others, they define the present state of play and the direction in which techniques and technologies evolve. (p.85)

So clearly, monitoring and description and standardisation/regulation and the dissemination of all of this is hugely important on practices. Interestingly, a Community of Practice for TEL edvisors that I’ve started recently had our first webinar yesterday looking at the different standards that Australian universities have for online course design. It probably merits a blog post of its own but I guess it’s a good example of what needs to happen to improve Technology Enhanced Learning and Teaching practices.

The final piece of the puzzle when it comes to monitoring – which ties back to our webinar nicely once more – is mediation.

Describing and materializing represent two modes of monitoring in the sense that they capture and to some extent formalize aspects of performance in terms of which subsequent enactments are defined and differentiated. A third mode lies in processes of mediation which also constitute channels of circulation. Within some snowboarding subcultures, making and sharing videos has become part of the experience. These films, along with magazines, websites and exhibitions, provide tangible records of individual performance and collectively reflect changing meanings of the sport within and between its various forms. Put simply, they allow actual and potential practitioners to ‘keep up’ with what is happening at the practice’s leading edge(s) (p.86)

I find the fact that monitoring/documenting and sharing the practice is considered an important part of practice quite interesting. Looking at teaching, I’ve tried to launch projects to support this in teaching but management levels have not seen value in this. (I’ll just have to persevere and keep making the argument).

There’s another nice description of the role of standards

…standards, in the form of rules, descriptions, materials and representations, constitute templates and benchmarks in terms of which present performances are evaluated and in relation to which future variants develop (p.86)

The discussion of the role of feedback notes that positive feedback can be self-perpetuating, in “what Latour and Woolgar refer to as ‘cycles of credibility’ (1986). Their study of laboratory life showed how the currencies of scientific research – citations, reputation, research funding – fuelled each other. In the situations they describe, research funding led to research papers that enhanced reputations in ways which made it easier to get more research funding and so on” (p.86)

Ultimately, feedback helps to sustain practices (as entities) by keeping practitioners motivated.

At a very basic level, it’s good to know you are doing well. Even the most casual forms of monitoring reveal (and in a sense constitute) levels of performance. In this role, signs of progress are often important in encouraging further effort and investment of time and energy (Sudnow, 1993). The details of how performances are evaluated (when how often, by whom) consequently structure the careers of individual practitioners and the career path that the practice itself affords. This internal structure is itself of relevance for the number of practitioners involved and the extent of their commitment (p.86)

Cross-referencing practices-as-performances

The act of participating in a performance of a practice means that it has been prioritised over other practices – the time spent on this performance is not available to the others.

…some households deliberately rush parts of the day in order to create unhurried periods of ‘quality’ time elsewhere in their schedule. In effect, short-cuts and compromises in the performance of certain practices are accepted because they allow for the ‘proper’ enactment of others (p.87)

Shove et al examine the importance of time as a tool, a coordinating agent that helps in this process. In a nutshell, it is a vital element of every practice and shapes the interactions between practices (and also practitioners). They move on to explore the change from static ‘clock-time’ to a more flexible ‘mobile-time’. Their argument is essentially that our adoption of mobile communication technologies (i.e. smart phones) is giving us a more fluid relationship with time because we can now call people on the fly to tell them that we are running late.

However some commentators are interested in the ways in which mobile messaging (texting, phoning, mobile emailing) influences synchronous cross-referencing between practices (p.88)

I’ll accept that mobile communication is changing the way we live but I’m not convinced that it is having the impact on practices that the authors suggest. Letting someone know that you’re running late particularly doesn’t change what is to be done, it just pushes it back. Perhaps letting someone know of a change of venue has more impact, in that it would allow a practice that might not otherwise have occurred to do so, but this doesn’t strike me as something that would happen regularly enough to change our concepts of time or practice.

The authors express this somewhat more eloquently than I:

But is this of further significance for the ways in which practices shape each other? For example, does the possibility of instant adjustment increase the range of practices in which many people are involved? Does real-time coordination generate more or less leeway in the timing and sequencing of what people do? Are patterns of inattention and disengagement changing as practices are dropped or cut short in response to news that something else is going on? Equally, are novel practices developing as a result? In thinking about these questions it is important to consider how technologies of ‘micro’-coordination relate to those that operate on a global scale (p.89)

Another significant idea that this generated for me was that the things that we do shape our world because we design and modify our world to suit the things that we do. This then may change our ability to do those things and we enter a cycle where practice shapes environment shapes practice etc.

Or as the authors put it:

we have shown that moments of performance reproduce and reflect qualities of spacing and timing, some proximate, some remote. It is in this sense that individual practices ‘make’ the environments that others inhabit (p.89)

I guess then, the real question is how we as TEL edvisors can make this work for us.

Cross-referencing practices-as-entities

This is the section that lost me a little but parts made sense. It’s something to do with the way that separate practices might be aggregated as part of a larger issue – such as eating and exercise both sit within this issue of obesity. Clearly obesity isn’t a practice but it does encompass both of these practices and creates linkages that wouldn’t necessarily otherwise be there. This happens in part by tying in monitoring and creating a discourse/meaning attached to them all.

The authors refer to this combination of the discourse and the monitoring via measurement technologies as “epistemic objects, in terms of which practices are conjoined and associated, one to another” (p.92). (And arguably monitoring and discourse create their own cyclical relationship)

They move on to expand the significance of the elements of a practice (material, competence and meaning),

this time viewing them as instruments of coordination. In their role as aggregators, accumulators, relays and vehicles, elements are more than necessary building blocks: they are also relevant for the manner in which practices relate to each other and for how these relations change over time. (p.92)

Writing and reading – as competences rather than practices I guess – occupy a vital space here in terms of the ways that they are vital in the dissemination of practices, meanings and techniques.

They discuss two competing ideas by other scholars in the field (Law and Latour) that posit that either practices need elements to remain stable for significant periods of time to allow practices to become entrenched or that they benefit from changes in the elements that enable practices to evolve. I don’t actually think that these positions are mutually exclusive.

Other thoughts

I jotted down a number of stray thoughts as I read this chapter that don’t necessarily tie to specific sections, so I’ll just share them as is.

Is a technology a material or does it also carry meanings and competences?

Does research culture/practice negatively impact teaching practice? Isolated and competitive – essentially the antithesis of a good teaching culture.

Does imposter syndrome (in H.E. specifically) inhibit teachers from being monitored/observed for feedback? Does rewarding only teaching excellence inhibit academic professional development in teaching because it stops people from admitting that they could use help. Are teaching excellence awards a hangover from a research culture that is highly competitive?
What if we could offer academics opportunities to anonymously and invisibly self assess their teaching and online course design? 

Is Digigogy (digital pedagogy) the ‘wicked problem’ that I’m trying to resolve in my research – in the same way that ‘obesity’ is an aggregator for exercise and eating as practices? I do like ‘digigogy’ as an umbrella term for TEL practices.

Where do TEL edvisors sit in the ‘monitoring’ space of TEL practices?

This ‘epistemic objects – cycle of monitoring/feedback and discourse’ is probably going to play a part in my research somehow. Maybe in CoPs.

So what am I taking away from this?

I guess it’s mainly that there are a lot of different ways in which practices (and performances of practices) are connected which impact on how the evolve and spread. Monitoring and feedback – particularly when it is baked into the practice – is a big deal. The whole mobile time thing feels like an interesting diversion but the place of technology (and what exactly it is in practice element terms) will be a factor, given that I’m looking at Tech Enhanced Learning. (To be honest though, I think I’m really looking at Tech Enhanced Teaching)

In specific terms, it seems more and more like what I need to do is break down all of the individual tasks/activities that make up the practice of ‘teaching’ – or Tech Enhanced Learning and Teaching – and find the cross-over points with the activities that make up the practice of a TEL edvisor. I think there is also merit in looking at the competition between the practices of research for academics and teaching, which impacts their practice in significant ways.

On now to Chapter 7, where the authors promise to bring all the ideas together. Looking forward to it.