Tag Archives: ePortfolio

Thoughts on “Academic Leaders’ perspectives on adopting ePortfolios for developing and assessing professional capabilities in Australian Business Education” (Holt et al, 2016)

While I’m still letting the sociomaterial stew simmer in the back of my mind, it seems like a good time to dig in to something that feels slightly more practical (not to mention incredibly relevant to my day to day work).

This paper is about the first stage of research in a major Australian project looking at the use of (and attitudes towards) ePortfolios in Higher education business schools. As someone working in a business school and advocating the use of ePortfolios, it is unsurprisingly of some interest. Now that we’ve had a real live semester of ePortfolios actually being used in teaching – rather than speculated upon – it’s particularly nice to be able to come to this with something more than a theoretical viewpoint. (I’ll freely admit that it was used only in two subjects and in one, the lecturer only picked up the tool in week 6 of a 13 week semester, but what they’ve already learned and the success that they have had has been incredibly encouraging)

As you might expect, the paper dives into a detailed explanation of the context of using ePortfolios in Higher Ed – it notably hasn’t been as commonly used in business disciplines, something that the authors attribute in part to the diversity of kinds of disciplines in this field. Some (e.g. accounting) have distinct pathways with clearly articulated accreditation leading to specific careers while others contribute more generally to a student’s ability to work in ‘business’. The authors suggest that professions including medicine, law, engineering, teaching and architecture might be more suited to tools and practices supporting the collection of evidence that can be used in external accreditation processes and this might be why ePortfolios have been reported on less frequently in business. All the same, they argue that there are still many compelling reasons that ePortfolios should be used in business schools.

This paper focuses particularly on attitudes towards ePortfolios amongst academic leaders in business schools – Associate Deans (Education/ Teaching & learning), program/course directors and subject/course/unit conveners. (It does seem that survey responses from teachers were also accepted though the details on this are a little hazy).

A lot of reasons (excuses?) are given for why ePortfolios aren’t being used widely which align with those that I’ve come across commonly in the literature (and day to day practice) about the use/non-use of ed. tech in general. Seeing these has helped me to reframe my research question – though I still need to run this by my supervisors – to How can (and do?) Education (or TELT?) Advisors help universities overcome barriers to adopting TELT practices? (Previously – How can Higher Education better support TELT practices?). This is no small thing for me, as it feels like I’m narrowing the focus of the research to something more achievable and personally meaningful.

Anyway, there are a few points of particular interest that this paper covers – reasons for using ePortfolios in business ed., perceived strengths amongst management and the beginnings of a framework for effective implementation of ePortfolios in this space.

Reasons to use ePortfolios

The use of ePortfolios across Higher Ed. is tied very closely to the development of professional capabilities (a.k.a competencies) and employability skills. I’d suggest that the technology can do more than this in terms of offering new opportunities for content management, creation and publishing that might finally enable us to move beyond linear text heavy essays into student construction of richer resources that more adequately reflect the world that we now live in. That said, the portfolio has been a vital tool for demonstrating one’s skills to prospective employers for centuries and the ePortfolio is simply the latest iteration of this.

The authors identify a common set of professional capabilities that universities aspire to equip students with via threshold learning outcomes and program and graduate attributes. ( I think we include something about being a global citizen and thought leader but the rest all seem fairly common and laudable)

1. Professional judgement: Use knowledge and skills to solve novel business challenges.
2. Problem solving: Use knowledge and skills to identify and solve common business problems.
3. Communication: Demonstrate oral, written and visual communication skills appropriate to the needs of different business stakeholders.
4. Teamwork: Demonstrate skills in working collaboratively with colleagues in undertaking complex and varied work tasks.
5. Leadership: Demonstrate skills in constructively influencing the work of colleagues individually and in teams towards mutually agreed goals.
6. Digital literacy: Use knowledge and skills in ICT to frame, analyse and report on business problems and their solutions.
7. Self-management: Demonstrate skills in self-initiative, self-motivation and self-directed learning in business studies and practices.
8. Creativity and innovation: Demonstrate the capacity to generate new ideas to meet customer needs, and in the understanding of how good ideas become marketable products.
9. Entrepreneurship: Appreciate how new businesses are created, grow and adapt to changing market conditions.
10. Social responsibility: Develop a critical awareness of businesses’ obligations to the societies within which they operate, and to those parties who directly contribute to their viability.
11. Cultural awareness: Demonstrate knowledge and skills in working effectively with cultural diversity as related to global and international business practices.
12. Sustainability as applied to business organisations: Develop a critical awareness of businesses’ need to evolve and adapt to the imperatives of an economically, environmentally and socially sustainable world in the service of future generations.
13. Ethics: Develop a personally meaningful set of values to guide professional practice which reflect honesty, fairness, respectfulness, loyalty, composure and competence. (p.5-6)

The academic leaders were asked which of these they rated as most important and which they were most satisfied with the current development of in their students. Communication and problem solving were rated as most important with entrepreneurship at the end of that list. (Accountants tended to rate creativity and innovation lower than others). In terms of how well they think their colleges/schools are doing, academic leaders felt most confident about problem solving, digital literacy and communication and least about leadership and creativity/innovation. (However, confidence in the teaching of all 13 capabiliities ranged from 2.53/5 to 1.68/5, so across the board, there’s work to be done in this space)

There’s also an interesting breakdown of the pedagogical approaches that academic leaders in business colleges saw as being valuable in supporting these varying capabilities – I’m not sure if they were provided with a set list because the choices seem limited. Exams are nowhere to be seen though, which I find heartening.

1. Problem solving: Ranked in order of decreasing importance, respondents indicated: 1. Case studies; 2. Projects; 3. Work-placement; and 4. Simulations, might be effective ways to assess a student’s ability to solve problems.
2. Communication: Case studies, projects, presentations and written work appear to be the most favoured ways to assess a student’s ability to communicate.
3. Teamwork: Group projects and work placements appear to be the most favoured ways to assess a student’s ability to work in a team.
4. Leadership: Projects appear to be the most favoured ways to assess a student’s ability to lead a team.
5. Digital literacy: Projects, simulations and assignments appear to be the most favoured ways to assess a student’s digital literacy.
6. Self-management: Projects and work placements appear to be the most favoured ways to assess a student’s ability to self-manage.
7. Creativity and innovation: Projects appears to be the most favoured way to assess a student’s creativity and innovation.
8. Entrepreneurship: Projects perhaps within a business context appears to be the most favoured way to assess a student’s entrepreneurial skills.
9. Social responsibility: Projects and Case studies appear to be the most favoured ways to assess a student’s sense of social responsibility.
10. Cultural awareness: International study and work tours appear to be the most favoured ways to assess a student’s cultural awareness.
11. Business Sustainability: Case studies, work placements and projects appear to be the most favoured ways to assess a student’s understanding of sustainability in a business context.
12. Professional judgement: Case studies, work placements and simulations appear to be the most favoured ways to assess a student’s professional judgement skills.
13. Ethics: Case studies and projects (p.9-10)

The perceived drivers of the implementation of ePortfolios offers some interesting insights into the value that academic leaders ascribe to ePortfolios and perhaps some selling points to stress when having the discussion about using them. (I have to admit at this point though that I’ve noticed that a lot of research seems to centre around people’s perceptions of things rather than the concrete realities of them. Maybe this is just the nature of education as a social science and there is certainly value in understanding why people make the decisions that they do in this space but just because people feel a certain way about a tool or a practice doesn’t necessarily make it so. Unless we are also looking at what is needed to shift perceptions, I’m not altogether sure what we hope to achieve by simply cataloguing them.)

The best reasons seen for using ePortfolios included “Improve student reflective learning”, “Enhance Student work placement experience”, “allow students to better demonstrate the achieve of learning outcomes to others” and “improve student understanding of learning outcomes.” (p. 11) Considered least important was “the imperative to use technology given the nature of the institution, i.e. mission, vision etc” (p.11) – which I’m fairly ok with and I’m also pretty happy that a teaching and learning goal was most highly valued. (But are people saying this because it seems like the right thing to say?)

In examining which kinds of support were most useful when using ePortfolios (and I suspect any other ed. tech), there was no clear preference for any of the following:

guidance on the purpose of the ePortfolio; guidance on how to use the ePortfolio; a workshop alongside to support the ePortfolio process; tutor/mentor support; IT helpdesk support for the learner; and support for producing media files. (p.12)

At least this seems like a solid checklist for developing a support plan and an implementation strategy.

The paper draws a few implications from the survey results as well as the existing literature, these align pretty well with my own feelings about ePortfolios and unfortunately they tend to make implementation projects harder, because taking a whole of program/degree approach to the use of ePortfolios in a siloed institution tends to get put quickly into the ‘too-hard basket’.

Housego and Parker (2009) and Woodley and Sims (2011), reflecting on their respective investigations, conclude that ideally ePortfolios should be integrated appropriately into the whole curriculum. With this in mind, ePortfolio implementation for assessing professional capabilities can be seen in the context of: whole-of-program-based curriculum designs; the major disciplinary studies allowing specialisation in business degrees; key areas of the curriculum dealing with work-integrated learning (WIL) (see Papadopoulos, Taylor, Fallshaw, & Zanko, 2011), foundational core and capstone studies, and those dealing directly with managerial capabilities like intrapersonal and interpersonal intelligence. (p.14)

I do note with some interest though that perhaps my college’s biggest success story with ePortfolios came in a fairly reflective unit related to management (post-grad), which aligns well with the final line of the paragraph.

The final section of the paper and perhaps the one that gives me the most to unpack (and which also excites me the most about the future work of this team) is a preliminary guidance framework for the implementation of ePortfolios in undergraduate business programs.

ePortfolios framework Holt et al 2016

This is absolutely something that I’m going to take to the powers that be at my institution to explore further. All in all this is a rich paper and I greatly look forward to future reports from this project.

Papadopoulos, T., Taylor, T., Fallshaw, E., & Zanko, M. (2011). Engaging industry: Embedding professional learning in the business curriculum final report. Sydney: Australian Learning and Teaching Council.

ePortfolio grading rubric

Here’s a useful assessment rubric created by the University of Wisconsin – Stout that can be applied to ePortfolios. I would consider adding links within the criteria to exemplars of best practice but I think it provides a solid basis for evaluating student work.

https://www2.uwstout.edu/content/profdev/rubrics/eportfoliorubric.html

screenshot of eportfolio assessing rubric