The e-portfolio in higher education: The case of a line of teaching innovation and complex change management
This work proposes a line of innovation to implement possible uses for the e-portfolio in higher education. We present an initial framework for analysis with attention to three main arguments: the validity of the interest of the e-portfolio for higher education in light of the current challenges posed by the knowledge society; the relevance of complex change management within organisations such as universities; and the identification of critical elements in the relevant literature concerning experiences similar to the case analysed here. The milestones for the line of innovation include six projects and three teacher training courses. Once data had been gathered in the respective assessment phases for each milestone by means of document analysis techniques (e-portfolios, teaching materials, usage statistics), questionnaires, discussion groups, in-depth interviews, and self-assessments (responsible academics, teachers, and students), a global analysis of the whole line was conducted from a complex approach to the problems of teaching change and innovation. A technological, political and cultural reading of innovation reveals emerging problems to reconsider: the attainment of deep learning; the standardisation of academic tutoring; the formation of learning and practice communities; the reconceptualisation of the e-portfolio as a personal learning environment; and the transformation of the university institution as a learning organisation. The premature condition of higher education to deal with the change in the teaching paradigm and the urgency to revisit its innovation policies to overcome it stand out among the critical conclusions of this study.
Received: 27 April 2021
Accepted: 27 October 2021
Ardoino, Jacques, Patrick Boumard, and Jean-Claude Salaberry. Actualité de la théorie de l’institution: hommage à René Lourau. Paris: L’Harmattan, 2003.
Arraiz, Ana, and Fernando Sabirón. The ethnographic portfolio: a socio-constructivist device for the recognition of learning.” [In French.] Carriérologie 12, no. 3-4 (2012): 319-335.
Arraiz, Ana, Alfredo Berbegal, and Fernando Sabirón. Academic tutoring focused on assessment: analysis of needs from the perspective of students and teachers. [In Spanish.] REDU 16, no. 2 (2018): 211-229. https://doi.org/10.4995/redu.2018.5992.
Ashford-Rowe, Kevin, Janice Herrington, and Christine Brown. “Establishing the critical elements that determine authentic assessment.” Assessment & Evaluation in Higher Education 39, no. 2 (2014): 205-222. https://doi.org/10.1080/02602938.2013.819566.
Baregheh, Anahita, Jennifer Rowley, and Sally Sambrook. “Towards a multidisciplinary definition of innovation.” Management Decision 47, no. 8 (2009): 1323–1339. https://doi.org/10.1108/00251740910984578.
Barnett, Ronald. “University knowledge in an age of supercomplexity.” Higher Education 40, no. 4 (2000): 409–422. https://doi.org/10.1023/A:1004159513741.
Barrett, Helen C., and Nathan Garrett. “Online personal learning environments: Structuring electronic portfolios for lifelong and life wide learning.” On the Horizon 17 no. 2 (2009): 142–152. https://doi.org/10.1108/10748120910965511.
Bell, Vikki. “Performative Knowledge.” Theory, Culture & Society 23, no. 2-3 (2006): 214-217. https://doi.org/10.1177/026327640602300245.
Berbegal, Alfredo, Ana Arraiz, Fernando Sabirón, and Carolina Falcón. The MaharaZar Portfolio at the University of Zaragoza: Emerging Reflexions. [In Spanish.] In Good Practices in ICT-supported University Teaching: Experiences in 2014, edited by José-Luis Alejandre, 135-144. Zaragoza: PUZ, 2015.
Blaj-Ward, Lai, and Kim Winter. “Engaging students as digital citizens.” Higher Education Research & Development 38, no. 5 (2019): 879-892. https://doi.org/10.1080/07294360.2019.1607829.
Brady, Malcolm, and Naoimh O’Reilly. “Learning management systems and their impact on academic work.” Technology, Pedagogy and Education 29, no. 3 (2020): 251-268. https://doi.org/10.1080/1475939X.2020.1743746.
Bratianu, Constantin. “Organizational learning and learning organization.” In Organizational Knowledge Dynamics: Managing Knowledge Creation, Acquisition, Sharing and Transformation, edited by Constantin Bratinu, 286- 312. Hershey: IGI Global, 2015.
Bruijn-Smolders, de Monique, Caroline F. Timmers, Jason C.L. Gawke, Wouter Schoonman, and Maris Ph. Born. “Effective self-regulatory processes in higher education: research findings and future directions. A systematic review.” Studies in Higher Education 41, no. 1 (2016): 139-158. https://doi.org/10.1080/03075079.2014.915302.
Bunney, Dian, Elaine Sharplin, and Christine Howitt. “Generic skills for graduate accountants: the bigger picture, a social and economic imperative in the new knowledge economy.” Higher Education Research & Development 34, no. 2 (2014): 256-269. https://doi.org/10.1080/07294360.2014.956700.
Burnes, Bernard. “Kurt Lewin and complexity theories: back to the future?” Journal of Change Management 4, no. 4 (2004): 309-325. https://doi.org/10.1080/1469701042000303811.
Cai, Yuzhuo. “From an Analytical Framework for Understanding the Innovation Process in Higher Education to an Emerging Research Field of Innovations in Higher Education.” The Review of Higher Education 40, no. 4 (2017): 585-616. https://doi.org/10.1353/rhe.2017.0023.
Carless, David. “Exploring learning-oriented assessment processes.” Higher Education 69 (2015): 963–976. https://doi.org/10.1007/s10734-014-9816-z.
Cumming, Jim. “Contextualised performance: reframing the skills debate in research education.” Studies in Higher Education 35, no. 4 (2010): 405-419. https://doi.org/10.1080/03075070903082342.
Dakka, Fadia. “Competition, innovation and diversity in higher education: dominant discourses, paradoxes and resistance.” British Journal of Sociology of Education 41, no. 1 (2020): 80-94. https://doi.org/10.1080/01425692.2019.1668747.
Del Canto, Francisco. “University As a Global Actor in the International System of the 21st Century.” Tuning Journal for Higher Education 6, no. 1 (2018): 169-98. https://doi.org/10.18543/tjhe-6(1)-2018pp169-198.
Driessen, Erik. “Do Portfolios have a future?” Advances in Health Sciences Education 22 (2017): 221–228. https://doi.org/10.1007/s10459-016-9679-4.
Engeström, Yrjö. “Activity theory and individual and social transformation.” In Perspectives on Activity Theory. Learning in Doing: Social, Cognitive and Computational Perspectives, edited by Yrjö Engeström, Reijo Miettinen, and Raija- Leena Punamäki-Gitai, 19-38. Cambridge: Cambridge University Press, 1999.
ETNOEDU. The ethnographic portfolio: a tool of assessment skills. [In Spanish.] Zaragoza: PUZ, 2007.
Falcón, Carolina, and Ana Arraiz. Efficient and sustainable career construction: the professional portfolio as a resource at university guidance. [In Spanish.] REOP 28, no. 2 (2017): 8 – 29. http://revistas.uned.es/index.php/reop/article/download/20116/16665.
Flood, Robert Louis. “The Relationship of Systems Thinking to Action Research.” Systemic Practice and Action Research 23 (2010): 269–284. https://doi.org/10.1007/s11213-010-9169-1.
Friesen, Norm. “Media: Digital, Ecological and Epistemological.” E-Learning and Digital Media 8, no. 3 (2011): 175-180. https://doi.org/10.2304/elea.2011.8.3.175.
Inken Gast, Kim Schildkamp, and Jan T. van der Veen. “Team-Based Professional Development Interventions in Higher Education: A Systematic Review.” Review of Educational Research 87, no. 4 (2017): 736–767. https://doi.org/10.3102/0034654317704306.
Gerritsen-van Leeuwenkamp, Karin J., Desirée Joosten-ten Brinke, and Liesbeth Kesterd. “Assessment quality in tertiary education: An integrative literature review.” Studies in Educational Evaluation 55 (2017): 94–116. https://doi.org/10.1016/j.stueduc.2017.08.001.
Gibson, David C. “ePortfolio decisions and dilemmas.” In Handbook of research in eportfolio, edited by Ali Jafari, and Catherine Kaufman, 135-145. London: Idea Group Reference, 2006.
Greeno, James G. “The Situativity of Knowing, Learning, and Research.” American Psychologist 53, no. 1 (1998): 5-26. https://doi.org/10.1037/0003-066X.53.1.5.
Gulden, Manarbek, Kondybayeva Saltanat, Doszhan Raigul, Turarov Dauren, and Abylay Assel. “Quality management of higher education: Innovation approach from perspectives of institutionalism. An exploratory literature review.” Cogent Business & Management 7, no. 1 (2020). https://doi.org/10.1080/23311975.2020.1749217.
Hallam, Gillian C., and Tracy Creagh. “ePortfolio use by university students in Australia: a review of the Australian ePortfolio Project.” Higher Education Research & Development 29, no. 2 (2010): 179-193. https://doi.org/10.1080/07294360903510582.
Harper, David A., Félix-Fernando Muñoz, and Francisco J. Vázquez. “Innovation in online higher-education services: building complex systems.” Economics of Innovation and New Technology (2020). https://doi.org/10.1080/10438599.2020.1716508.
Hasanefendic, Sandra, Julie M. Birkholz, Hugo Horta, and Peter van der Sijde. “Individuals in action: bringing about innovation in higher education.” European Journal of Higher Education 7, no.2 (2017): 101-119, https://doi.org/10.1080/21568235.2017.1296367.
Hill, Phil. “Online educational delivery models: A descriptive view.” Educause Review (2012): 85–97. https://er.educause.edu/-/media/files/article-downloads/ erm1263.pdf.
Holman, David. “A dialogical approach to skill and skilled activity.” Human Relations 53, no. 7 (2000): 957-980. https://doi.org/10.1177/0018726700537003.
Hora, Matthew T., Jana Bouwma-Gearhart, and Hyoung Joon Park. “Data driven decision-making in the era of accountability: Fostering faculty data cultures for learning.” The Review of Higher Education 40, no. 3 (2017): 391-426. https://doi.org/10.1353/rhe.2017.0013.
House, Ernest R. “Technology versus craft: a ten-year perspective on innovation.” Journal of Curriculum Studies 11, no. 1 (1979): 1-15. https://doi.org/10.1080/0022027790110102.
JISC. Effective Practice with ePortfolios: Supporting 21st century learning. Bristol: HEFCE/JISC, 2008.
Kauko, Jaakko. “Complexity in higher education politics: bifurcations, choices and irreversibility.” Studies in Higher Education 39, no. 9 (2014): 1683-1699. https://doi.org/10.1080/03075079.2013.801435.
Lehmann, Erik E., Michele Meoli, Stefano Paleari, and Sarah A. E. Stockinger. “The role of higher education for the development of entrepreneurial ecosystems.” European Journal of Higher Education 10, no. 1 (2020): 1-9. https://doi.org/10.1080/21568235.2020.1718924.
Lowenthal, Patrick, John White, and Karen Cooley. “Remake/Remodel: Using ePortfolios and a System of Gates to Improve Student Assessment and Program Evaluation.” International Journal of ePortfolio 1, no. 1 (2011): 61-70. http://www.theijep.com/pdf/IJEP37.pdf.
MacIntosh, Robert, and Donald MacLean. “Conditioned emergence: researching change and changing research.” International Journal of Operations and Production Management 21, no. 10 (2001): 1343-57. https://doi.org/10.1108/EUM0000000005973.
Meeus, Will, Linda Van Looy, and Peter Van Petegem. “Portfolio in higher education: Time for a clarificatory framework.” International Journal of Teaching and Learning in Higher Education 17, no. 2 (2016): 127-35. https://www.isetl.org/ijtlhe/pdf/IJTLHE27.pdf.
Merino, Abel, Alfredo Berbegal, Fernando Sabirón, and Ana Arraiz. Academic tutoring at the university: a hybrid space for constructing professional identity. [In Spanish.] In Edunovatic 2019: 4th Virtual International Conference on Education, Innovation and ICT, edited by REDINE, 237-242. Madrid: REDINE, 2019.
Moore, Michele-Lee, and Frances Westley. “Surmountable chasms: networks and social innovation for resilient systems.” Ecology and Society 16, no. 1 (2011). http://www.ecologyandsociety.org/vol16/iss1/art5/.
Oner, Diler, and Emine Adadan. “Are integrated portfolio systems the answer? An evaluation of a web-based portfolio system to improve preservice teachers’ reflective thinking skills.” Journal of Computing in Higher Education 28, no. 2 (2016): 236–260. https://doi.org/10.1007/s12528-016-9108-y.
Parkes, Kelly A., Katie S. Dredger, and David Hicks. “ePortfolio as a measure of reflective practice.” International Journal of ePortolio 3, no. 2 (2013): 99–115. http://www.theijep.com/pdf/IJEP110.pdf.
Rittel, Horst W. J., and Melvin M. Webber. “Dilemmas in a general theory of planning.” Policy Sciences 4, (1973): 155–169. https://doi.org/10.1007/BF01405730.
Roberts, Pauline. “Developing reflection through an ePortfolio-based learning environment: design principles for further implementation.” Technology, Pedagogy and Education 27, no. 3 (2018): 313-326. https://doi.org/10.1080/1475939X.2018.1447989.
Sabirón, Fernando, and Ana Arraiz. Learning from assessment: a decalogue for developing professional skills through portfolio authentic assessment. [In Spanish.] Revista Iberoamericana de Evaluación Educativa 6, no. 1 (2013): 135-152. https://revistas.uam.es/riee/article/view/3846/4031.
Scully, Darina, Michael O’Leary, and Mark Brown. The Learning Portfolio in Higher Education: A Game of Snakes and Ladders. Dublin: CARPE/NIDL, 2018.
Siemens, George. “Connectivism: A learning theory for the digital age.” International Journal of Instructional Technology & Distance Learning 2, no. 1 (2005): 3–10. http://itdl.org/Journal/Jan_05/article01.htm.
Slade, Christine, and Terry Downer. “Students’ conceptual understanding and attitudes towards technology and user experience before and after use of an ePortfolio.” Journal of Computing in Higher Education 32 (2019): 529–552. https://doi.org/10.1007/s12528-019-09245-8.
Sticchi, Maria. “From 1999 to 2019: 20 Years of European Debate, Development, and Achievements.” Tuning Journal for Higher Education 6, no. 2 (2019): 51- 71. https://doi.org/10.18543/tjhe-6(2)-2019pp51-71.
Stilgoe, Jack, Richard Owen, and Phil Macnaghten. “Developing a framework for responsible innovation.” Research Policy 42, no. 9 (2013): 1568–1580. https://doi.org/10.1016/j.respol.2013.05.008.
Struyven, Katrien, Yves Blieck, and Véronique De Roeck. “The electronic portfolio as a tool to develop and assess pre-service student teaching competences: Challenges for quality.” Studies in Educational Evaluation 43 (2014): 40-54. https://doi.org/10.1016/j.stueduc.2014.06.001.
Swanson, Elizabeth, Lisa V McCulley, David J Osman, Nancy Scammacca Lewis, and Michael Solis. “The effect of team-based learning on content knowledge: A meta-analysis.” Active Learning in Higher Education 20, no. 1 (2019): 39–50, https://doi.org/10.1177/1469787417731201.
Tassone, Valentina C., Catherine O’Mahony, Emma McKenna, Hansje J. Eppink, and Arjen E. J. Wals. “(Re)designing higher education curricula in times of systemic dysfunction: a responsible research and innovation perspective.” Higher Education 76 (2018): 337-352. https://doi.org/10.1007/s10734-017- 0211-4.
Thibodeaux, Tilisa, Cynthia Cummings, and Dwayne Harapnuik. “Factors that Contribute to ePortfolio Persistence.” International Journal of ePortfolio 7, no. 1 (2017): 1-12. http://www.theijep.com/pdf/IJEP257.pdf.
Trautwein, Caroline, Matthias Nückles, and Marianne Merkt. “Complex dynamics in academics’ developmental processes in teaching.” Higher Education Research & Development, 34, no. 3 (2015): 641-657. https://doi.org/10.1080/07294360.2 014.973376.
Waddock, Sandra, Greta M. Meszoely, Steve Waddell, and Domenico Dentoni. “The complexity of wicked problems in large scale change.” Journal of Organizational Change Management 28, no. 6 (2015): 993–1012. https://doi.org/10.1108/JOCM-08-2014-0146.
Walder, Anne M. “Obstacles to innovation: The fear of jeopardising a professorial career.” British Journal of Education 3, no. 6 (2015):1-16.
Wenger, Etienne. “Communities of Practice and Social Learning Systems: the Career of a Concept.” In Social Learning Systems and Communities of Practice, edited by Chris Blackmore, 179-198. London: Springer, 2010.
Wernick, Andrew. “University. Theory.” Culture & Society 23, no. 2-3 (2006): 557- 563. https://doi.org/10.1177/0263276406062810.
Woodward, Helen, and Phil Nanlohy. “Digital portfolios: fact or fashion?” Assessment & Evaluation in Higher Education 29, no. 2 (2004): 227-238. https://doi.org/10.1080/0260293042000188492.
Authors are required to sign and submit a copyright transfer agreement after acceptance but before publication of their manuscript. To that effect, they receive, from the Managing Editor of Tuning Journal for Higher Education, a standard copyright assignment form designed along the following lines:
The author who signs the copyright transfer agreement must be the sole creator of the work or legally acting on behalf of and with the full agreement of all the contributing authors.
2. Copyright and Code of conduct:
a) Authors warrant that their work is original; has not been previously copyrighted or published in any form; is not under consideration for publication elsewhere; its submission and publication do not violate TJHE Ethical Guidelines for Publication and any codes (of conduct), privacy and confidentiality agreements, laws or any rights of any third party; and no publication payment by the Publisher (University of Deusto) is required.
b) Authors are solely liable for the consequences that may arise from third parties’ complaints about the submitted manuscript and its publication in Tuning Journal for Higher Education (TJHE).
c) Authors grant to the Publisher the worldwide, sub-licensable, and royalty-free right to exploit the work in all forms and media of expression, now known or developed in the future, for educational and scholarly purposes.
d) Authors retain the right to archive, present, display, distribute, develop, and republish their work (publisher's version) to progress their scientific career provided the original publication source (Tuning Journal) is acknowledged properly and in a way that does not suggest the Publisher endorses them or their use of the wortk.
e) Authors warrant that no permissions or licences of any kind will be granted that might infringe the rights granted to the Publisher.
Tuning Journal for Higher Education is an Open Access publication. Its content is free for full and immediate access, reading, search, download, distribution and reuse in any medium or format only for non-commercial purposes and in compliance with any applicable copyright legislation, without prior permission from the Publisher or the author(s). In any case, proper acknowledgement of the original publication source must be made and any changes to the original work must be indicated clearly and in a manner that does not suggest the author’s and or Publisher’s endorsement whatsoever. Any other use of its content in any medium or format, now known or developed in the future, requires prior written permission of the copyright holder.