A bibliometric review of research on student outcomes in higher education 1960-2020

  • Ahmet Aypay Nazarbayev University, Kazakhstan
  • Hasan Yücel Ertem Zonguldak Bülent Ecevit University, Turkey
Keywords: student outcomes, bibliometric review, topics, methodologies, citations, co-citations

Abstract

This study conducted a bibliometric analysis of studies on student outcomes in higher education from 1960 to 2020, providing a bibliometric content analysis of articles based on 52 Scopus-indexed higher education journals. Bibliometric analysis methodology was used, and Preferred Reporting Items for Systematic Reviews and Meta-analyses were employed to identify and select the 2,375 articles included in the sample. The trajectory of publications over time was also analyzed, and often-cited journals, authors, articles, and co-citations were identified. The topical foci of research on student outcomes were revealed, co-occurrence analysis was performed, and keyword co-occurrence maps are presented. Limitations, interpretation, implications, and recommendations were also made on the basis of the findings.

Received: 12 September 2021
Accepted: 18 August 2022

Downloads

Download data is not yet available.

Author Biographies

Ahmet Aypay, Nazarbayev University, Kazakhstan

Professor in Higher Education at Graduate School of Education, Nazarbayev University. Dr. Aypay’s research interests are college outcomes, normative structure of colleges and universities, organization, governance and leadership in higher education. He received his PhD from Vanderbilt University, Nashville, TN, USA. He has worked as a faculty member and administrator at various universities in Turkey.

Hasan Yücel Ertem, Zonguldak Bülent Ecevit University, Turkey

Professor in the department of educational sciences at Ereğli Faculty of Education, Zonguldak Bülent Ecevit University, Zonguldak, Turkey. Dr. Ertem’s research focuses on student attrition, student retention, first-year experience, and organizational factors that influence students. He received his PhD from Middle East Technical University, Ankara, Turkey. Previously, he worked as a science teacher in high schools.

References

Adelman, Clifford. The Toolbox Revisited: Paths to Degree Completion from High School through College. Washington, D.C.: U. S. Department of Education, 2006.

Aleksejeva, Ludmila. “Country’s Competitiveness and Sustainability: Higher Education Impact.” Journal of Security & Sustainability Issues 5, no. 3 (2016): 355-363.

Altbach, Philip. G., and Jane Knight. “The Internationalization of Higher Education: Motivations and Realities.” Journal of Studies in International Education 11, no.3/4 (2007): 290-305.

Amanvermez, Yagmur, Metta Rahmadiana, Eirini Karyotaki, Lenore de Wit, David D. Ebert, and Ronald C. Kessler and Pim Cujipers. “Stress Management Interventions for College Students: A Systematic Review and Meta-Analysis.” Clinical Psychology (2020): https://doi.org/10.1111/cpsp.12342

Antonio, Anthony L. “The Role of Interracial Interaction in the Development of Leadership Skills and Cultural Knowledge and Understanding.” Research in Higher Education 42, no. 5 (2001): 593-617.

Aparicio, Gloria, Tximin Iturralde, and Amaia Maseda. “A Holistic Bibliometric Overview of the Student Engagement Research Field.” Journal of Further and Higher Education (2021). DOI: https://doi.org/10.1080/0309877X.2020.1795092.

Arum, Richard, and Josipa Roksa. “Academically Adrift: Limited Learning on College Campuses.” Chicago, IL: University of Chicago Press, 2011.

Astin, Alexander W. “Student Involvement: A Developmental Theory for Higher Education.” Journal of College Student Personnel 25, no.4 (1984): 297-308.

Astin, Alexander W. What Matters in College? Four Critical Years Revisited. San Francisco, JA: Jossey Bass, 1993.

Bean, Jean P. “Dropouts and Turnover: The Synthesis and Test of a Causal Model of Student Attrition.” Research in Higher Education 12, no.2 (1980): 155-187.

Bean, John. P., and Barbara S. Metzner. “A Conceptual Model of Non-Traditional Undergraduate Student Attrition.” Review of Educational Research 55, no.4 (1985): 485-540.

Berg, Gary A. Low-income Students and the Perpetuation of Inequality: Higher Education in America. New York, NY: Routledge, 2016.

Bliuc, Ana M., Peter Goodyear, and Robert A. Ellis. “Research Focus and Methodological Choices in Studies into Students’ Experiences of Blended Learning in Higher Education.” The Internet and Higher Education 10, no.4 (2007): 231-244.

Bowen, Howard R. Investment in Learning: The Individual and Social Value of American Higher Education. San Francisco: Jossey-Bass, 1977.

Bowles, Terry., and Brindle A. Kimberly. “Identifying Facilitating Factors and Barriers to Improving Student Retention Rates in Tertiary Teaching Courses: A Systematic Review.” Higher Education Research & Development 36, no. 5(2017): 903-919.

Braun, Virginia, and Victoria Clarke. “Using Thematic Analysis in Psychology.” Qualitative Research in Psychology 3, no.2 (2006): 77-101.

Broadbent, Jaclyn, and Walter L. Poon. “Self-regulated Learning Strategies & Academic Achievement in Online Higher Education Learning Environments: A Systematic Review.” The Internet and Higher Education, 27 (2015): 1-13.

Calma, Angelito, and Martin Davies. “Critical Thinking in Business Education: Current Outlook and Future Prospects.” Studies in Higher Education, (2020). DOI: https://doi.org/10.1080/03075079.2020.1716324.

Chang, Mitchell J. “Does racial diversity matter?: The educational impact of a racially diverse undergraduate population.” Journal of College Student Development 40, no. 4 (1999): 377–395.

Chauhan, Anushree., Manisha Goel, and Ritu G. Arora “Motivation among Higher Education Academicians: A Factor Analytical Approach.” ANVESHAKInternational Journal of Management 7, no. 1 (2018): 172-189.

Cohen, Louis, Lawrence Manion, and Keith Morrison. Research Methods in Education. New York, NY: Routledge, 2007.

Crane, Diana. Invisible Colleges: Diffusion of Knowledge in Scientific Communities. Chicago: University of Chicago Press, 1972.

Crisp, Gloria, and Irene. “Mentoring College Students: A Critical Review of the Literature between 1990 and 2007.” Research in Higher Education 50, no 6 (2009): 525-545.

Dehdarirad, Taherah., Anne Villarroya, and Maite Barrios. “Research on Women in Science and Higher Education: A Bibliometric Analysis.” Scientometrics 103, no. 3 (2015): 795-812.

Denson, Nida. “Do Curricular and Co-curricular Diversity Activities Influence Racial Bias? A Meta-analysis.” Review of Educational Research 79, 2 (2009): 805-838.

Duran, Antonio. “Queer and of Color: A Systematic Literature Review on Queer Students of Color in Higher Education Scholarship.” Journal of Diversity in Higher Education 12, no.4 (2019): 390-400.

Feldman, Kenneth, and Theodore Newcomb. The Impact of College on Students. San Francisco: Jossey-Bass, 1969.

Guppy, Neil, Paulina D. Mikicich, and Ravi Pendakur. “Changing Patterns of Educational Inequality in Canada.” Canadian Journal of Sociology 9, no.3 (1984): 319-331.

Gurin, Patricia, Eric Dey, Sylvia Hurtado, and Gerald Gurin. “Diversity and Higher Education: Theory and Impact on Educational Outcomes.” Harvard Educational Review 72, no. 3 (2002): 330-367.

Hallinger, Phillip. “A Conceptual Framework for Systematic Reviews of Research in Educational Leadership and Management.” Journal of Educational Administration 51, no. 2 (2013): 126-149.

Hallinger, Phillip. “Reviewing Reviews of Research in Educational Leadership: An Empirical Assessment.” Educational Administration Quarterly 50, no. 4 (2014): 539-576.

Hallinger, Phillip, and, Jesna Kovačević. “A Bibliometric Review of Research on Educational Administration: Science Mapping the Literature, 1960 to 2018.” Review of Educational Research 89, 3: (2019): 335-369.

Hammond, Christopher D. “Internationalization, Nationalism, and Global Competitiveness: A Comparison of Approaches to Higher Education in China and Japan.” Asia Pacific Education Review 17, no. 4 (2016): 555-566.

Huang, Ching Y. “How Background, Motivation, and the Cooperation Tie of Faculty Members Affect their University–Industry Collaboration Outputs: An Empirical Study based on Taiwan Higher Education Environment.” Asia Pacific Education Review 19, no. 3 (2018): 413-431.

Hurtado, Sylvia. “The Next Generation of Diversity and Intergroup Relations Research.” Journal of Social Issues 61, no. 3 (2005): 595-610.

Hurtado, Sylvia. “Linking Diversity with the Educational and Civic Missions of Higher Education.” The Review of Higher Education 30, no. 2 (2007): 185-196.

Kabilan, Muhammad K., Norlida Ahmad, and Mohamad J. Z. Abidin. “Facebook: An Online Environment for Learning of English in Institutions of Higher Education?.” The Internet and Higher Education 13, no. 4 (2010): 179-187.

Kahu, Ella R. “Framing Student Engagement in Higher Education.” Studies in Higher Education 38, no. 5 (2013): 758-773.

Kirkwood, Adrian, and Linda Price. “Learners and Learning in the Twenty-first Century: What Do We Know about Students’ Attitudes towards and Experiences of Information and Communication Technologies that Will Help Us Design Courses?” Studies in Higher Education 30, no. 3(2005: 257-274.

Klavans, Richard, and Kevin W. Boyack. “Which Type of Citation Analysis Generates the Most Accurate Taxonomy of Scientific and Technical Knowledge?.” Journal of the Association for Information Science and Technology 68, no. 4 (2017): 984-998.

Kwiek, Marek. “The Prestige Economy of Higher Education Journals: A Quantitative Approach.” Higher Education. (2020). DOI: https://doi.org/10.1007/s10734-020-00553-y.

Lave, Jean, and Etienne Wenger. Situated Learning: Legitimate Peripheral Participation. New York, NY: Cambridge University Press, 1991.

Liu, Hsing-Yuan, and Chia-Chen Chang & Chang Gung. “Effectiveness of 4Ps Creativity Teaching for College Students: A Systematic Review and Metaanalysis.” Creative Education, 8 (2017): 857-869.

Locks, Angela M., Sylvia Hurtado, Nicholas A. Bowman, and Leticia Oseguera. “Extending Notions of Campus Climate and Diversity to Students’ Transition to College.” The Review of Higher Education 31, 3: (2008): 257-285.

Lopez-Leyva, Santos and Garry Rhoades. “Country Competitiveness Relationship with Higher Education Indicators.” Journal of Technology Management & Innovation 11, 4 (2016): 47-55.

Lynch, Kathleen, and Claire O’riordan. “Inequality in Higher Education: A Study of Class Barriers.” British Journal of Sociology of Education 19, no. 4 (1998): 445-478.

Mayhew, Matthew J., Alyssa N. Rockenbach, Nicholas A. Bowman, Tricia A. Seifert, Gregory C. Wolniak, Ernest T. Pascarella and Patrick T. Terenzini. How College Affects Students: 21st Century Evidence that Higher Education Works, Volume 3, Indianapolis, IN: Jossey-Bass, 2016.

MacNell, Lilian, Adam Driscoll, and Andrea N. Hunt. “What’s in a Name: Exposing Gender Bias in Student Ratings of Teaching.” Innovative Higher Education 40, no. 4 (2015): 291-303.

McMillan, Libba, Tanya Johnson, Francine M. Parker, Caralise W. Hunt, and Diane E. Boyd. “Improving Student Learning Outcomes through a Collaborative Higher Education Partnership.” International Journal of Teaching and Learning in Higher Education 32, no. 1 (2020): 117-124.

Melguizo, Tatiana, and Jacques Wainer. “Toward a Set of Measures of Student Learning Outcomes in Higher Education: Evidence from Brazil”. Higher Education 72, no. 3 (2016): 381-401.

Mishra, Shweta. “Social Networks, Social Capital, Social Support and Academic Success in Higher Education: A Systematic Review with a Special Focus on ‘Underrepresented’ Students.” Educational Research Review 29, (2020): (100307). DOI: https://doi.org/10.1016/j.edurev.2019.100307.

Moher, David., Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, Antes, G., ... and Jocalyn Clark. “Preferred Reporting Items for Systematic Reviews and Meta-analyses: The PRISMA Statement (Chinese edition).” Journal of Chinese Integrative Medicine 7, no. 9 (2009): 889-896.

Mongeon, Philippe, and Adele Paul-Hus. “The Journal Coverage of Web of Science and Scopus: A Comparative Analysis.” Scientometrics 106, no. 1 (2016): 213-228.

Moustakas, Clark. Phenomenological research methods. London: Sage Publications, 1994.

Neyt, Brecht, Eddy Omey, Dieter Verheast, and Stijn Baert. “Does Student Work Really Affect Educational Outcomes? A Review of the Literature.” Journal of Economic Surveys 33, no. 3 (2019): 896-821.

Nichols, Sue, and Garth Stahl. “Intersectionality in Higher Education Research: A Systematic Literature Review. Higher Education Research & Development 38, no. 6 (2019): 1255-1268

Nuske, Alison, Rilotta Fiona, Michelle Bellon, and Amanda Richdale. “Transition to Higher Education for Students with Autism.” Journal of Diversity in Higher Education 12, no. 3 (2019): 280-295.

O’Flaherty, Jacqueline, and Craig Phillips. “The Use of Flipped Classrooms in Higher Education: A Scoping Review.” The Internet and Higher Education 25, (2015): 85-95.

Özkaya, Ali. “Bibliometric Analysis of the Publications Made in STEM Education Area.” Bartin Üniversitesi Egitim Fakültesi Dergisi 8, no. 2 (2019): 590-628.

Pascarella, Ernest T., and Patrick T. Terenzini. How college affects students: Findings and insights from twenty years of research. San Francisco, CA: JosseyBass, 1991.

Pascarella, Ernest T. “How college affects students: Ten directions for future research.” Journal of College Student Development 47, no. 5 (2006): 508-520.

Pascarella, Ernest T., and Patrick T. Terenzini. How College Affects Students: A Third Decade of Research. Volume 2. Indianapolis, IN: Jossey-Bass, 2005.

Petticrew, Mark, and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide. Malden, MA: Blackwell, 2006.

Ramsden, Paul. “A Performance Indicator of Teaching Quality in Higher Education: The Course Experience Questionnaire.” Studies in Higher Education 16 no. 2 (1991): 129-150.

Richardson, Michelle, Charles Abraham, and Rod Bond. “Psychological Correlates of University Students’ Academic Performance: A Systematic Review and Meta-analysis.” Psychological Bulletin, 138, no. 2 (2012): 353-387.

Roblyer, Margaret D., Michele McDaniel, Marsena Webb, James Herman, and James V. Witty. “Findings on Facebook in Higher Education: A Comparison of College Faculty and Student Uses and Perceptions of Social Networking Sites.” The Internet and Higher Education 13, no. 3 (2010): 134-140.

Rovai, Alfred P. “In Search of Higher Persistence Rates in Distance Education Online Programs.” The Internet and Higher Education 6, no. 1 (2003): 1-16.

Salisbury, Mark H., Paul D. Umbach, Michael B. Paulsen, and Ernest T. Pascarella. “Going Global: Understanding the Choice Process of the Intent to Study Abroad.” Research in Higher Education 50, no. 2 (2009): 119-143.

Serenko, Alexander, and Nick Bontis. “Global Ranking of Knowledge Management and Intellectual Capital Academic Journals: 2013 update.” Journal of Knowledge Management 17, no. 2 (2013): 307–326.

Sewell, William H. “Inequality of Opportunity for Higher Education.” American Sociological Review 36, no. 5 (1971): 793-809.

Shavit, Yossi (Ed.). Stratification in Higher Education: A Comparative Study. Stanford, CA: Stanford University Press, 2007.

Shea, Peter., Chun S. Li, and Alexandria Pickett. “A Study of Teaching Presence and Student Sense of Learning Community in Fully Online and WebEnhanced College Courses.” The Internet and Higher Education 9, no. 3 (2006): 175-190.

Singh, Gurnam. Black and Minority Ethnic (BME) Students’ Participation in Higher Education: Improving Retention and Success: A Synthesis of Research Evidence. York: Higher Education Academy, 2009.

Song, Liyan., Ernise S. Singleton, Janette R. Hill, and Myung H. Koh. “Improving Online Learning: Student Perceptions of Useful and Challenging Characteristics.” The Internet and Higher Education 7, no. 1 (2004): 59-70.

Sönmez, Ömer F. “Bibliometric Analysis of Educational Research Articles Published in the Field of Social Study Education based on Web of Science Database.” Participatory Educational Research 7, no. 2 (2020): 216-229.

Spelt, Elisabeth J., Harm J. Biemans, Hilde Tobi, Pieternel A. Luning, and Martin Mulder. “Teaching and Learning in Interdisciplinary Higher Education: A Systematic Review.” Educational Psychology Review 21, no. 4 (2009): 365-378.

Stankovska, Gordana., Slagana Angelkoska, Fadbi Osmani, and Svetlana P. Grncarovska “Job Motivation and Job Satisfaction Among Academic Staff in Higher Education.” Bulgarian Comparative Education Society 15, (2017): 159-166.

Tight, Malcolm. “Systematic Reviews and Meta-analyses of Higher Education Research.” European Journal of Higher Education 9, no. 2 (2019): 133-152.

Times Higher Education (THE). World University Rankings 2020. Retrieved from https://www.timeshighereducation.com/world-university-rankings/2020/worldranking#!/page/0/length/25/sort_by/rank/sort_order/asc/cols/stats, (2020).

Tinto, Vincent. “Dropout from Higher Education: A Theoretical Synthesis of Recent Research.” Review of Educational Research 45, no. 1 (1975): 89-125.

Tinto, Vincent. Leaving College: Rethinking the Causes and Cures of Student Attrition. Chicago, IL: University of Chicago Press, 1987.

Tinto, Vincent. “Classrooms as Communities: Exploring the Educational Character of Student Persistence.” The Journal of Higher Education 68, no. 6 (1997): 599-623.

Thomas, Scott L., and Ronald H. Heck. “Analysis of Large-scale Secondary Data in Higher Education Research: Potential Perils Associated with Complex Sampling Designs.” Research in Higher Education 42, no. 5 (2001): 517-540.

Tomlinson, Michael. “Graduate Employability: A Review of Conceptual and Empirical Themes.” Higher Education Policy 25, no. 4 (2012): 407-431.

Tymon, Alex. “The Student Perspective on Employability.” Studies in Higher Education 38, 6 (2013): 841-856.

Umbach, Paul D., and Matthew R. Wawrzynski. “Faculty Do Matter: The Role of College Faculty in Student Learning and Engagement.” Research in Higher education 46, no. 2 (2005): 153-184.

Unterhalter, Elaine, and Colleen Howell. “Unaligned Connections or Enlarging Engagements? Tertiary Education in Developing Countries and the Implementation of the SDGs.” Higher Education, (2020): [Online First]. DOI: https://doi.org/10.1186/s13643-016-0384-4.

Valentine, Jeffrey C., Amy S. Hirschy, Christine D. Bremer, Walter Novillo, Marisa Castellano and Aaron Banister. “Keeping At-risk Students in School: A Systematic Review of College Retention Programs.” Educational Evaluation and Policy Analysis 33, no. 2 (2011): 214-234.

Walpole, Marybeth. “Socioeconomic Status and College: How SES Affects College Experiences and Outcomes.” The Review of Higher Education 27, no. 1 (2003): 45-73.

Wals, Arjen E., and Bob Jickling. ““Sustainability” in Higher Education.” International Journal of Sustainability in Higher Education 3, no. 3 (2002): 221-232.

White, Howard D., and Katherine W. McCain “Visualizing a Discipline: An Author Co-citation Analysis of Information Science, 1972–1995.” Journal of the American Society for Information Science 49, no. 4 (1998): 327-355.

Worsley, Joanne, Andy Pennington, and Rhiannon Corcoran. “What Interventions Improve College and University Students’ Mental Health and Wellbeing? A Review of Review-level Evidence.” (2020). Unpublished manuscript accessed in 6.12.2020 at https://whatworkswellbeing.org/wp-content/uploads/2020/03/Student-mental-health-full-review.pdf.

Yeoh, Kim H., and Kiran Kaur. “Subject Support in Collection Development: Using the Bibliometric Tool.” Collection Building 27, no. 4 (2008): 157-166.

Yıldırım, Ali, and Hasan Şimşek. Sosyal Bilimlerde Nitel Araştırma Yöntemleri. Seçkin yayıncılık: Ankara, 2016.

Zepke, Nick, and Linda Leach. “Improving Student Engagement: Ten Proposals for Action.” Active Learning in Higher Education 11, no. 3 (2010): 167-177.

Zlatkin-Troitschanskaia, O., Hans A. Pant, and Hamish Coates. “Assessing Student Learning Outcomes in Higher education: Challenges and International Perspectives” Assessment and Evaluation in Higher Education 41, no. 5 (2016): 655-661.

Zupic, Ivan, and Tomaz Čater. “Bibliometric Methods in Management and Organization.” Organizational Research Methods 18, no. 3 (2015): 429-472.

Published
2022-11-29
How to Cite
Aypay, Ahmet, and Hasan Yücel Ertem. 2022. “A Bibliometric Review of Research on Student Outcomes in Higher Education 1960-2020”. Tuning Journal for Higher Education 10 (1), 27-63. https://doi.org/10.18543/tjhe.2189.