Learning Gain in Higher Education: Volume 14

This chapter provides a review of existing research on learning gain and related topics in higher education. The methodology adopted is a form of systematic review. The origins and meaning of learning gain, and its relation to similar terms, are discussed. The ways in which learning gain has been applied in practice and in research are considered. The issues raised by this practice and research are examined, and the various criticisms made are reviewed. Some conclusions are then drawn.

In the last five years, there has been an increased interest across the globe, and in the United Kingdom in particular, to define, conceptualise and measure learning gains. The concept of learning gains, briefly summarised as the improvement in knowledge, skills, work-readiness and personal development made by students during their time spent in higher education, has been hailed by some as an opportunity to measure ‘excellence’ in teaching. This chapter will review some of the common definitions and the methods employed in research on learning gains. Secondly, we will provide a critical evaluation of the computational aspects of learning gains (e.g., raw gain, normalised gain). Finally, we will critically reflect upon the lessons learnt and what is not yet known in terms of learning gains.

This chapter outlines the challenges that research and practice in higher education have faced in measuring students' competences and learning outcomes. Particular attention is given to the systematic and institutional contexts in Germany. Based on the outlined national and international contextual framework, the Germany-wide program “Modeling and Measuring Competences in Higher Education (KoKoHs)” is discussed in terms of its two central working stages, key outcomes and lessons learned. In particular, the central results of the second phase are presented for the first time and integrated into the current state of international research. Based on this analysis, perspectives for further research on student learning in higher education and implications for practice and policy are derived.

For more than a decade, there has been an increased focus on the need for accountability and transparency about the value that United States and international higher education institutions add to students' knowledge and skills to help increase their economic productivity and career opportunities. This focus on accountability and transparency within the U.S. dates to 2005 when former US Secretary of Education Margaret Spellings established a Commission on the Future of Higher Education to develop a national strategy for higher education reform. This led to an increased focus on measuring value added within higher education institutions and using value-added scores to make institutional comparisons. This chapter presents a brief history of value added within the United States and presents high-level summaries of initiatives, assessments used to measure value added, and a review of how value added is measured. We also present challenges around methodology and interpretation of results. Lastly, we discuss some of the future directions in evaluating value added in higher education and areas for future research.

This chapter provides an overview of the LEGACY project in the UK and its evaluation, focussing on the effectiveness of the different methodologies used for measuring learning gain. The overall impact of the project on participating institutions and the higher education sector as a whole, in terms of capacity building and developing communities of understanding, is also reviewed.

The changes in the economy along with various political reforms have resulted in an increased focus on enhancing the employability of higher education graduates and have challenged the traditional role of higher education such as creating informed citizens and improving the well-being of individuals and the larger society. In this era of globalization, employability of higher education graduates is considered imperative in strengthening economies and in increasing their competitiveness. This increased focus on employability calls for innovative methods and approaches for assessing the skills and competencies of graduates. Employability is a broad concept and should not be seen as synonymous with the actual employment of graduates. Given these changes in the larger economy and higher education systems, this chapter attempts to map the changes in the overall goals and objectives of higher education against various political and economic forces, and to discuss the implications of these changes with reference to ‘employability gain’ of graduates. In doing so, we first discuss various definitions of employability and identify commonalities and differences between them. Next, we examine the potential of two assessment approaches – self-reports and performance-based tests – for measuring employability gains based on research findings from two higher education quality management projects implemented in Germany.

Learning gain – the attempt to measure the different ways in which students benefit from their learning experience – is now a core part of government plans for higher education across many countries. A focus on student outcomes is a key strand of enquiry for judging quality and assessing value for money. New approaches to quantifying learning gain and new metrics were developed through 13 pilot projects across England. Evaluation of the projects explored the theoretical underpinnings of the metrics including behavioural, cognitive and affective approaches, as well as progress and outcome measures, and identified challenges to measuring learning gain. In this chapter policy implications of the global accountability agenda are discussed, including the use of metrics to drive enhancement, rank excellence and ensure quality and standards.

Higher education likely makes significant contributions towards planetary sustainability through its research activities, but many hope that it will also have an impact via its educational roles. International accords, national strategies and institutional commitments emphasise higher education's responsibilities with respect to education for sustainability, or for sustainable development, but research is hard-pressed to identify systematic changes in the attitudes and aspirations of young people as a consequence of the current efforts of higher education. This chapter analyses the evidence for learning gains but suggests that we should be open to the possibility of learning losses. The chapter ends by exploring if teaching students the skills and dispositions to think critically, deeply and independently, better than we do at present, might not only be a better fit to the liberal traditions and abilities of higher education but also best support generations to come to decide for themselves what their contribution to sustainability could be.

Australian universities have a rich history for enabling, promoting and evaluating innovation and excellence in learning and teaching. Universities have used this practice to respond to drivers from government and the changing global educational environment, as well as accommodating for the characteristics of Australian universities such as scale, equity of access and the balance of domestic and international students. Often through institutional collaborations, educators have challenged pedagogical practices and introduced and tested innovative ways to enhance student learning, which has contributed to an international reputation for quality learning and teaching. However, the recent removal of specific government funding to support innovation, the increased emphasis on student success and employability outcomes and the threat of performance-based funding means that Australian universities will need to commit to the ongoing development of learning and teaching and demonstrate the potential for learning gain.

There is strong agreement among educators at universities and colleges worldwide about the importance of assessing and measuring student learning. Yet, putting those best intentions into practice can be daunting within existing institutions. At Minerva, we had the luxury of starting a new college from scratch. We designed the institution to deliver specific student outcomes, and built all the operating practices and systems needed to support faculty and students in this pursuit. In this chapter, we share how Minerva defined what we teach, how we teach, and how our practices enable us to measure whether our students are indeed achieving the outcomes we had intended for them. We hope you might be inspired by learning about our approach, as we do believe that much of what we have put into place can be incorporated by other institutions to help their students achieve their learning outcomes.