{"id":275,"date":"2014-08-06T11:53:31","date_gmt":"2014-08-06T11:53:31","guid":{"rendered":"https:\/\/staffblogs.le.ac.uk\/loproject\/?p=275"},"modified":"2025-02-26T13:24:00","modified_gmt":"2025-02-26T13:24:00","slug":"lopapers","status":"publish","type":"post","link":"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/08\/06\/lopapers\/","title":{"rendered":"Seven useful learning outcomes papers"},"content":{"rendered":"<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Lady-reading.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-273\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Lady-reading.png\" alt=\"Lady reading\" width=\"82\" height=\"135\" \/><\/a><\/p>\n<p>Over the last few months I have been doing some rigorous searching and reviewing of the published, peer-reviewed literature concerning learning outcomes.\u00a0 We currently have a paper in review as a result of this work and I hope to provide further details about that particular piece at some point soon.<\/p>\n<p>For this post, I want to provide a few details for readers about some of the papers that I\u2019ve come across that make interesting and useful reading.\u00a0 These papers address a range of themes and issues concerning the learning outcomes approach in higher education.\u00a0 As such, they help to show the broad and multi-faceted nature of this particular topic:<\/p>\n<p><span style=\"text-decoration: underline\">Conceptions of learning outcomes<\/span><\/p>\n<p><a href=\"http:\/\/link.springer.com\/article\/10.1007%2Fs11092-010-9097-8\" target=\"_blank\">Pr\u00f8itz, T.S. 2010. Learning outcomes: What are they? Who defines them? When and where are they defined? <em>Educational Assessment, Evaluation and Accountability<\/em> 22, no. 2: 119-137.<\/a><\/p>\n<p>As I\u2019ve commented on a number of times in previous posts, there are lots of debates engaged in by scholars about the origins and purposes of learning outcomes (they are variously viewed, for example, as the building blocks of student-centred learning or as supporting a managerialist accountability agenda).\u00a0 Rather than rehearsing or reviewing these well-established arguments, Pr\u00f8itz analyses a selection of 33 \u2018scholarly written documents\u2019 to investigate how learning outcomes are conceived of by scholars within these particular documents:<\/p>\n<blockquote><p><em>To provide insight into this issue, the paper explores the following questions: How is the term \u2018learning outcome\u2019 defined? By whom?\u00a0 When? Where?&#8230;Findings indicate that there is a dominant established definition of the term learning outcome.\u00a0 However, a wide range of alternative definitions are also identified.\u00a0 These assert that learning outcomes involve more than what can be described in pre-specified and measurable terms (from abstract).<\/em><\/p><\/blockquote>\n<p><span style=\"text-decoration: underline\">Debates about learning outcomes<\/span><\/p>\n<p><a href=\"http:\/\/jos.sagepub.com\/content\/49\/4.toc\">Farquharson, K. 2013. Regulating sociology: threshold learning outcomes and institutional isomorphism. <em>Journal of Sociology<\/em> 49, no. 4: 486\u2013500.<\/a><\/p>\n<p>Again, I\u2019ve tried to identify a paper here that interrogates the issue of learning outcomes, but from a different angle to the well-worn (and well-cited) arguments presented by scholars like Hussey and Smith.\u00a0 This paper discusses institutional isomorphism \u2013 \u2018a process whereby organisations come to appear and behave in a similar fashion\u2019, i.e. homogenisation becomes \u2018the norm across the field\u2019 (p.488) \u2013 and considers whether the adoption of threshold learning outcomes is an example of institutional isomorphism:<\/p>\n<blockquote><p><em>This article examines the adoption of threshold learning outcomes (TLOs) for academic disciplines in Australia as an example of institutional isomorphism. It is argued that the type of sociology embedded in the TLOs values the sociology of the metropole and that, while the TLOs are broad enough to allow for individual sociology departments to continue to teach their own version of sociology, they further institutionalise the norm that sociology is about metropolitan theory and methods. Nevertheless, these isomorphic processes may serve to positively legitimise and institutionalise sociology, potentially enhancing the discipline\u2019s position in higher education (from abstract).<\/em><\/p><\/blockquote>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Journal-annotate.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-272\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Journal-annotate.png\" alt=\"Journal annotate\" width=\"107\" height=\"107\" srcset=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Journal-annotate.png 192w, https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Journal-annotate-150x150.png 150w\" sizes=\"auto, (max-width: 107px) 100vw, 107px\" \/><\/a><\/p>\n<p><span style=\"text-decoration: underline\">Implementing a learning outcomes approach<\/span><\/p>\n<p><a href=\"http:\/\/alh.sagepub.com\/content\/3\/3\/205.short\">Watson, P. 2002. The role and integration of learning outcomes into the educational process. <em>Active Learning in Higher Education<\/em> 3: 205-219.<\/a><\/p>\n<p>I have included this paper as an example of how a learning outcomes approach was incorporated into construction degree courses within one institution.\u00a0 I do not suggest this is a perfect example or an example of the way it should be done.\u00a0 I have included it here specifically because it is <em>an<\/em> example:<\/p>\n<blockquote><p><em>This article provides a rationale for the adoption of a learning outcomes approach for delivering a curriculum. Included is a unit guide framework for establishing the learning outcomes and the incorporation of an appropriate assessment strategy. This format has been adopted at Sheffield Hallam University and has proved to be most successful. In order to provide validity for this approach, the article contains an example of the use of a learning outcomes model related to the requirements of professional bodies involved in the education of construction students within higher education establishments (from abstract).<\/em><\/p><\/blockquote>\n<p><span style=\"text-decoration: underline\">Assessing learning outcomes<\/span><\/p>\n<p><a href=\"http:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/10382040508668353#.U-HqYrd0xMs\">Smith, B.W., and Y. Zhou. 2005. Assessment of learning outcomes: the example of spatial analysis at Bowling Green State University. <em>International Research in Geographical and Environmental Education<\/em> 14, no. 3: 211-216.<\/a><\/p>\n<p><a href=\"http:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/02602930701773034#.U-HqjLd0xMs\">Oliver, B., B. Tucker, R. Gupta, and S. Yeo. 2008. <em>e<\/em>VALUate: an evaluation instrument for measuring students\u2019 perceptions of their engagement and learning outcomes. <em>Assessment &amp; Evaluation in Higher Education <\/em>33, no. 6: 619-630.<\/a><\/p>\n<p>These papers offer examples of how the assessment of learning outcomes is being approached in different institutions\/contexts.\u00a0 Smith and Zhou describe an approach based on students self-assessing the skills that they have developed (which are aligned to the learning outcomes of the course):<\/p>\n<blockquote><p><em>The purpose of this [paper] is to provide an overview of a developing approach to assessing selected undergraduate geography courses at Bowling Green State University (BGSU). The assessment focuses on the students\u2019 skills in collecting, integrating, analysing, displaying, and communicating spatial information and data sources using mapping and geographic information systems (GIS). For convenience, this set of skills is referred to as spatial analysis\u2026One factor influencing our approach is that the Student Achievement Assessment Committee has evolved university-wide learning outcomes that supposedly are attained by all graduates. Those outcomes are identified by six verbs: write, present, investigate, connect, participate, and lead (BGSU Student Achievement Assessment Committee)\u2026In this initial stage of the project\u2019s development, students are asked to complete a self-assessment on the set of skills ranging from simple map reading to advanced GIS analysis (p.211\/212).<\/em><\/p><\/blockquote>\n<p>Oliver et al discuss the development of a specific tool that has been developed to measure students\u2019 perceptions on their engagement with their course and their achievement of the learning outcomes:<\/p>\n<blockquote><p><em>In the current climate in Australian higher education, quality assurance in university teaching is a priority. In particular, the introduction of the Learning and Teaching Performance Fund (LTPF) has refocused attention on universities\u2019 internal student evaluation survey instruments.\u00a0 This paper reports the development, validation and implementation of a new unit survey instrument which prompts students to reflect on what helps their achievement of unit learning outcomes, and to report their levels of motivation, engagement and overall satisfaction with a semester-long course or unit of study. The instrument ( eVALUate) was created from precepts reported in the research literature, current practices in evaluating teaching, and sound quality assurance practices appropriate to a university outcomes-focused education paradigm (from abstract).<\/em><\/p><\/blockquote>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Girl-thinking.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-271\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Girl-thinking.png\" alt=\"Girl thinking\" width=\"91\" height=\"117\" \/><\/a><\/p>\n<p><span style=\"text-decoration: underline\">Sustainability<\/span><\/p>\n<p><a href=\"http:\/\/www.emeraldinsight.com\/journals.htm?articleid=1738024\">Svanstr\u00f6m, M., F.J. Lozano-Garc\u00eda, and D. Rowe. 2008. Learning outcomes for sustainable development in higher education. <em>International Journal of Sustainability in Higher Education<\/em> 9, no. 3: 339-351.<\/a><\/p>\n<p><a href=\"http:\/\/www.emeraldinsight.com\/journals.htm?articleid=1650876\">Shephard, K. 2008. Higher education for sustainability: seeking affective learning outcomes. <em>International Journal of Sustainability in Higher Education<\/em> 9, no. 1: 87-98.<\/a><\/p>\n<p>These papers I would particularly recommend reading.\u00a0 They consider learning outcomes within the context of promoting sustainability and affective learning.\u00a0 I have already commented in a <a title=\"Making learning outcomes work for social responsibility and not neoliberalism\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/03\/14\/socialresp\/\" target=\"_blank\">previous post <\/a>on how much I like Svanstr\u00f6m et al\u2019s framework of developing learning outcomes at two different levels.\u00a0 This framework helps to counter the arguments that learning outcomes narrow learning and promote a utilitarian focus:<\/p>\n<blockquote><p><em>This paper sets out to discuss the commonalities that can be found in learning outcomes (LOs) for education for sustainable development in the context of the Tbilisi and Barcelona declarations. The commonalities include systemic or holistic thinking, the integration of different perspectives, skills such as critical thinking, change agent abilities and communication, and finally different attitudes and values (from abstract).<\/em><\/p>\n<p><em>\u2026LOs for sustainability were generated in two levels, for \u201cBroad education and learning\u201d providing the systems perspective, and for \u201cDiscipline education and learning\u201d providing deeper disciplinary perspective (p.344).<\/em><\/p><\/blockquote>\n<p>Shephard focuses on the importance of developing learning within the affective domain, as well as the cognitive one.\u00a0 Various disciplines are examined to explore the ways in which they address affective outcomes and develop students\u2019 attitudes, values and behaviours:<\/p>\n<blockquote><p><em>This paper suggests that most teaching and assessment in higher education focus on cogitative skills of knowledge and understanding rather than on affective outcomes of values, attitudes and behaviours. Some areas of higher education, however, have effectively pursued affective outcomes and these use particular learning and teaching activities to do so. Key issues for consideration include assessing outcomes and evaluating courses, providing academic credit for affective outcomes, key roles for role models and designing realistic and acceptable learning outcomes in the affective domain (from abstract).<\/em><\/p>\n<p><em>\u2026This paper suggests that a central element of education for sustainability is a quest for affective learning outcomes of values, attitudes and behaviours\u2026educators for sustainability need to identify which of their intended learning outcomes are indeed affective outcomes of values, attitudes and behaviours (p.95\/96).<\/em><\/p><\/blockquote>\n<p>This, of course, is not an exhaustive list of interesting\/useful papers that focus on learning outcomes.\u00a0 However, they are some of the papers that have helped to clarify and extend my thinking around the topic of learning outcomes.\u00a0 Happy reading!<\/p>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Yellow-head-reading.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-274\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/08\/Yellow-head-reading.png\" alt=\"Yellow head reading\" width=\"125\" height=\"103\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over the last few months I have been doing some rigorous searching and reviewing of the published, peer-reviewed literature concerning learning outcomes.\u00a0 We currently have a paper in review as a result of this work and I hope to provide further details about that particular piece at some point soon. For this post, I want [&hellip;]<\/p>\n","protected":false},"author":147,"featured_media":273,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,3,24,6],"tags":[8,14,17,11],"class_list":["post-275","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-implementinglos","category-lodebates","category-lo-literature","category-losinhe","tag-forlos","tag-extendinglos","tag-reflections-on-los","tag-scholarviews"],"_links":{"self":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/275","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/comments?post=275"}],"version-history":[{"count":7,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/275\/revisions"}],"predecessor-version":[{"id":282,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/275\/revisions\/282"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media\/273"}],"wp:attachment":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media?parent=275"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/categories?post=275"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/tags?post=275"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}