{"id":136,"date":"2014-05-08T09:25:00","date_gmt":"2014-05-08T09:25:00","guid":{"rendered":"https:\/\/staffblogs.le.ac.uk\/loproject\/?p=136"},"modified":"2025-02-26T13:24:00","modified_gmt":"2025-02-26T13:24:00","slug":"limitedevidence","status":"publish","type":"post","link":"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/05\/08\/limitedevidence\/","title":{"rendered":"Arguing against learning outcomes: limited evidence and moving forward"},"content":{"rendered":"<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/05\/Professor.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-144\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/05\/Professor.png\" alt=\"Professor\" width=\"137\" height=\"125\" \/><\/a><\/p>\n<p>As part of the &#8216;Learning Outcomes Project&#8217;, I&#8217;m always very eager to see the different contexts in which other academics\/scholars write about learning outcomes (LOs).\u00a0 Last week I came across <a href=\"http:\/\/thesedablog.wordpress.com\/2014\/04\/24\/53ideas-2-students-respond-to-clear-and-high-expectations\/\" target=\"_blank\">a piece from Graham Gibbs <\/a>on the SEDA blog in which he discusses the importance of conveying clear and high expectations to students.\u00a0 The key message for me from the piece was that high expectations need to be communicated to students, not the threshold or bare minimum that they have to do, and an effective method for communicating these high expectations may be using exemplars of previous exceptional work.\u00a0 It is a thought-provoking piece that I would encourage others to read.<\/p>\n<p>As I indicate above, I was particularly interested in this piece because LOs were included in the discussion.\u00a0 Gibbs argues that quality assurance regulations have led to LOs being implemented across institutions for their apparent ability to convey clear expectations.\u00a0 However, my use of the word &#8216;apparent&#8217; is significant as, for Gibbs, the situation is far less straightforward:<\/p>\n<blockquote><p><em>All of this is supposed to convey clear expectations. However there is a growing realisation that, first, it is very difficult for anyone to understand what learning outcomes and criteria actually mean, or for two people to understand the same thing \u2013 including teachers and markers. Second, that the more detail is provided, the more detail students demand. Third, that the big, complex and important goals teachers care about can come to be replaced by small, simple and trivial goals that seem easier to specify. This is a problem that was encountered with \u2018behavioural objectives\u2019 in the 1950\u2019s and 60\u2019s to such an extent that such objectives were largely abandoned in the UK (though not in the US). And fourth, that the greater the degree of specification, the easier it is for students to see clearly what they do not need to do, resulting in them narrowing their attention in a strategic way.<\/em><\/p><\/blockquote>\n<p>I don&#8217;t take issue with any of the arguments Gibbs is making here.\u00a0 They are arguments that are well-known within the LOs literature and have been made by various scholars (see for example <a href=\"http:\/\/alh.sagepub.com\/content\/3\/3\/220.abstract\" target=\"_blank\">Hussey and Smith, 2002<\/a>).\u00a0 They are also perhaps fairly logical arguments to make about what could potentially be the consequences of a LOs approach in HE.<\/p>\n<p>But again, my use of &#8216;could potentially&#8217; is significant here.\u00a0 My issue, or rather the point I would like to make in response to these comments from Gibbs, is that whenever claims like these are made about LOs, evidence\u00a0is rarely given to support them.<\/p>\n<p>In the <a href=\"http:\/\/www.tandfonline.com\/doi\/full\/10.1080\/13562517.2014.901964\" target=\"_blank\">paper<\/a> that\u00a0the\u00a0&#8216;Learning Outcomes Project&#8217; has just had published, we show that, currently, there is very little evidence about how students view and use LOs.\u00a0 As such, our understandings about the impact of LOs on student learning is very limited.\u00a0 Our\u00a0paper goes on to present the research that we have conducted with students.\u00a0\u00a0Some of our key findings\u00a0were that the majority of our participants found LOs useful and wanted them to remain a part of their learning experience.\u00a0 Encouragingly, some in our focus groups indicated that they did not want to narrow their learning around LOs but rather use\u00a0the LOs as a guide from which they could then develop and extend their learning according to their own interests and passions.<\/p>\n<p>Similarly, in a paper to be published soon, we present the results of research conducted with academic staff about their views and uses of LOs.\u00a0 We found little indication that the <em>&#8216;important goals teachers care about&#8217;<\/em> were becoming <em>&#8216;replaced by small, simple and trivial goals that seem easier to specify&#8217;<\/em>.\u00a0 In actuality, academics&#8217; responses indicated that their use of LOs is far more nuanced than general statements such as Gibbs&#8217; suggest.\u00a0 I have also discussed in <a title=\"Can learning outcomes support the broader purposes of higher education?\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/02\/20\/lopurposes\/\" target=\"_blank\">other blog posts <\/a>how LOs can be used to support broader educational goals, and within these discussions I draw on <a title=\"Making learning outcomes work for social responsibility and not neoliberalism\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/03\/14\/socialresp\/\" target=\"_blank\">work others are doing <\/a>in this area.<\/p>\n<p>My point here is not necessarily to refute anything that Gibbs is saying about LOs, but to highlight that these arguments are often made from what appears to be a &#8216;common-sense&#8217; perspective rather than an evidentiary one.\u00a0 Further, the evidence the &#8216;Learning Outcomes Project&#8217; has gained so far does not always support these &#8216;common-sense&#8217; claims.<\/p>\n<p>But again, my aim here is not to suggest that scholars are\u00a0at fault with the arguments\u00a0they are making.\u00a0 Instead, I am saying that we need to now move beyond these oft-made and oft-cited complaints about LOs as they don&#8217;t move our understandings about this topic forward.\u00a0 In connection to my <a title=\"Embracing the nuances within a learning outcomes approach: moving the discussions forward\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/04\/29\/embracingnuances\/\" target=\"_blank\">previous post<\/a>, these grand statements don&#8217;t take account of the nuances within the situations in which both the students and staff in our research are applying and using LOs.\u00a0 These grand statements don&#8217;t even actually\u00a0imply that there could be nuances within these situations.\u00a0 As such, they don&#8217;t help us to understand how LOs are being used in practice, and what impact they might be having on teaching and learning.<\/p>\n<p>At the &#8216;Learning Outcomes Project&#8217;, we are moving beyond these statements to research and provide evidence about the actual uses and impacts of LOs on students, staff and HE as a whole.\u00a0 In this way we hope to drive discussions and understandings about this topic forward.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As part of the &#8216;Learning Outcomes Project&#8217;, I&#8217;m always very eager to see the different contexts in which other academics\/scholars write about learning outcomes (LOs).\u00a0 Last week I came across a piece from Graham Gibbs on the SEDA blog in which he discusses the importance of conveying clear and high expectations to students.\u00a0 The key [&hellip;]<\/p>\n","protected":false},"author":147,"featured_media":144,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,6,4,2],"tags":[9,17,11],"class_list":["post-136","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lodebates","category-losinhe","category-researchinglos","category-uolproject","tag-againstlos","tag-reflections-on-los","tag-scholarviews"],"_links":{"self":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/136","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/comments?post=136"}],"version-history":[{"count":10,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/136\/revisions"}],"predecessor-version":[{"id":147,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/136\/revisions\/147"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media\/144"}],"wp:attachment":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media?parent=136"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/categories?post=136"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/tags?post=136"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}