{"id":205,"date":"2014-06-24T10:49:22","date_gmt":"2014-06-24T10:49:22","guid":{"rendered":"https:\/\/staffblogs.le.ac.uk\/loproject\/?p=205"},"modified":"2025-02-26T13:24:00","modified_gmt":"2025-02-26T13:24:00","slug":"counter","status":"publish","type":"post","link":"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/06\/24\/counter\/","title":{"rendered":"Countering arguments against learning outcomes with scrutiny and evidence"},"content":{"rendered":"<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Pencil-break.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-215\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Pencil-break.png\" alt=\"Pencil break\" width=\"104\" height=\"118\" \/><\/a><\/p>\n<p>The issue of &#8216;learning outcomes&#8217; often leads to heated debates about their desirability for and applicability to university level learning.\u00a0 I came across <a href=\"http:\/\/www.tssu.ca\/2013\/03\/13\/learning-outcomes-teaching-flexibility\/\" target=\"_blank\">this letter\u00a0<\/a>by a Professor at Simon Fraser University written to SFU students in which he argues, quite vociferously, against learning outcomes.\u00a0 Some key extracts are:<\/p>\n<blockquote><p><em>Students will have less of a voice in the classroom as a result of Learning Outcomes. This is because professors will not have the flexibility to deviate from the Outcomes they have created. Learning Outcomes will be created long before the first day of class. Professors will have pre-determined what you will learn, and what you will be marked on&#8230;students will not have a say in Learning Outcomes.<\/em><\/p>\n<p>&#8212;&#8212;&#8211;<\/p>\n<p><em>[Learning outcomes] set in stone what a course will look like. If you don\u2019t like it, lump it. It\u2019s not up to you.<\/em><\/p>\n<p>&#8212;&#8212;&#8211;<\/p>\n<p><em>Students are not cars in a car factory. You are not our raw material, to assemble as we want. The idea behind Learning Outcomes is that the university will somehow be able to describe precisely what you will turn out to be like<\/em><\/p>\n<p>&#8212;&#8212;-<\/p>\n<p><em>We need for students to have more of a say in their learning. We don\u2019t need more words about what students will be required to do.<\/em><\/p><\/blockquote>\n<p>Every time I read this letter I can feel the anger emanating from him.<\/p>\n<p>He also says:<\/p>\n<blockquote><p><em>This is the case with Learning Outcomes. The more we talk about, in advance, what is going to happen in class, the less chance there will be any wiggle room for innovation.<\/em><\/p>\n<p>&#8212;&#8212;<\/p>\n<p><em>If I cannot articulate what is wrong for students about Learning Outcomes, then I have no case<\/em><\/p><\/blockquote>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Angry-man.gif\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-214\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Angry-man.gif\" alt=\"Angry man\" width=\"82\" height=\"82\" \/><\/a><\/p>\n<p>The Professor is certainly not alone in his views here.\u00a0 The same, or very similar, arguments are often made by other scholars or educational commentators on the dangers of learning outcomes (LOs).\u00a0 I have to say, though, that\u00a0this is possibly the angriest piece I&#8217;ve come across yet &#8211; after reading the whole letter it does feel like LOs are set to destroy all that is good in the world of higher education.<\/p>\n<p>My intention here is not to mock the Professor for his views &#8211; as I say, he is not alone in them.\u00a0 It is to highlight, as I&#8217;ve done in a <a title=\"Unwarranted research claims in educational research: reflections for \u2018learning outcomes\u2019\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/05\/15\/warrantres\/\" target=\"_blank\">previous post<\/a>, that these, in essence, black and white views about LOs (i.e. that they are either good or bad in or for HE) do not match the empirical data that the &#8216;Learning Outcomes Project&#8217; has begun to gather.<\/p>\n<p>I noted in my <a title=\"Unwarranted research claims in educational research: reflections for \u2018learning outcomes\u2019\" href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/2014\/05\/15\/warrantres\/\" target=\"_blank\">previous post <\/a>the lack of empirical data on the topic of LOs in HE and I point out that many arguments against LOs are made with no evidence offered to support the claims being made &#8211; they are largely, in effect, the author&#8217;s fears about what they think will happen.<\/p>\n<p>The Professor&#8217;s letter here is a further case in point.\u00a0 He argues that if he cannot articulate what is wrong with LOs, then he has no case.\u00a0 Well, he does articulate his arguments very well &#8211; <strong><span style=\"text-decoration: underline\">but<\/span><\/strong> he has no <em>evidence<\/em> that LOs will actually\u00a0create these woeful learning situations.\u00a0 He is not basing his arguments on data (or proof) that these dreadful circumstances will arise from the adoption of\u00a0an LOs approach &#8211; he is basing them on his own fears and concerns.\u00a0 Again, I do\u00a0not belittle his fears or concerns, but rarely does an initiative or strategy lead to <em>only one<\/em> type of outcome for the whole diverse community in which it is applied.<\/p>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Diverse.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-217\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Diverse.png\" alt=\"Diverse\" width=\"107\" height=\"97\" \/><\/a><\/p>\n<p>At the &#8216;Learning Outcomes Project&#8217;, we are beginning to fill the empirical gap in\u00a0the knowledge about the <em>actual <\/em>impact of LOs for students and academic staff.\u00a0 In so doing, I do find it hard not to cringe a little bit when I read extreme, black and white views like this about LOs.<\/p>\n<p>Our data, with both students and academic staff, show that perspectives about and uses of LOs are far more nuanced than these extreme arguments allow for.\u00a0 I must refer here to our paper <em><a href=\"http:\/\/www.tandfonline.com\/doi\/full\/10.1080\/13562517.2014.901964\" target=\"_blank\">Learning about learning outcomes: the student perspective<\/a>, <\/em>which shows that students, in our study at least, do find LOs useful learning aids and use them in various ways to support their studies.\u00a0 Importantly, some students indicate that they do not focus solely on their LOs when studying but use them more as <em>guides<\/em> to help\u00a0direct their independent work &#8211;\u00a0this is not quite the straight-jacket effect on learning that the Professor suggests LOs will have.<\/p>\n<p>The ways in which students use LOs correspond in many ways to how academics in our study report working with LOs (paper to be published soon).\u00a0 Most academics indicate using LOs to help frame their thinking about their module design and assessment, rather than &#8216;set in stone&#8217; everything that they and their students will do.\u00a0 Almost all academics recognised the dangers of restricting learning around LOs, but stated that it comes down to how LOs are used by tutors.\u00a0 The majority of academics that we interviewed were concerned to use LOs in ways that would retain flexibility for students in their learning.\u00a0 Arguments like the Professor&#8217;s above give no agency to academics (or students) to use LOs in ways that support (rather than detract from or oppose) their teaching (or learning) values or pedagogical beliefs.<\/p>\n<p>Before I finish this post, I&#8217;d like to\u00a0just take a few learning outcomes and apply the Professor&#8217;s arguments to them to see how well his claims stand up to some scrutiny.\u00a0 These LOs have been gathered through our work on the &#8216;Learning Outcomes Project&#8217;:<\/p>\n<blockquote><p>LO1 &#8211; Identify the significant factors that led to the outbreak of the First World War<\/p>\n<p>LO2 &#8211; Analyse key films of the period in relation to their historical contexts of production and reception<\/p>\n<p>LO3 &#8211; Justify the appropriateness of the research method(s) chosen for your particular research project<\/p><\/blockquote>\n<p>According to the Professor, these LOs are a straight-jacket for the teacher and the student &#8211; prescribing only one determined way through the learning journey that neither the teacher nor the student can develop or refine as the module progresses.<\/p>\n<p>However, to me, these seem merely the formalised statements of what\u00a0teachers will have in their minds when developing their modules.\u00a0 I don&#8217;t think many teachers would start a module without some idea of what they want their students to get out of it or know\/understand by the end of it.\u00a0 If these ideas are not considered straight-jackets, why are LOs?<\/p>\n<p style=\"text-align: center\"><a href=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Student.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-219\" src=\"https:\/\/staffblogs.le.ac.uk\/loproject\/files\/2014\/06\/Student.png\" alt=\"Student\" width=\"104\" height=\"98\" \/><\/a><\/p>\n<p>There are also various ways in which the modules could be designed to achieve their LOs &#8211; the LOs do not prescribe the pedagogical methods as the Professor seems to suggest.\u00a0 There is room for flexibility and critique from the student too.\u00a0 Let&#8217;s take LO1 for example.\u00a0 This LO does not suggest that there is only one way for the student to achieve it &#8211; therefore, each student might have their own interpretations about the content covered in the module and so argue differently about the significance of the factors leading to the outbreak of the First World War.\u00a0 They will be identifying the significant factors (and so achieving the learning outcome) &#8211; yet they can also go beyond that to incorporate their own perspectives and analyses of the information and content they&#8217;ve studied.\u00a0 I cannot see why setting this LO\u00a0would mean this engagement by\u00a0students with the module\/content\u00a0is prohibited.\u00a0 I would suggest that LOs only become as restrictive to learning as the Professor suggests if teachers use them in\u00a0restrictive ways,\u00a0e.g. use them essentially as tick boxes\u00a0for content to be covered.\u00a0 But I have yet to come across a teacher who would work with their students in this way.\u00a0 Further, I happen to know of colleagues who are developing LOs explicitly with their students &#8211; which the Professor suggests\u00a0cannot and will not happen.<\/p>\n<p>So overall, my opinion is that the Professor&#8217;s arguments do not stand up to detailed scrutiny.\u00a0 Yet I have to admit, I am secretly pleased when I come across extreme and evidence-less arguments like this because it gives me the chance to highlight the work of our project and show how our data is now illuminating the insufficiences within the apparent &#8216;knowledge-base&#8217; about LOs in HE.\u00a0\u00a0 It is time, though, to\u00a0move beyond these types of extreme (and evidence-less) arguments and start engaging with\u00a0what the research data is <em>actually<\/em> beginning to tell\u00a0us, and only then can\u00a0we begin to have more meaningful conversations about the topic of LOs.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The issue of &#8216;learning outcomes&#8217; often leads to heated debates about their desirability for and applicability to university level learning.\u00a0 I came across this letter\u00a0by a Professor at Simon Fraser University written to SFU students in which he argues, quite vociferously, against learning outcomes.\u00a0 Some key extracts are: Students will have less of a voice [&hellip;]<\/p>\n","protected":false},"author":147,"featured_media":215,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,6,2],"tags":[9,17,11],"class_list":["post-205","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lodebates","category-losinhe","category-uolproject","tag-againstlos","tag-reflections-on-los","tag-scholarviews"],"_links":{"self":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/205","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/users\/147"}],"replies":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/comments?post=205"}],"version-history":[{"count":13,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/205\/revisions"}],"predecessor-version":[{"id":222,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/posts\/205\/revisions\/222"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media\/215"}],"wp:attachment":[{"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/media?parent=205"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/categories?post=205"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/staffblogs.le.ac.uk\/loproject\/wp-json\/wp\/v2\/tags?post=205"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}