{"id":5406,"date":"2013-05-02T05:13:21","date_gmt":"2013-05-02T05:13:21","guid":{"rendered":"http:\/\/eltchat.org\/wordpress\/?p=5406"},"modified":"2013-05-02T05:13:21","modified_gmt":"2013-05-02T05:13:21","slug":"materials-evaluation-an-eltchat-summary-200213","status":"publish","type":"post","link":"https:\/\/eltchat.org\/index.php\/2013\/05\/02\/materials-evaluation-an-eltchat-summary-200213\/","title":{"rendered":"Materials Evaluation &#8211; An #Eltchat Summary (20\/02\/13)"},"content":{"rendered":"<p>The topic this week was:<\/p>\n<blockquote><p><strong>Materials evaluation: What would be your top tips for effectively evaluating materials for language teaching? What do you look for? What do you avoid? What influences your decisions in using or not using a given material?<\/strong><\/p>\n<p>&nbsp;<\/p>\n<div id=\"attachment_5422\" style=\"width: 310px\" class=\"wp-caption alignleft\"><a href=\"http:\/\/eltchat.org\/wordpress\/wp-content\/uploads\/2013\/05\/2012-12-04-14.32.24.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-5422\" class=\"size-medium wp-image-5422\" alt=\"photo taken by @Marisa_C \" src=\"http:\/\/eltchat.org\/wordpress\/wp-content\/uploads\/2013\/05\/2012-12-04-14.32.24-300x225.jpg\" width=\"300\" height=\"225\" \/><\/a><p id=\"caption-attachment-5422\" class=\"wp-caption-text\">photo taken by @Marisa_C<\/p><\/div><\/blockquote>\n<p><em>When we evaluate materials, we inevitably ask lots of questions. Turns out discussion of materials evaluation generates a great quantity of questions too. Here is the summary I have cobbled together from a particularly challenging transcript:<\/em><\/p>\n<p><em>(NB: I have filled in the missing letters from all tweets containing abbreviations, just to make reading easier!)<\/em><\/p>\n<p>@Marisa_C helpfully defined materials for us: \u201cMaterials = coursebook, supplementary, own design, downloads, anything\u201d and everybody jumped in with<strong>\u00a0criteria<\/strong>\u00a0<strong>they consider important<\/strong>. Further\u00a0<strong>criteria<\/strong>\u00a0arose throughout the discussion, but for convenience and clarity, they are all gathered together here:<\/p>\n<blockquote><p>Needs to provide good mix of skills and be interactive. Lots of heads-up activities. (@MarjorieRosenbe)<\/p>\n<p>Also important is clear structure and engaging topics.\u00a0(@MarjorieRosenbe)<\/p>\n<p>Level should be appropriate. (@MarjorieRosenbe)<\/p>\n<p>Materials able to be connected to students\u2019 intrerests\/background\/culture..? (@TomTesol)<\/p>\n<p>We usually look at\u00a0 whether suited to specific learning situation\u00a0 + offer valid methodology in relation to course aims. (@AlexandraKouk)<\/p>\n<p>I think materials need to allow us to communicate well with students \u2013 that creates rapport. (@MarjorieRosenbe)<\/p>\n<p>For me, the point of a book is to help me present new input to ss \u2014 I have to do the rest (communicative stuff) (@TomTesol)<\/p>\n<p>For me, an important criterion is how memorable is the topic\/.content going to be so that language can stay \u2018glued\u2019 to it. (@Marisa_C)<\/p>\n<p>How does the material lend itself or be adapted) to natural,meaningful,relevant communication? (@CotterHUE)<\/p>\n<p>I don\u2019t think a book should tell you what, but rather present a selection of things to choose from. (@teflgeek)<\/p>\n<p>F=fun R=rapport I=ideology N=needs D=design. \u2026Sorry missed the E=education (as in principles of) (@Marisa_C)<\/p>\n<p>When I look at a page of material I see if I would be interested myself \u2013 then I decide. And I ask sts what they think too.\u00a0(@MarjorieRosenbe)<\/p>\n<p>I like materials which show you something interesting about the world and help learn\/practise language\/skills (@robertmclarty)<\/p>\n<p>Systematically:\u00a0 Does it fit age, level, syllabus criteria\u2026 (@teflgeek)<\/p>\n<p>I also feel materials need to appeal to variety of learner types\u2026Learner types can be sensory perception (VAK) but also global-analytic cognitive processing types. (@MarjorieRosenbe)<\/p>\n<p>Another issue to consider with mats is that subject matter might interest you, but does it interest sts? (@pjgallantary)<\/p>\n<p>Assess supplementary audio: is it an EIL approach with non-natives holding conversations? Or native English speakers? (@CotterHUE)<\/p><\/blockquote>\n<h1><em>Done and dusted? I think not. Materials evaluation is a complex business.<\/em><\/h1>\n<p>I posed the question \u201chow do you identify the criteria and which are more\/less important also?\u201d and @pjgallantary supplied a useful answer: \u201ccourse books are\u00a0where we all start \u2013 knowing how they work helps us understand what to look for in materials\u201d \u00a0Of course, being able to evaluate effectively isn\u2019t the whole story \u2013 there are institutional constraints to take into consideration too. @Shaunwilden reminded us that course books \u00a0\u201dare establishment enforced more often than a choice by teacher and students\u201d and\u00a0@teflgeek told us about a group evaluation process in which nobody agreed, and the resolution? \u201cThere were three of us and the DoS got the casting vote\u201d. \u00a0Meanwhile,\u00a0@TomTesol reminded us that materials evaluation is not just about selection prior to the beginning of a course but a continuing process involving \u201cconstantly reviewing, getting students\u2019 and faculty feedback\u2026\u201d<\/p>\n<p>The discussion meandered naturally into the question of materials adaptation, which is a common follow-on to evaluation and identification of shortcomings. Why do we adapt the all-singing, all-dancing glorious multi-colour materials on the market these days?<\/p>\n<h1><strong>The following reasons emerged:<\/strong><\/h1>\n<blockquote><p>Books written for a specific demographic with set format from publisher\u2026which doesn\u2019t match your students (@CotterHUE)<\/p>\n<p>Problems with delivery but mostly missing keys and audioscripts which meant I had to copy them for students (@MarjorieRosenbe)<\/p>\n<p>Other reason was that book on ICT was really outdated. Or book for BEC prep didn\u2019t deal with exam (@MarjorieRosenbe)<\/p>\n<p>Main issue with coursebooks is their homogeneity \u2013 T needs to be able to make relevant to own students (@pjgallantary)<\/p>\n<p>Ultimately NO book is ever going to be right for your class because it wasn\u2019t designed specifically for your class. (@teflgeek)<\/p>\n<p>The point in the book is that you may HAVE to use it in which case try to salvage what you can &amp; improve (@Marisa_C)<\/p>\n<p>I constantly adapt and update materials based on surprises, feedback, etc. design new materials too. Assessment important (@CotterHUE)<\/p><\/blockquote>\n<h1><strong>And how do we go about it?<\/strong><\/h1>\n<blockquote><p>To lessonize: first, look at relevance of content\u00a0 i.e. what u want it for &#8211;\u00a0 to teach language point, vocab., skills etc (@AlexandraKouk)<\/p>\n<p>As to developing own materials, As ever we must start from sts needs -WHY are we using this text, this video, etc, then HOW (@pjgallantary)<\/p>\n<p>I create materials for PEO using articles \u2013 lots of things you can do \u2013 vocab, discussion, grammar etc. (@MarjorieRosenbe)<\/p>\n<p>I adapt to suit the SKILLS I want them to develop (@TomTesol)<\/p>\n<p>As Marisa implied, if you can\u2019t figure out a way to adapt materials so the inpurt will stick, your evaluation is finished: They stink. (@TomTesol)<\/p><\/blockquote>\n<p>The question of the role of the\u00a0<strong>Teacher\u2019s Book<\/strong>\u00a0within the evaluation process, and ultimately teaching, was touched on a few times throughout the discussion and opinons were varied:<\/p>\n<blockquote><p>Never really use the teachers book, except for answers. Looking at teachers book means I\u2019m unresponsive to the class.(@CotterHUE)<\/p>\n<p>Depends. Came across word I didn\u2019t know in ESP book, now have printed teachers notes.(@MarjorieRosenbe)<\/p>\n<p>Most are now online and often very long. 120 pages or so of pdfs to print out.But lots of info. (@Marjorie Rosenbe)<\/p>\n<p>Teacher\u2019s Book Important to most \u2018non-natives\u2019 I\u2019ve worked with. (@TomTesol)<\/p>\n<p>Or inexperienced \u2018natives\u2019. Or experienced \u2018natives\u2019 looking for new ideas or something to bounce off maybe. (@LizziePinard)<\/p>\n<p>For me not very [important] but if I am choosing for a group of teachers it is something I look at closely. (@Shaunwilden)<\/p>\n<p>Well, depending on the market and availability of training \u2013 sometimes that\u2019s all a Teacher can get \u2013 a good Teacher\u2019s guide. (@Marisa_C)<\/p><\/blockquote>\n<p>A few curveballs were thrown near the end \u2013 broadening the scope of \u201cmaterials\u201d but there wasn\u2019t enough time to go into this in any depth as the hour was fast drawing to a close and next thing we knew everyone was being invited to contribute their final five minute words of wisdom. This is what emerged amongst fielding of curveballs:<\/p>\n<blockquote><p>Constant assessment of materials, be it website, publisher, etc. What works with your style and students? What doesnt work? (@CotterHUE)<\/p>\n<p>I think to evaluate effectively you need more awareness of your own beliefs\/principles etc and good awareness of context etc (@LizziePinard)<\/p>\n<p>Test drive stuff before landing yourself with a CB for a year of pain! Use good placement to match students to level especially important first (@oyajimbo)<\/p><\/blockquote>\n<h1>Finally, here are the\u00a0links that were thrown up throughout the discussion:<\/h1>\n<blockquote><p>Very old\u00a0<a href=\"http:\/\/t.co\/NoZ5KNl1\">blog post<\/a>\u00a0on choosing a CB or materials (@Marisa_C)<\/p>\n<p>Here\u2019s\u00a0<a href=\"http:\/\/t.co\/xcxbkqpm\">more recent research<\/a>\u00a0with v. useful checklist on p.6 (@AlexandraKouk)<\/p>\n<p>Subject matter might interest you but does it interest sts?\u00a0<a href=\"http:\/\/t.co\/2E7v7bOK\">Wrote about that<\/a>\u00a0(@CotterHUE)<\/p>\n<p>A\u00a0<a href=\"http:\/\/t.co\/ghQgawKB\">useful research paper\u00a0<\/a>\u00a0(@AlexandraKouk)<\/p>\n<p><a href=\"http:\/\/t.co\/JGM85Oha\">Another useful research paper<\/a>\u00a0(@AlexandraKouk)<\/p>\n<p>Have a look<a href=\"http:\/\/t.co\/SqX591bs\">\u00a0here\u00a0<\/a>and add sth if you can \u2013 been collecting interesting texts\/topics for developing lessons. (@Marisa_C)<\/p>\n<p><a href=\"http:\/\/t.co\/RPUVjLv6\">Pecha Kucha<\/a>\u00a0with mnemonic for evaluation (@Marisa_C)<\/p>\n<p>This is a\u00a0<a href=\"http:\/\/t.co\/jOEjcQf6\">MATERIALS mnemonic<\/a>\u00a0from Tanner and Green (back in the day)\u00a0(borrowed) (@TomTesol)<\/p><\/blockquote>\n<p><em>Phew! That finally brings me to the end of this summary. Thanks all for a great discussion. And, if you have any criteria you want to add to the list, anything you want to add, agree, or indeed disagree with, feel free to do so in the comments section. Nobody will object to the discussion continuing, I am sure!<\/em><\/p>\n<p><em>Thank you to all who participated.\u00a0<img decoding=\"async\" alt=\":-)\" src=\"http:\/\/s0.wp.com\/wp-includes\/images\/smilies\/icon_smile.gif?m=1129645325g\" \/><\/em><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<h1><strong>Postscript:<\/strong><\/h1>\n<p>&nbsp;<\/p>\n<p>If you want an overview of all the literature out there on materials development and have access\/can wangle access to journal articles, @HeatherBu2011 recommends the following:<\/p>\n<p>\u201cState-of-the-Art Article:\u00a0<em id=\"__mceDel\">Materials development for language learning and teaching\u201d\u00a0<\/em>by Brian Tomlinson in\u00a0Language Teaching (2012), 45.2, 143\u2013179<\/p>\n<p>&nbsp;<\/p>\n<p>Thanks to <a href=\"http:\/\/reflectiveteachingreflectivelearning.com\/2013\/02\/21\/summary-of-20th-february-2013s-eltchat-discussion-on-materials-evaluation\/\">Lizzie Pinard<\/a> for this summary.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The topic this week was: Materials evaluation: What would be your top tips for effectively evaluating materials for language teaching? What do you look for? What do you avoid? What influences your decisions in using or not using a given material? &nbsp; When we evaluate materials, we inevitably ask lots of questions. Turns out discussion&hellip; <br \/> <a class=\"read-more\" href=\"https:\/\/eltchat.org\/index.php\/2013\/05\/02\/materials-evaluation-an-eltchat-summary-200213\/\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[12],"tags":[],"class_list":["post-5406","post","type-post","status-publish","format-standard","hentry","category-summary"],"_links":{"self":[{"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/posts\/5406","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/comments?post=5406"}],"version-history":[{"count":0,"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/posts\/5406\/revisions"}],"wp:attachment":[{"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/media?parent=5406"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/categories?post=5406"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eltchat.org\/index.php\/wp-json\/wp\/v2\/tags?post=5406"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}