{"id":50447,"date":"2021-07-02T09:29:59","date_gmt":"2021-07-02T13:29:59","guid":{"rendered":"https:\/\/www.sogolytics.com\/blog\/?p=50447"},"modified":"2023-06-07T10:34:51","modified_gmt":"2023-06-07T14:34:51","slug":"can-student-parent-surveys-measure-teaching-quality","status":"publish","type":"post","link":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/","title":{"rendered":"Can Student\/Parent Surveys Measure Teaching Quality?"},"content":{"rendered":"<p>The Bill &amp; Melinda Gates Foundation performed a study to answer the question: &#8220;Can well-crafted student surveys play an important role in evaluating teacher effectiveness?&#8221; What researchers <a href=\"https:\/\/www.researchgate.net\/publication\/262091843_Can_Student_Surveys_Measure_Teaching_Quality\" target=\"_blank\" rel=\"noopener noreferrer\">discovered<\/a> is incredibly important not only to students who rate their teachers, but also to parents who want the best educational experience for their child.<\/p>\n<div class=\"div-spacer\"><\/div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-50450 size-large\" src=\"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1-1024x683.jpg\" alt=\"A classroom\" width=\"1024\" height=\"683\" srcset=\"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1.jpg 1024w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1-300x200.jpg 300w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1-768x512.jpg 768w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1-600x400.jpg 600w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-1-50x33.jpg 50w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<div class=\"div-spacer\"><\/div>\n<p>Let\u2019s look at this and other studies correlating surveys to teacher effectiveness and quality.<\/p>\n<div class=\"div-spacer\"><\/div>\n<h2>Harvard University, Ronald Ferguson, December 2018<\/h2>\n<p><a href=\"https:\/\/www.researchgate.net\/publication\/262091843_Can_Student_Surveys_Measure_Teaching_Quality\" target=\"_blank\" rel=\"noopener noreferrer\">This study<\/a> found that certain classroom characteristics were linked to teacher quality, and these characteristics could successfully predict student achievement. The scenario presented by the study was a classroom full of students who appeared at a glance to be well-behaved and successfully learning, but in reality were bored because the teacher valued memorization more than understanding. The teacher was actually indifferent to students\u2019 feelings and opinions.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>While end-of-year tests scored high enough to keep this teacher in place, there was no love of learning among the students. The reason administration and the teacher didn\u2019t know this? No one asked the students.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>Colleges and universities evaluate teaching. These surveys help administrators determine pay increases and promotion opportunities. And students can rate instructors in online surveys that other students use to select which classes\/instructors they prefer. Students in elementary and primary schools don\u2019t have this option.<\/p>\n<div class=\"div-spacer\"><\/div>\n<h2>Inside Higher Ed<\/h2>\n<p>On the flip side, <a href=\"https:\/\/www.insidehighered.com\/news\/2020\/02\/27\/study-student-evaluations-teaching-are-deeply-flawed\" target=\"_blank\" rel=\"noopener noreferrer\">studies show<\/a> that student evaluations of teaching are deeply flawed. They bear little relation to teaching effectiveness because they\u2019re biased and unreliable. The study found that students\u2019 biases affect ratings rather than an objective view of a teacher\u2019s capabilities. In essence, a student\u2019s learning experiences are swayed by gender, class size, type of course being taught, and other irrelevant criteria.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>Students perceive instructors differently based on characteristics like age, gender, race, and more. As a result, these perceptions could negatively affect outcomes for minority groups while punishing teachers who represent unpopular topics or courses.<\/p>\n<div class=\"div-spacer\"><\/div>\n<h2>Correlating student ratings with teaching quality<\/h2>\n<p><a href=\"https:\/\/www.insidehighered.com\/news\/2020\/02\/27\/study-student-evaluations-teaching-are-deeply-flawed\" target=\"_blank\" rel=\"noopener noreferrer\">Studies show<\/a> that students evaluating teachers (SET) are notoriously unreliable and biased. They should not be relied upon to make staffing decisions or tenure options. Unreliable student surveys disadvantage faculty, and punishes those who teach less &#8220;popular&#8221; courses.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>As part of the above study, researchers wanted to answer the question, &#8220;If SETs are valid, reliable, and unbiased, what next?&#8221; How do administrators interpret SET scores without a level of bias and a fair basis to judge teachers\u2019 performance? The study reports that even under &#8220;ideal&#8221; circumstances, SETs &#8220;still yield an &#8216;unacceptably high error rate.'&#8221;<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>The study goes on to say that the correlation between student ratings and teaching quality is &#8220;far, far stronger than even the most optimistic empirical research can support.&#8221; If this is the case, then SETs lead to correct decisions. In essence, this means the teachers with the highest evaluations are most likely the poorest teachers and those with the lowest scores are &#8220;better than the typical instructor.&#8221;<\/p>\n<div class=\"div-spacer\"><\/div>\n<h2>Take teacher evaluations with a grain of salt<\/h2>\n<p>Educational administrators should take student ratings of the quality of instruction with a grain of salt. Studies show these surveys are biased and unreliable. However, administrations still use these evaluations to determine staffing and more because they\u2019re both easy and inexpensive to capture and evaluate compared with other teaching assessments for quality.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>The evidence cautions evaluating the results. Studies are split between an active computation of teachers and technology-based simulations of teacher scores. When studies simulate scores and compare job candidates across a field, they found faculty who were underperforming compared to their peers. What they found was that SET scores don\u2019t correlate with quality or student learning. Thus, teacher surveys don\u2019t always lead to a determination of teacher quality.<\/p>\n<div class=\"div-minispacer\"><\/div>\n<p>Even high scorers on the SET can be identified as &#8220;poor teachers.&#8221; The above research found that &#8220;19 percent of those with SET scores above the 95th percentile are no better than the median professor at teaching.&#8221;<\/p>\n<div class=\"div-spacer\"><\/div>\n<h2>Final thoughts<\/h2>\n<p>What does this mean for evaluating teachers\u2019 quality? In essence, you can\u2019t filter out idiosyncrasies in <a href=\"https:\/\/www.sogolytics.com\/survey-templates\/school\/teacher-professional-development-survey\/\" target=\"_blank\" rel=\"noopener noreferrer\">teacher surveys<\/a>. What you can do is construct surveys that focus on independent evaluations, interviews with students, teacher observations, and peer reviews of teaching materials. This gives you a more accurate picture of a teacher\u2019s proficiency than SET scores alone.<\/p>\n<div class=\"div-spacer\"><\/div>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-50449 size-large\" src=\"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-2-1024x637.jpg\" alt=\"Student Teacher interaction\" width=\"1024\" height=\"637\" srcset=\"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-2.jpg 1024w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-2-300x187.jpg 300w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-2-768x478.jpg 768w, https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2021\/07\/k12-2-50x31.jpg 50w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<div class=\"div-spacer\"><\/div>\n<p>Surveying students, parents, teachers, and peers can give you a more accurate picture of teaching quality. Still, expect some bias and variations. To get a more accurate picture of teaching proficiency, use multiple forms of assessment to discover a teacher\u2019s true performance.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The Bill &amp; Melinda Gates Foundation performed a study to answer the question: &#8220;Can well-crafted student surveys play an important role in evaluating teacher effectiveness?&#8221; What researchers discovered is incredibly important not only to students who rate their teachers, but also to parents who want the best educational experience for their child. Let\u2019s look at this and other studies correlating surveys to teacher effectiveness and quality. Harvard University, Ronald Ferguson, December 2018 This study found that certain classroom characteristics were linked to teacher quality, and these characteristics could successfully predict student achievement. The scenario presented by the study was a classroom full of students who appeared at a glance to be well-behaved and successfully learning, but in reality were bored because the teacher valued memorization more than understanding. The teacher was actually indifferent to students\u2019 feelings and opinions. While end-of-year tests scored high enough to keep this teacher in place, there was no love of learning among the students. The reason administration and the teacher didn\u2019t know this? No one asked the students. Colleges and universities evaluate teaching. These surveys help administrators determine pay increases and promotion opportunities. And students can rate instructors in online surveys that other students use to select which classes\/instructors they prefer. Students in elementary and primary schools don\u2019t have this option. Inside Higher Ed On the flip side, studies show that student evaluations of teaching are deeply flawed. They bear little relation to teaching effectiveness because they\u2019re biased and unreliable. The study found that students\u2019 [&hellip;]<\/p>\n","protected":false},"author":42,"featured_media":5087,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[800,186],"tags":[209,270,146,631,632],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v19.7.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog<\/title>\n<meta name=\"description\" content=\"Can well-crafted student surveys truly evaluate teacher effectiveness? Here&#039;s a look at studies correlating surveys to teacher effectiveness and quality.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog\" \/>\n<meta property=\"og:description\" content=\"Can well-crafted student surveys truly evaluate teacher effectiveness? Here&#039;s a look at studies correlating surveys to teacher effectiveness and quality.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/\" \/>\n<meta property=\"og:site_name\" content=\"Sogolytics Blog\" \/>\n<meta property=\"article:published_time\" content=\"2021-07-02T13:29:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-07T14:34:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2018\/08\/k12-2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"487\" \/>\n\t<meta property=\"og:image:height\" content=\"714\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Kathy Edens\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/\",\"url\":\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/\",\"name\":\"Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.sogolytics.com\/blog\/#website\"},\"datePublished\":\"2021-07-02T13:29:59+00:00\",\"dateModified\":\"2023-06-07T14:34:51+00:00\",\"author\":{\"@id\":\"https:\/\/www.sogolytics.com\/blog\/#\/schema\/person\/8c1bd6009f414ebed9f5d54e258bb581\"},\"description\":\"Can well-crafted student surveys truly evaluate teacher effectiveness? Here's a look at studies correlating surveys to teacher effectiveness and quality.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Can Student\/Parent Surveys Measure Teaching Quality?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.sogolytics.com\/blog\/#website\",\"url\":\"https:\/\/www.sogolytics.com\/blog\/\",\"name\":\"Sogolytics Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.sogolytics.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.sogolytics.com\/blog\/#\/schema\/person\/8c1bd6009f414ebed9f5d54e258bb581\",\"name\":\"Kathy Edens\",\"description\":\"A stereotypical introvert, Kathy is a writer who isn\u2019t sure what she thinks until she writes about it. She believes collaborating with a variety of individuals from all walks of life and different experiences makes content come alive.\",\"url\":\"https:\/\/www.sogolytics.com\/blog\/author\/kedens\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog","description":"Can well-crafted student surveys truly evaluate teacher effectiveness? Here's a look at studies correlating surveys to teacher effectiveness and quality.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/","og_locale":"en_US","og_type":"article","og_title":"Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog","og_description":"Can well-crafted student surveys truly evaluate teacher effectiveness? Here's a look at studies correlating surveys to teacher effectiveness and quality.","og_url":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/","og_site_name":"Sogolytics Blog","article_published_time":"2021-07-02T13:29:59+00:00","article_modified_time":"2023-06-07T14:34:51+00:00","og_image":[{"width":487,"height":714,"url":"https:\/\/www.sogolytics.com\/blog\/wp-content\/uploads\/2018\/08\/k12-2.jpg","type":"image\/jpeg"}],"author":"Kathy Edens","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/","url":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/","name":"Can Student\/Parent Surveys Measure Teaching Quality? - Sogolytics Blog","isPartOf":{"@id":"https:\/\/www.sogolytics.com\/blog\/#website"},"datePublished":"2021-07-02T13:29:59+00:00","dateModified":"2023-06-07T14:34:51+00:00","author":{"@id":"https:\/\/www.sogolytics.com\/blog\/#\/schema\/person\/8c1bd6009f414ebed9f5d54e258bb581"},"description":"Can well-crafted student surveys truly evaluate teacher effectiveness? Here's a look at studies correlating surveys to teacher effectiveness and quality.","breadcrumb":{"@id":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.sogolytics.com\/blog\/can-student-parent-surveys-measure-teaching-quality\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Can Student\/Parent Surveys Measure Teaching Quality?"}]},{"@type":"WebSite","@id":"https:\/\/www.sogolytics.com\/blog\/#website","url":"https:\/\/www.sogolytics.com\/blog\/","name":"Sogolytics Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.sogolytics.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.sogolytics.com\/blog\/#\/schema\/person\/8c1bd6009f414ebed9f5d54e258bb581","name":"Kathy Edens","description":"A stereotypical introvert, Kathy is a writer who isn\u2019t sure what she thinks until she writes about it. She believes collaborating with a variety of individuals from all walks of life and different experiences makes content come alive.","url":"https:\/\/www.sogolytics.com\/blog\/author\/kedens\/"}]}},"_links":{"self":[{"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/posts\/50447"}],"collection":[{"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/users\/42"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/comments?post=50447"}],"version-history":[{"count":4,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/posts\/50447\/revisions"}],"predecessor-version":[{"id":57663,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/posts\/50447\/revisions\/57663"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/media\/5087"}],"wp:attachment":[{"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/media?parent=50447"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/categories?post=50447"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sogolytics.com\/blog\/wp-json\/wp\/v2\/tags?post=50447"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}