John Hattie developed a way of synthesizing various influences in different meta-analyses according to their effect size (Cohen’s d). In his ground-breaking study “Visible Learning” he ranked 138 influences that are related to learning outcomes from very positive effects to very negative effects. Hattie found that the average effect size of all the interventions he studied was 0.40. Therefore he decided to judge the success of influences relative to this ‘hinge point’, in order to find an answer to the question “What works best in education?”
Originally, Hattie studied six areas that contribute to learning: the student, the home, the school, the curricula, the teacher, and teaching and learning approaches. (The updated list also includes the classroom.) But Hattie did not only provide a list of the relative effects of different influences on student achievement. He also tells the story underlying the data. He found that the key to making a difference was making teaching and learning visible. He further explained this story in his book “Visible learning for teachers“.
John Hattie updated his list of 138 effects to 150 effects in Visible Learning for Teachers (2011), and more recently to a list of 195 effects in The Applicability of Visible Learning to Higher Education (2015). His research is now based on nearly 1200 meta-analyses – up from the 800 when Visible Learning came out in 2009. According to Hattie the story underlying the data has hardly changed over time even though some effect sizes were updated and we have some new entries at the top, at the middle, and at the end of the list.
Below you can find an updated version of our first, second and third visualization of effect sizes related to student achievement.
Rank | Influence | Effect size d (Dec 2017) | Effect size d (Aug 2017) | Subdomain | Domain |
---|---|---|---|---|---|
1 | Collective teacher efficacy | 1.57 | 1.57 | Leadership | SCHOOL |
2 | Self-reported grades | 1.33 | 1.33 | Prior knowledge and background | STUDENT |
3 | Teacher estimates of achievement | 1.29 | 1.62 | Teacher attributes | TEACHER |
4 | Cognitive task analysis | 1.29 | 1.29 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
5 | Response to intervention | 1.29 | 1.29 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
6 | Piagetian programs | 1.28 | 1.28 | Prior knowledge and background | STUDENT |
7 | Jigsaw method | 1.2 | 1.2 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
8 | Conceptual change programs | 0.99 | 0.99 | Other curricula programs | CURRICULA |
9 | Prior ability | 0.94 | 0.94 | Prior knowledge and background | STUDENT |
10 | Strategy to integrate with prior knowledge | 0.93 | 0.93 | Learning strategies | TEACHING: Focus on student learning strategies |
11 | Self-efficacy | 0.92 | 0.92 | Beliefs, attitudes and dispositions | STUDENT |
12 | Teacher credibility | 0.9 | 0.9 | Teacher attributes | TEACHER |
13 | Micro-teaching/video review of lessons | 0.88 | 0.88 | Teacher education | TEACHER |
14 | Transfer strategies | 0.86 | 0.86 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
15 | Classroom discussion | 0.82 | 0.82 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
16 | Scaffolding | 0.82 | 0.82 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
17 | Deliberate practice | 0.79 | 0.82 | Learning strategies | TEACHING: Focus on student learning strategies |
18 | Summarization | 0.79 | 0.79 | Learning strategies | TEACHING: Focus on student learning strategies |
19 | Effort | 0.77 | 0.79 | Learning strategies | TEACHING: Focus on student learning strategies |
20 | Interventions for students with learning needs | 0.77 | 0.77 | Implementations that emphasize school-wide teaching strategies | TEACHING: Focus on implementation method |
21 | Mnemonics | 0.76 | 0.77 | Learning strategies | TEACHING: Focus on student learning strategies |
22 | Planning and prediction | 0.76 | 0.76 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
23 | Repeated reading programs | 0.75 | 0.76 | Reading, writing and the arts | CURRICULA |
24 | Teacher clarity | 0.75 | 0.75 | Teacher attributes | TEACHER |
25 | Elaboration and organization | 0.75 | 0.75 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
26 | Evaluation and reflection | 0.75 | 0.75 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
27 | Reciprocal teaching | 0.74 | 0.75 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
28 | Rehearsal and memorization | 0.73 | 0.74 | Learning strategies | TEACHING: Focus on student learning strategies |
29 | Comprehensive instructional programs for teachers | 0.72 | 0.73 | Reading, writing and the arts | CURRICULA |
30 | Help seeking | 0.72 | 0.83 & 0.60 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
31 | Phonics instruction | 0.7 | 0.7 | Reading, writing and the arts | CURRICULA |
32 | Feedback | 0.7 | 0.7 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
33 | Deep motivation and approach | 0.69 | 0.69 | Motivational approach, orientation | STUDENT |
34 | Field independence | 0.68 | 0.68 | Prior knowledge and background | STUDENT |
35 | Acceleration programs | 0.68 | 0.68 | School curricula for gifted students | CLASSROOM |
36 | Learning goals vs. no goals | 0.68 | 0.68 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
37 | Problem-solving teaching | 0.68 | 0.68 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
38 | Outlining and transforming | 0.66 | 0.66 | Learning strategies | TEACHING: Focus on student learning strategies |
39 | Concept mapping | 0.64 | 0.64 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
40 | Vocabulary programs | 0.62 | 0.62 | Reading, writing and the arts | CURRICULA |
41 | Creativity programs | 0.62 | 0.62 | Other curricula programs | CURRICULA |
42 | Behavioral intervention programs | 0.62 | 0.62 | Classroom influences | CLASSROOM |
43 | Setting standards for self-judgement | 0.62 | 0.62 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
44 | Teachers not labeling students | 0.61 | 0.61 | Teacher-student interactions | TEACHER |
45 | Relations of high school to university achievement | 0.6 | 0.6 | Prior knowledge and background | STUDENT |
46 | Meta-cognitive strategies | 0.6 | 0.6 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
47 | Spaced vs. mass practice | 0.6 | 0.6 | Learning strategies | TEACHING: Focus on student learning strategies |
48 | Direct instruction | 0.6 | 0.6 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
49 | Mathematics programs | 0.59 | 0.59 | Math and sciences | CURRICULA |
50 | Appropriately challenging goals | 0.59 | 0.59 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
51 | Spelling programs | 0.58 | 0.58 | Reading, writing and the arts | CURRICULA |
52 | Tactile stimulation programs | 0.58 | 0.58 | Other curricula programs | CURRICULA |
53 | Strategy monitoring | 0.58 | 0.58 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
54 | Service learning | 0.58 | 0.58 | Implementations using out-of-school learning | TEACHING: Focus on implementation method |
55 | Working memory strength | 0.57 | 0.57 | Prior knowledge and background | STUDENT |
56 | Full compared to pre-term/low birth weight | 0.57 | 0.57 | Physical influences | STUDENT |
57 | Mastery learning | 0.57 | 0.57 | Strategies emphasizing success criteria | TEACHING: Focus on teaching/instructional strategies |
58 | Explicit teaching strategies | 0.57 | 0.57 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
59 | Technology with learning needs students | 0.57 | 0.57 | Implementations using technologies | TEACHING: Focus on implementation method |
60 | Concentration/persistence/ engagement | 0.56 | 0.56 | Beliefs, attitudes and dispositions | STUDENT |
61 | Prior achievement | 0.55 | 0.55 | Prior knowledge and background | STUDENT |
62 | Visual-perception programs | 0.55 | 0.55 | Reading, writing and the arts | CURRICULA |
63 | Self-verbalization and self-questioning | 0.55 | 0.55 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
64 | Cooperative vs. individualistic learning | 0.55 | 0.55 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
65 | Technology in other subjects | 0.55 | 0.55 | Implementations using technologies | TEACHING: Focus on implementation method |
66 | Practice testing | 0.54 | 0.54 | Learning strategies | TEACHING: Focus on student learning strategies |
67 | Interactive video methods | 0.54 | 0.54 | Implementations using technologies | TEACHING: Focus on implementation method |
68 | Second/third chance programs | 0.53 | 0.53 | Reading, writing and the arts | CURRICULA |
69 | Enrichment programs | 0.53 | 0.53 | School curricula for gifted students | CLASSROOM |
70 | Positive peer influences | 0.53 | 0.53 | Classroom influences | CLASSROOM |
71 | Peer tutoring | 0.53 | 0.53 | Strategies emphasizing student perspectives in learning | TEACHING: Focus on student learning strategies |
72 | Cooperative vs. competitive learning | 0.53 | 0.53 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
73 | Positive family/home dynamics | 0.52 | 0.52 | Home environment | HOME |
74 | Socio-economic status | 0.52 | 0.52 | Family resources | HOME |
75 | Teacher-student relationships | 0.52 | 0.52 | Teacher-student interactions | TEACHER |
76 | Self-regulation strategies | 0.52 | 0.52 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
77 | Record keeping | 0.52 | 0.52 | Learning strategies | TEACHING: Focus on student learning strategies |
78 | Play programs | 0.5 | Other curricula programs | CURRICULA | |
79 | Parental involvement | 0.5 | 0.5 | Home environment | HOME |
80 | Student rating of quality of teaching | 0.5 | 0.5 | Teacher-student interactions | TEACHER |
81 | Note taking | 0.5 | 0.5 | Learning strategies | TEACHING: Focus on student learning strategies |
82 | Underlining and highlighting | 0.5 | 0.5 | Learning strategies | TEACHING: Focus on student learning strategies |
83 | Time on task | 0.49 | 0.49 | Learning strategies | TEACHING: Focus on student learning strategies |
84 | Science programs | 0.48 | 0.48 | Math and sciences | CURRICULA |
85 | Generalized school effects | 0.48 | 0.48 | Other school factors | SCHOOL |
86 | Clear goal intentions | 0.48 | 0.48 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
87 | Providing formative evaluation | 0.48 | 0.48 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
88 | Questioning | 0.48 | 0.48 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
89 | Intelligent tutoring systems | 0.48 | 0.48 | Implementations using technologies | TEACHING: Focus on implementation method |
90 | Comprehension programs | 0.47 | 0.47 | Reading, writing and the arts | CURRICULA |
91 | Integrated curricula programs | 0.47 | 0.47 | Other curricula programs | CURRICULA |
92 | Small group learning | 0.47 | 0.47 | Classroom composition effects | CLASSROOM |
93 | Information communications technology (ICT) | 0.47 | 0.47 | Implementations using technologies | TEACHING: Focus on implementation method |
94 | Perceived task value | 0.46 | 0.46 | Beliefs, attitudes and dispositions | STUDENT |
95 | Study skills | 0.46 | 0.46 | Learning strategies | TEACHING: Focus on student learning strategies |
96 | Relative age within a class | 0.45 | 0.45 | Physical influences | STUDENT |
97 | Writing programs | 0.45 | 0.45 | Reading, writing and the arts | CURRICULA |
98 | Imagery | 0.45 | 0.45 | Learning strategies | TEACHING: Focus on student learning strategies |
99 | Achieving motivation and approach | 0.44 | 0.44 | Motivational approach, orientation | STUDENT |
100 | Early years’ interventions | 0.44 | 0.44+0.29+0.27 | Home environment | HOME |
101 | Strong classroom cohesion | 0.44 | 0.44 | Classroom influences | CLASSROOM |
102 | Inductive teaching | 0.44 | 0.44 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
103 | Technology with elementary students | 0.44 | 0.44 | Implementations using technologies | TEACHING: Focus on implementation method |
104 | Exposure to reading | 0.43 | 0.43 | Reading, writing and the arts | CURRICULA |
105 | Outdoor/adventure programs | 0.43 | 0.43 | Other curricula programs | CURRICULA |
106 | School size (600-900 students at secondary) | 0.43 | 0.43 | School compositional effects | SCHOOL |
107 | Teacher expectations | 0.43 | 0.43 | Teacher attributes | TEACHER |
108 | Philosophy in schools | 0.43 | 0.43 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
109 | Teaching communication skills and strategies | 0.43 | 0.43 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
110 | Motivation | 0.42 | 0.42 | Motivational approach, orientation | STUDENT |
111 | Reducing anxiety | 0.42 | 0.42 | Motivational approach, orientation | STUDENT |
112 | Elaborative interrogation | 0.42 | 0.42 | Strategies emphasizing student meta-cognitive/ self-regulated learning | TEACHING: Focus on student learning strategies |
113 | Behavioral organizers | 0.42 | 0.42 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
114 | Technology in writing | 0.42 | 0.42 | Implementations using technologies | TEACHING: Focus on implementation method |
115 | Technology with college students | 0.42 | 0.42 | Implementations using technologies | TEACHING: Focus on implementation method |
116 | Positive self-concept | 0.41 | 0.41 | Beliefs, attitudes and dispositions | STUDENT |
117 | Professional development programs | 0.41 | 0.41 | Teacher education | TEACHER |
118 | Relating creativity to achievement | 0.4 | 0.4 | Prior knowledge and background | STUDENT |
119 | Goal commitment | 0.4 | 0.4 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
120 | Cooperative learning | 0.4 | 0.4 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
121 | Inquiry-based teaching | 0.4 | 0.4 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
122 | After-school programs | 0.4 | 0.4 | Implementations using out-of-school learning | TEACHING: Focus on implementation method |
123 | Social skills programs | 0.39 | 0.39 | Other curricula programs | CURRICULA |
124 | Relations of high school achievement to career performance | 0.38 | 0.38 | Prior knowledge and background | STUDENT |
125 | Drama/arts programs | 0.38 | 0.38 | Reading, writing and the arts | CURRICULA |
126 | Career interventions | 0.38 | 0.38 | Other curricula programs | CURRICULA |
127 | Music programs | 0.37 | 0.37 | Reading, writing and the arts | CURRICULA |
128 | Worked examples | 0.37 | 0.37 | Strategies emphasizing success criteria | TEACHING: Focus on teaching/instructional strategies |
129 | Mobile phones | 0.37 | 0.37 | Implementations using technologies | TEACHING: Focus on implementation method |
130 | Bilingual programs | 0.36 | 0.36 | Other curricula programs | CURRICULA |
131 | Student-centered teaching | 0.36 | 0.36 | Student-focused interventions | TEACHING: Focus on student learning strategies |
132 | Attitude to content domains | 0.35 | 0.35 | Beliefs, attitudes and dispositions | STUDENT |
133 | Counseling effects | 0.35 | 0.35 | Other school factors | SCHOOL |
134 | Classroom management | 0.35 | 0.35 | Classroom influences | CLASSROOM |
135 | Gaming/simulations | 0.35 | 0.35 | Implementations using technologies | TEACHING: Focus on implementation method |
136 | Chess instruction | 0.34 | 0.34 | Other curricula programs | CURRICULA |
137 | Motivation/character programs | 0.34 | 0.34 | Other curricula programs | CURRICULA |
138 | Decreasing disruptive behavior | 0.34 | 0.34 | Classroom influences | CLASSROOM |
139 | Collaborative learning | 0.34 | 0.34 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
140 | Teaching creative thinking | 0.34 | 0.34 | Implementations that emphasize school-wide teaching strategies | TEACHING: Focus on implementation method |
141 | Stereotype threat | 0.33 | 0.33 | Beliefs, attitudes and dispositions | STUDENT |
142 | Technology in mathematics | 0.33 | 0.33 | Implementations using technologies | TEACHING: Focus on implementation method |
143 | ADHD – treatment with drugs | 0.32 | 0.32 | Physical influences | STUDENT |
144 | Principals/school leaders | 0.32 | 0.32 | Leadership | SCHOOL |
145 | School climate | 0.32 | 0.32 | Leadership | SCHOOL |
146 | Average teacher effects | 0.32 | 0.32 | Teacher attributes | TEACHER |
147 | Adjunct aids | 0.32 | 0.32 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
148 | External accountability systems | 0.31 | 0.31 | School resourcing | SCHOOL |
149 | Matching style of learning | 0.31 | 0.31 | Student-focused interventions | TEACHING: Focus on student learning strategies |
150 | Manipulative materials on math | 0.3 | 0.3 | Math and sciences | CURRICULA |
151 | Ability grouping for gifted students | 0.3 | 0.3 | School curricula for gifted students | CLASSROOM |
152 | Teaching test taking and coaching | 0.3 | 0.3 | Learning strategies | TEACHING: Focus on student learning strategies |
153 | Technology with high school students | 0.3 | 0.3 | Implementations using technologies | TEACHING: Focus on implementation method |
154 | Mindfulness | 0.29 | 0.29 | Beliefs, attitudes and dispositions | STUDENT |
155 | Home visiting | 0.29 | 0.29 | Home environment | HOME |
156 | Cognitive behavioral programs | 0.29 | 0.29 | Classroom influences | CLASSROOM |
157 | Online and digital tools | 0.29 | 0.29 | Implementations using technologies | TEACHING: Focus on implementation method |
158 | Technology in reading/literacy | 0.29 | 0.29 | Implementations using technologies | TEACHING: Focus on implementation method |
159 | Homework | 0.29 | 0.29 | Implementations using out-of-school learning | TEACHING: Focus on implementation method |
160 | Desegregation | 0.28 | 0.28 | School compositional effects | SCHOOL |
161 | Pre-school programs | 0.28 | 0.26 | Other school factors | SCHOOL |
162 | Whole-school improvement programs | 0.28 | 0.28 | Implementations that emphasize school-wide teaching strategies | TEACHING: Focus on implementation method |
163 | Use of calculators | 0.27 | 0.27 | Math and sciences | CURRICULA |
164 | Mainstreaming/inclusion | 0.27 | 0.27 | Classroom composition effects | CLASSROOM |
165 | Student personality attributes | 0.26 | 0.26 | Beliefs, attitudes and dispositions | STUDENT |
166 | Exercise/relaxation | 0.26 | 0.26 | Physical influences | STUDENT |
167 | Lack of illness | 0.26 | 0.26 | Physical influences | STUDENT |
168 | Out-of-school curricula experiences | 0.26 | 0.26 | School compositional effects | SCHOOL |
169 | Volunteer tutors | 0.26 | 0.26 | Strategies emphasizing student perspectives in learning | TEACHING: Focus on student learning strategies |
170 | Problem-based learning | 0.26 | 0.26 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
171 | Use of PowerPoint | 0.26 | 0.26 | Implementations using technologies | TEACHING: Focus on implementation method |
172 | Grit/incremental vs. entity thinking | 0.25 | 0.25 | Beliefs, attitudes and dispositions | STUDENT |
173 | Adopted vs non-adopted care | 0.25 | 0.25 | Family structure | HOME |
174 | Religious schools | 0.24 | 0.24 | Types of school | SCHOOL |
175 | Competitive vs. individualistic learning | 0.24 | 0.24 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
176 | Intact (two-parent) families | 0.23 | 0.23 | Family structure | HOME |
177 | Summer school | 0.23 | 0.23 | Types of school | SCHOOL |
178 | Teacher personality attributes | 0.23 | 0.23 | Teacher attributes | TEACHER |
179 | Individualized instruction | 0.23 | 0.23 | Student-focused interventions | TEACHING: Focus on student learning strategies |
180 | Programmed instruction | 0.23 | 0.23 | Implementations using technologies | TEACHING: Focus on implementation method |
181 | Technology in science | 0.23 | 0.23 | Implementations using technologies | TEACHING: Focus on implementation method |
182 | Teacher verbal ability | 0.22 | 0.22 | Teacher attributes | TEACHER |
183 | Clickers | 0.22 | 0.22 | Implementations using technologies | TEACHING: Focus on implementation method |
184 | Visual/audio-visual methods | 0.22 | 0.22 | Implementations using technologies | TEACHING: Focus on implementation method |
185 | Finances | 0.21 | 0.21 | School resourcing | SCHOOL |
186 | Reducing class size | 0.21 | 0.21 | Classroom composition effects | CLASSROOM |
187 | Interleaved practice | 0.21 | 0.21 | Learning strategies | TEACHING: Focus on student learning strategies |
188 | Discovery-based teaching | 0.21 | 0.21 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
189 | Technology in small groups | 0.21 | 0.21 | Implementations using technologies | TEACHING: Focus on implementation method |
190 | Student support programs – college | 0.21 | 0.21 | Implementations that emphasize school-wide teaching strategies | TEACHING: Focus on implementation method |
191 | Extra-curricula programs | 0.2 | 0.2 | Other curricula programs | CURRICULA |
192 | Engaged vs disengaged fathers | 0.2 | 0.2 | Family structure | HOME |
193 | Aptitude/treatment interactions | 0.19 | 0.19 | Student-focused interventions | TEACHING: Focus on student learning strategies |
194 | Learning hierarchies-based approach | 0.19 | 0.19 | Strategies emphasizing learning intentions | TEACHING: Focus on teaching/instructional strategies |
195 | Co- or team teaching | 0.19 | 0.19 | Implementations that emphasize school-wide teaching strategies | TEACHING: Focus on implementation method |
196 | Within class grouping | 0.18 | 0.18 | Classroom composition effects | CLASSROOM |
197 | Web-based learning | 0.18 | 0.18 | Implementations using technologies | TEACHING: Focus on implementation method |
198 | Lack of stress | 0.17 | 0.17 | Motivational approach, orientation | STUDENT |
199 | Other family structure | 0.16 | 0.16 | Family structure | HOME |
200 | One-on-one laptops | 0.16 | 0.16 | Implementations using technologies | TEACHING: Focus on implementation method |
201 | Home-school programs | 0.16 | 0.16 | Implementations using out-of-school learning | TEACHING: Focus on implementation method |
202 | Sentence combining programs | 0.15 | 0.15 | Reading, writing and the arts | CURRICULA |
203 | Parental autonomy support | 0.15 | 0.15 | Home environment | HOME |
204 | Distance education | 0.13 | 0.13 | Implementations using out-of-school learning | TEACHING: Focus on implementation method |
205 | Morning vs. evening | 0.12 | 0.12 | Beliefs, attitudes and dispositions | STUDENT |
206 | Positive ethnic self-identity | 0.12 | 0.12 | Beliefs, attitudes and dispositions | STUDENT |
207 | Juvenile delinquent programs | 0.12 | 0.12 | Other curricula programs | CURRICULA |
208 | School choice programs | 0.12 | 0.12 | School compositional effects | SCHOOL |
209 | Tracking/streaming | 0.12 | 0.12 | Classroom composition effects | CLASSROOM |
210 | Mentoring | 0.12 | 0.12 | Classroom influences | CLASSROOM |
211 | Initial teacher training programs | 0.12 | 0.12 | Teacher education | TEACHER |
212 | Different types of testing | 0.12 | 0.12 | Strategies emphasizing feedback | TEACHING: Focus on teaching/instructional strategies |
213 | Teacher subject matter knowledge | 0.11 | 0.11 | Teacher education | TEACHER |
214 | Diverse student body | 0.1 | 0.1 | School compositional effects | SCHOOL |
215 | Background music | 0.1 | 0.1 | Classroom influences | CLASSROOM |
216 | Diversity courses | 0.09 | 0.09 | Other curricula programs | CURRICULA |
217 | Charter schools | 0.09 | 0.09 | Types of school | SCHOOL |
218 | Modifying school calendars/timetables | 0.09 | 0.09 | Other school factors | SCHOOL |
219 | Detracking | 0.09 | 0.09 | Classroom composition effects | CLASSROOM |
220 | Gender on achievement | 0.08 | 0.08 | Physical influences | STUDENT |
221 | Perceptual-motor programs | 0.08 | 0.08 | Other curricula programs | CURRICULA |
222 | Single-sex schools | 0.08 | 0.08 | Types of school | SCHOOL |
223 | Middle schools’ interventions | 0.08 | 0.08 | School compositional effects | SCHOOL |
224 | Mastery goals | 0.06 | 0.06 | Motivational approach, orientation | STUDENT |
225 | Whole language approach | 0.06 | 0.06 | Reading, writing and the arts | CURRICULA |
226 | College halls of residence | 0.05 | 0.05 | School compositional effects | SCHOOL |
227 | Teacher performance pay | 0.05 | 0.05 | Teacher attributes | TEACHER |
228 | Breastfeeding | 0.04 | 0.04 | Physical influences | STUDENT |
229 | Multi-grade/age classes | 0.04 | 0.04 | Classroom composition effects | CLASSROOM |
230 | Humor | 0.04 | 0.04 | Teaching/instructional strategies | TEACHING: Focus on teaching/instructional strategies |
231 | Parental employment | 0.03 | 0.03 | Family resources | HOME |
232 | Student control over learning | 0.02 | 0.02 | Student-focused interventions | TEACHING: Focus on student learning strategies |
233 | Non-immigrant background | 0.01 | 0.01 | Family resources | HOME |
234 | Open vs. traditional classrooms | 0.01 | 0.01 | Classroom composition effects | CLASSROOM |
235 | Technology in distance education | 0.01 | 0.01 | Implementations using technologies | TEACHING: Focus on implementation method |
236 | Performance goals | -0.01 | -0.01 | Motivational approach, orientation | STUDENT |
237 | Summer vacation effect | -0.02 | -0.02 | Types of school | SCHOOL |
238 | Lack of sleep | -0.05 | -0.05 | Physical influences | STUDENT |
239 | Surface motivation and approach | -0.11 | -0.11 | Motivational approach, orientation | STUDENT |
240 | Family on welfare/state aid | -0.12 | -0.12 | Family resources | HOME |
241 | Parental military deployment | -0.16 | -0.16 | Home environment | HOME |
242 | Television | -0.18 | -0.18 | Home environment | HOME |
243 | Students feeling disliked | -0.19 | -0.19 | Classroom influences | CLASSROOM |
244 | Suspension/expelling students | -0.2 | -0.2 | Other school factors | SCHOOL |
245 | Non-standard dialect use | -0.29 | -0.29 | Prior knowledge and background | STUDENT |
246 | Retention (holding students back) | -0.32 | -0.32 | Classroom composition effects | CLASSROOM |
247 | Corporal punishment in the home | -0.33 | -0.33 | Home environment | HOME |
248 | Moving between schools | -0.34 | -0.34 | Home environment | HOME |
249 | Depression | -0.36 | -0.36 | Motivational approach, orientation | STUDENT |
250 | Boredom | -0.49 | -0.49 | Motivational approach, orientation | STUDENT |
251 | Deafness | -0.61 | -0.61 | Physical influences | STUDENT |
252 | ADHD | -0.9 | -0.9 | Physical influences | STUDENT |
- Backup: Our first visualization of the Hattie ranking (2009)
- Backup: Hattie Ranking: 195 Influences And Effect Sizes visualized (2015)
- Backup: Interactive comparison of Hattie rankings (2009, 2011, 2015)
- Backup: Hattie's list of 256 influences and effect sizes (2017)
Hi there – thanks for sharing the graphic – not sure if someone has already pointed out to you the error. You have “Classroom Behavioural” with an effect size of 0.8
I was looking for Classroom Discussion and assume you must have got those mixed up. Classroom Behavioural has an effect size of only 0.62.
Hope this helps with a revision of the graphic – cheers
Hi Tom,
Thanks for pointing that out! I double checked the issue with Hattie’s two books about “Visible Learning”.
The list I visualized for this website is related to Hattie (2009) Visible Learning.
Hattie constantly updates his list with more meta studies. I suggest that your comment relates to an updated list in Hattie (2011) Visible Learning for Teachers?
Cheers, Sebastian
Can someone help me please? I have seen many different tables of Hattie’s effect sizes and the order and effect size seems to differ quite significantly between them. Why is this? I am trying to use them for an evaluative model and I am confused as to which order and effect size I should use.
With thanks for any clarification you can offer.
Hi Clare,
As Hattie has updated the ranking in his newer books I would recommend to use the latest version of the list in “Visible Learning for Teachers” which cites over 900 meta studies.
Could you please explain the negative probabilities in the work that I’ve read about here:
https://ollieorange2.wordpress.com/2014/08/25/people-who-think-probabilities-can-be-negative-shouldnt-write-books-on-statistics/comment-page-1/#comment-545
Hello,
the CLE calculations have been wrong in earlier editions of Visibible Learning. The Common Language Effect Size (CLE) is a probability measure and by definition must be between 0% and 100%. This error has been corrected in newer editions and translations of the book. From the very beginning the story of Visible Learning is mainly based on the effect size (Cohen’s d) which are correct.
Here’s what John Hattie says about about it: “At the last minute in editing I substituted the wrong column of data into the CLE column and did not pick up this error; I regret this omission. In each subsequent edition the references to CLE and their estimates will be dropped – with no loss to the story.” http://leadershipacademy.wiki.inghamisd.org/file/view/Corrections%20in%20VL2.pdf/548965844/Corrections%20in%20VL2.pdf
That is not the main issue. The bigger problem is conceptual. For example, ‘instructional strategies’ is not a strategy … no more than vehicle is a specific vehicle. A child’s wagon, a wheelbarrow, a half ton truck, a five ton truck are vehicles. If we used ‘vehicles’ to move gravel from point A to point B … and we calculated an effect size on vehicles … we suffer from ‘regression towards the mean’; the child’s wagon will look more powerful than it is (a higher effect size) and the 5 ton truck will look worse (a lower effect size). The same issue is with Cooperative Learning. Cooperative learning is a label for a belief system about how students learn; it has approximately 200 group structures that go from simple to complex (Numbered Heads to Think Pair Share to Jigsaw to Group Investigation). To provide an effect size for cooperative learning is imprecise … same problem …. regression towards the mean.
Also, Concept Mapping (Joseph Novak’s work) is an example of an instructional strategy … he wisely does not provide an effect size for ‘graphic organizers’ — because graphic organizers is not a specific instructional method (that would included, flow charts, ranking ladders, Venn diagrams, Fishbone diagrams, Mind Maps and Concept Maps).
For a ‘drug’ example, imagine calculating the effect size for 10 mg, 50 mg., 100 mg., and 150 mg of that drug … then averaging them to tell people that this ‘pain medicine’ has an effect size of say .58. Clearly, that is imprecise. cheers, bbb
I am looking at this graph and am curious as to what age group this study was done on when it comes to education.
Dear Erica,
in an interview John Hattie explains: “I was interested in 4-20 year olds and for every influence was very keen to evaluate any moderators – but found very few indeed. The story underlying the data seems applicable to this age range.”
Best wishes,
Sebastian
http://visible-learning.org/2013/01/john-hattie-visible-learning-interview/
Very interesting looking at the things that you do in your classroom that you feel are really getting the ideas across well, and finding out that you may be missing a big chuck of your class just by the way you are presenting material to them!
Hi,
I’ve been reading a book called Spark, by John Ratey. In it, he argues that cardio exercise has a large influence on student success. Does anyone know where this might fit into Hattie’s effects, or any related studies?
I note that peer tutoring has a 0.55 effect but mentoring which Hattie states is a form of peer tutoring has a 0.15 effect. How can there be this level of difference? One could assume from this that mentoring is not a particularly worthwhile investment but there would be few people who have achieved eminence in their fields who were not heavily influenced by a mentor.
“Peer mentoring” is a specific kind of program. Likewise, I’m guessing Hattie’s “mentoring” isn’t what you have in mind. If you look at mentoring programs, it’s not like having a single brilliant individual who intimately guides you throughout a period of life. This is very hard to do well in the broader school system. You need way too many mentors to be practical, not to mention paying them and matching them up. Also, not all students respond well. Great people have generally relied on and responded to mentors in their development. But try fixing up a typical student with a typical mentor, and you’ll see it hard to predict the outcome.
Hello, I am about to buy the book but I wondered if someone could just quickly fill me in here on what statistic is being used to represent the effect size, e.g. r or r^2 or z? Thanks.
Hello Daniel,
Hattie uses Cohen’s d to represent the effect size. Cohen’s d is defined as the difference between two means divided by a standard deviation of the pooled groups or of the control group alone.
Cheers, Sebastian
So in a group with a large standard deviation (e.g wide range of abilities) the effect size for the same improvement in mean always looks smaller than a group with a smaller standard deviation (lower range of abilities)? Hardly seems a valid tool for comparison..
Hello Mark,
effect size d isn’t a perfect measure (that doesn’t exist) but it’s a good and practical approach to compare different sample sizes. Moreover, taking into account the standard deviation helps to better interpret mean differences. Taking your example of a large standard deviation before the intervention (e.g. wide range of abilities): imagine an intervention that results in only a small mean difference. Maybe your intervention has a large effect size d if you manage to bring the group of learners together and lower the standard deviation.
OK. I am not a statistician but I have some questions about Hattie’s explanation as to how publication bias does not affect his results. You can find the questions here:
https://sites.google.com/a/lsnepal.com/hattie-funnel-plot/
Hi Brad,
I found this paper with a more detailed funnel plot. It’s a follow-up on Hattie’s “reading methods”:
http://ivysherman.weebly.com/uploads/1/7/4/2/17421639/post_-_edd_1007_final_paper_pr.pdf
Comprehensive school entry screening is not specifically mentioned
by Prof. John Hattie. However certain elements are:
Feedback, Evaluation, Classroom Behaviour, Interventions for
the Learning Disabled, Prior Achievement, Home Environment, Early Intervention, Parent Involvement, Preterm Birth Weight, Reducing Anxiety, SES. But others are missing eg. The division of Behaviour into Internal and External, the effects of below average Speech-Language level, Resilience, etc.
The validity of the 20 years research on Parent, Teacher and Child-based school entry screening is contained in Reddington & Wheeldon (2009)which can be sent to Prof. Hattie (also presented at the International Conference on Applied Psychology, Paris, July, 2014).
Prof. Hattie’s hierarchies are an extremely helpful guide, and checklist, against which to compare the Parent, Teacher and Child based items of the school entry screening system.
I purchased the Visible Learning book and appreciate the ranking and effect sizes.
Although, there isnt a place anywhere in the book where the intervention labels are explained in detail.
For instance, what does Piagetian programs mean; what do creativity programs entail; how are repeated reading programs executed?
Is there a way I can find out more information on what the labels mean to John Hattie?
This might be of some help: http://visible-learning.org/glossary/#2_Piagetian_programs
The explanation in this link is backed up with another link – that second link is to an abstract about a study that compared Piagettian test with IQ tests so see was the better predictor of school performance. It is not very surprising that Piagetian tests were better predictors (since these correspond to school tasks more closely than those of IQ tests).
The main problem for me is that the study does not deal with ‘Piagetian programs’ (sic) just a test. I am struggling to find an endorsement of ‘Piagetian programs’, though I can find plenty of studies that points out gaps in Piaget’s approach – including Piaget’s own admission (late in life, but all the more creditworthy to acknowledge at that stage) that he was wrong about language being secondary to learning.
Where are these studies that show strong effect sizes for Piagetian programmes?
Hi Mr. Hattie,
How was your ranking calculated mathematically?
Do you use the data from visible learning to make your calculations?
Would you take video submissions to run through your visible learning process complete with transcripts and data analysis?
Is there a charge for visible learning?
How long does it take to get feedback?
I’m fascinated by the idea that you are quantifying teaching strategies and want to better understand the process.
Thanks,
Kendra Henry
Here are some thoughts on Hatties use of statistics mathematically http://literacyinleafstrewn.blogspot.no/2012/12/can-we-trust-educational-research_20.html
…and here https://ollieorange2.wordpress.com/2014/08/25/people-who-think-probabilities-can-be-negative-shouldnt-write-books-on-statistics/
Hello GL,
Thank you for the links discussing the issues related to Hattie’s use of CLE.
The CLE calculations have been wrong in earlier editions of Visible Learning. The Common Language Effect Size (CLE) is a probability measure and by definition must be between 0% and 100%. This error has been corrected in newer editions and translations of the book. From the very beginning the story of Visible Learning is mainly based on the effect size (Cohen’s d) which are correct.
Here’s what John Hattie says about about it: “At the last minute in editing I substituted the wrong column of data into the CLE column and did not pick up this error; I regret this omission. In each subsequent edition the references to CLE and their estimates will be dropped – with no loss to the story.” http://leadershipacademy.wiki.inghamisd.org/file/view/Corrections%20in%20VL2.pdf/548965844/Corrections%20in%20VL2.pdf
Best wishes, Sebastian
Dear Kendra,
For transcripts and data analysis you might check out the Visible Classroom project: http://visibleclassroom.com
For a better understanding of the process I would recommend reading the book “Visible Learning for Teachers”.
Best wishes, Sebastian
Hi Mr. Hattie,
Is it possible to get access to your powerpoint?
Thanks,
Kendra Henry
Is there an explanation, on your site, of the new top two effects? Teacher estimates of achievement and Collective Teacher Efficacy?
Well, I (stupidly) rented a Kindle version of the VL for Teachers that your link led me to on Amazon. I am trying to learn precisely what is meant by the new top two effects. I didn’t notice that it was the 2012 version, which I already own. (Old eyes shouldn’t buy books on a smartphone, I suppose.)
If the 2012 list was the Gold Standard of effect sizes, how is it that the 2015 list is topped by two brand-new effects?
Dear Chuck,
Thanks for your comment! I also think about these two brand new effects since I have visualized the new list. Unfortunately John Hattie gives little detail in his paper from 2015. I found this a short introduction video “Collective teacher efficacy” helpful: https://www.youtube.com/watch?v=FUfEWZGLFZE. And I think this is one of the meta-analysis Hattie relates to: Eels (2011): “Meta-Analysis of the Relationship Between Collective Teacher Efficacy and Student Achivement” http://ecommons.luc.edu/cgi/viewcontent.cgi?article=1132&context=luc_diss
Best regards, Sebastian
Sebastian
Question on one of the top effect sizes…
I looked up and read the dissertation by Jenni Anne Marie Donohoo on Collective Efficacy.
There is zero mention anywhere in the paper about any effect size over 0.63. Can you find out how Hattie (or anyone) got the 1.57 effect size on collective efficacy?
Thanks
It is great to be reading about research from the horses mouth and linking to the practices of our school which our strongly influenced by Hattie
I’m just wondering way diagnotic and remediation programs to overcome students’weaknesses on science concepts and other diciplines has not been included this review. I have working in this area since 1990. one of this work was appears in may Ph D thesis at Monash, 1990. ‘Remediation of weaknesses in physiscs concencepts’.
Regards
Did I miss ‘focus’? To those of us ‘on the front lines’ one of the most important variables in learning is Focus/lack thereof. Add the co-morbidity of anxiety and depression, it effects that student-teacher relationship, contributes to the lack of retention and big picture learning. Focus, and it’s deficit, will impact not only the student, but the home, the school, the curricula, the teacher, and learning approaches..sigh…
Thanks for the diagram Sebastian – what are these effects influencing specifically? It says “learning outcomes” at the start – is there anywhere that the specific learning outcomes are listed, along with how they are objectively measured?
Kind regards,
Kevin
Hi there!
What’s mean classroom behavior ? What’s the definition of this concept ?
I’m looking forward to see your explanation.
Have a good day!
Simon, I find a similar issue with the topics listed. In my field as a Behavior Analyst, the topography of behavior is important as an objective means to gather data. An unbiased observer should be able to collect data with specificity of the behavioral definition for valid data to be analyzed.
Rebekah
Is there somewhere where I can look to see just what topics are included under each heading for effect size? For instance, where would ‘memorization’ as an effect fall under?
I have been a Hattie follower since 2009 and really believe in his research. My question is, does anyone know why the 2015 list of 195 influences is not published in later books (i.e. Teaching Literacy in the VL Classroom, 2017)?
How can we get the 1400 meta-analyses list?
Hello !!! Where can I find the descriptions of all 195 influences with good and bad examples ?? So I can read about good parctrice and bad practice, something very practicle !!! Thx
I would recommend reading Hattie’s book “Visible Learning for Teachers”: https://www.amazon.ca/Visible-Learning-Teachers-John-Hattie/dp/0415690153
Hi there – very interested in all of this – however Differentiation, doesn’t seem to appear…..what am I missing here?
Thanks
Martin
I agreed with your opinion !!!
Differentiation is not a specific strategy–it is an application of strategies. Many of the specific strategies are examples that are used for differentiation.
A question about the effect of a larger, maybe more conceptual, item: academic standards. That doesn’t seem to be on the list, but “Teacher Efficacy,” “Teacher Credibility,” and “teacher Clarity” do appear. So should one assume that clear academic performance expectations are woven into other contributors/factors?
Also, “Subject Matter Knowledge” is rather low on the list – but I’ve read numerous articles/attended many conferences where they discuss the importance of teachers being subject matter experts
Thoughts?
What is number 141 (July 4, 1900)?
Thanks for pointing to this error. Number 141 is “stereotype threat”. I corrected the this.
The teaching and learning variables are numerous and often amazing! “Hats off to Hattie” for diving deep into what makes us all tick. The uniqueness of each student and all of the influences that abound in each student’s life is often overwhelming. Prayer and a conscientious professional learning committee (PLC) is a great place to start for the benefit of each student. I’m grateful for your help and perseverance to provide us with valuable research. I would like to see the old PTA (Parent & Teachers Association) revitalized. Active stakeholders are needed in the learning process in my view.
Hello: I am a reading consultant organizing a class for students reading two or more years below grade level. I believe the teaching of specific strategies: summarizing, main idea, theme, elements of a story, highlighting, skimming/scanning, are essential but I would like to see Haddie’s scale on the efficacy of teaching specific skills such as these to the middle schooler (ages 13-15, grades 7 and 8). Please advise as to where to find them (of course, I know where summarizing is on the scale..but others…)
I am working on my Masters of Education and am interested in including Hattie’s studies in my research. Can you tell me how come I can’t find this particular research in any peer reviewed journals?
I’d love to analyse his study and thoroughly read his methods for research. It seems suspicious that I can only view his study by purchasing his book.
I have been trying to find research on the effect size of two current trends in elementary classrooms: Flexible Seating and Blended Learning. Has Hattie, or anyone, gathered data on either of these?
What is meant by “gender on achievement”?
The effect of gender on the learning outcomes. (“Do boys learn less then girls?”)
I have tried reading on the mathematics of size effects, but I find it quite complicated. If the size effect of inductive teaching is 0,44 and the size effect of micro-teaching is 0,88, does it mean that micro-teaching is twice as effective as inductive teaching ? Is it a linear relation or something else ?
Thanks’ for your help.
Hi,
this is very interesting. Could you explain what is meant by collective teacher efficacy? What parameters went into this category?
Thank you very much.
Hi Klara, here is a short overview on CTE: https://visible-learning.org/2018/03/collective-teacher-efficacy-hattie/
I’m just wondering way diagnotic and remediation programs to overcome students’weaknesses on science concepts and other diciplines has not been included this review. I have working in this area since 1990. one of this work was appears in may Ph D thesis at Monash, 1990. ‘Remediation of weaknesses in physiscs concencepts’.