Table III.A4: Matching by Year (All Turnover)
Treated Comparison
Year Matched Unmatched Used Unused Bandwidth
Missouri
2001 331 1 1290 44 0.006
2002 322 6 1301 37 0.011
2003 331 4 1293 15 0.011
2004 314 4 1291 15 0.018
2005 321 1 1319 22 0.030
2006 343 5 1329 5 0.030
2007 327 6 1341 7 0.025
2008 372 4 1302 4 0.018
2009 277 2 1215 1 0.055
2010 308 14 1236 18 0.011
2011 285 7 1340 8 0.014
2012 345 4 1278 6 0.025
2013 354 7 1259 12 0.025
2014 262 8 1368 4 0.030
2015 343 9 1289 29 0.025
All 4835 82 19451 227 .
Tennessee
2007 208 5 1050 12 0.030
2008 235 3 1041 3 0.025
2009 211 9 1088 1 0.025
2010 197 5 1079 20 0.013
2011 235 6 1057 0 0.016
2012 252 1 1018 13 0.009
2013 221 1 1035 12 0.030
2014 236 5 1032 3 0.020
2015 217 7 1049 0 0.035
All 2012 42 9449 64 .
Notes: Kernel matching (epanechnikov) performed separately by year. Bandwidth chosen via cross-validation using the
“kmatch” package in Stata.
(a) Missouri
(b) Tennessee
Figure III.A11: Propensity Score Distribution (All Turnover)
Table III.A5: Covariate Balance (All Turnover)
Unmatched Matched
Treat Comp Std Diff Treat Comp Std Diff Missouri
Math (yeart) -0.077 0.111 -0.20 -0.050 -0.044 -0.01 Math (yeart−1) -0.041 0.117 -0.18 -0.018 -0.008 -0.01 Math (yeart−2) -0.020 0.124 -0.16 0.001 0.008 -0.01 Math (yeart−3) -0.010 0.125 -0.16 0.009 0.016 -0.01 Math (yeart−4) -0.007 0.126 -0.17 0.014 0.026 -0.02 Math (yeart−5) 0.015 0.119 -0.14 0.033 0.040 -0.01 ELA (yeart) -0.077 0.118 -0.22 -0.046 -0.041 -0.01 ELA (yeart−1) -0.041 0.120 -0.18 -0.015 -0.007 -0.01 ELA (yeart−2) -0.014 0.121 -0.16 0.009 0.018 -0.01 ELA (yeart−3) -0.014 0.123 -0.17 0.004 0.018 -0.02 ELA (yeart−4) -0.012 0.125 -0.18 0.009 0.018 -0.01 ELA (yeart−5) 0.004 0.119 -0.16 0.021 0.027 -0.01 Prin Transition (yeart−1) 0.131 0.179 -0.13 0.131 0.130 0.00 Prin Transition (yeart−2) 0.174 0.181 -0.02 0.174 0.174 0.00 Prin Transition (yeart−3) 0.192 0.168 0.06 0.190 0.190 0.00 Prin Transition (yeart−4) 0.170 0.167 0.01 0.170 0.166 0.01 Prin Transition (yeart−5) 0.180 0.162 0.05 0.180 0.176 0.01 Prop New Tch (yeart) 0.167 0.152 0.13 0.166 0.164 0.01 Prop New Tch (yeart−1) 0.168 0.153 0.13 0.167 0.166 0.01 Prop New Tch (yeart−2) 0.168 0.155 0.12 0.167 0.166 0.01 Prop New Tch (yeart−3) 0.171 0.157 0.12 0.170 0.170 0.00 Prop New Tch (yeart−4) 0.175 0.160 0.12 0.174 0.173 0.01 Prop New Tch (yeart−5) 0.181 0.167 0.09 0.180 0.180 0.00 Tennessee
Math (yeart) -0.073 0.082 -0.16 -0.052 -0.061 0.01 Math (yeart−1) -0.048 0.085 -0.14 -0.030 -0.043 0.01 Math (yeart−2) -0.029 0.087 -0.12 -0.015 -0.028 0.01 Math (yeart−3) -0.035 0.094 -0.14 -0.016 -0.038 0.02 Math (yeart−4) 0.009 0.090 -0.09 0.031 0.016 0.02 Math (yeart−5) 0.020 0.095 -0.08 0.036 0.023 0.01 ELA (yeart) -0.077 0.082 -0.17 -0.052 -0.061 0.01 ELA (yeart−1) -0.043 0.086 -0.14 -0.025 -0.034 0.01 ELA (yeart−2) -0.025 0.091 -0.12 -0.006 -0.018 0.01 ELA (yeart−3) -0.023 0.102 -0.13 -0.002 -0.013 0.01 ELA (yeart−4) 0.011 0.108 -0.10 0.035 0.025 0.01 ELA (yeart−5) 0.021 0.119 -0.11 0.039 0.023 0.02 Prin Transition (yeart−1) 0.117 0.177 -0.17 0.117 0.121 -0.01 Prin Transition (yeart−2) 0.155 0.174 -0.05 0.156 0.163 -0.02 Prin Transition (yeart−3) 0.173 0.167 0.02 0.171 0.170 0.00 Prin Transition (yeart−4) 0.160 0.161 -0.00 0.161 0.160 0.00 Prin Transition (yeart−5) 0.168 0.153 0.04 0.168 0.169 -0.00 Prop New Tch (yeart) 0.158 0.149 0.10 0.157 0.158 -0.01 Prop New Tch (yeart−1) 0.152 0.148 0.05 0.151 0.152 -0.01 Prop New Tch (yeart−2) 0.158 0.147 0.12 0.156 0.155 0.00 Prop New Tch (yeart−3) 0.159 0.152 0.07 0.158 0.158 0.01 Prop New Tch (yeart−4) 0.165 0.157 0.07 0.164 0.164 -0.00 Prop New Tch (yeart−5) 0.259 0.260 -0.01 0.256 0.258 -0.00 Notes: “Treat” are schools who did not change principals in yeartand “Comp” are comparison schools who did not change principals in yeart. “Std Diff” refers to the standardized difference between treatment and comparison schools, which compares the difference in means in units of the pooled standard deviation.
Table III.A6: Matching by Year (Transfers)
Treated Comparison
Year Matched Unmatched Used Unused Bandwidth
Missouri
2001 102 1 1332 2 0.020
2002 80 4 1333 5 0.025
2003 92 2 1302 6 0.025
2004 68 6 1282 24 0.014
2005 88 3 1340 1 0.050
2006 94 4 1325 9 0.009
2007 91 3 1345 3 0.035
2008 99 3 1305 1 0.070
2009 65 8 1215 1 0.040
2010 82 5 1252 2 0.055
2011 78 3 1347 1 0.030
2012 91 11 1283 1 0.030
2013 89 8 1263 8 0.017
2014 71 4 1372 0 0.070
2015 86 14 1314 4 0.011
All 1276 79 19610 68 .
Tennessee
2007 43 4 1032 30 0.009
2008 50 4 1017 27 0.007
2009 46 3 1069 2 0.030
2010 44 3 1013 1 0.019
2011 52 3 1043 0 0.055
2012 63 3 1030 1 0.045
2013 54 3 1031 0 0.050
2014 39 4 998 1 0.055
2015 52 1 1027 1 0.080
All 443 28 9260 63 .
Notes: Kernel matching (epanechnikov) performed separately by year. Bandwidth chosen via cross-validation using the
“kmatch” package in Stata.
(a) Missouri
(b) Tennessee
Figure III.A12: Propensity Score Distribution (Transfers)
Table III.A7: Covariate Balance (Transfers)
Unmatched Matched
Treat Comp Std Diff Treat Comp Std Diff Missouri
Math (yeart) -0.022 0.111 -0.14 0.024 0.038 -0.01 Math (yeart−1) 0.018 0.117 -0.11 0.057 0.069 -0.01 Math (yeart−2) 0.022 0.124 -0.12 0.067 0.079 -0.01 Math (yeart−3) 0.033 0.125 -0.11 0.069 0.080 -0.01 Math (yeart−4) 0.035 0.126 -0.12 0.055 0.068 -0.02 Math (yeart−5) 0.047 0.119 -0.10 0.068 0.077 -0.01
ELA (yeart) -0.048 0.118 -0.18 0.004 0.006 -0.00
ELA (yeart−1) -0.017 0.120 -0.16 0.031 0.032 -0.00 ELA (yeart−2) -0.016 0.121 -0.16 0.032 0.049 -0.02 ELA (yeart−3) 0.014 0.123 -0.13 0.058 0.065 -0.01 ELA (yeart−4) -0.008 0.125 -0.17 0.020 0.028 -0.01 ELA (yeart−5) 0.002 0.119 -0.16 0.028 0.036 -0.01 Prin Transition (yeart−1) 0.160 0.179 -0.05 0.160 0.161 -0.00 Prin Transition (yeart−2) 0.216 0.181 0.09 0.215 0.209 0.01 Prin Transition (yeart−3) 0.228 0.168 0.15 0.226 0.220 0.01 Prin Transition (yeart−4) 0.190 0.167 0.06 0.193 0.185 0.02 Prin Transition (yeart−5) 0.201 0.162 0.10 0.206 0.198 0.02 Prop New Tch (yeart) 0.173 0.152 0.18 0.168 0.170 -0.01 Prop New Tch (yeart−1) 0.175 0.153 0.18 0.170 0.171 -0.01 Prop New Tch (yeart−2) 0.177 0.155 0.19 0.172 0.174 -0.02 Prop New Tch (yeart−3) 0.178 0.157 0.17 0.176 0.172 0.02 Prop New Tch (yeart−4) 0.184 0.160 0.18 0.179 0.177 0.01 Prop New Tch (yeart−5) 0.191 0.167 0.16 0.188 0.186 0.01 Tennessee
Math (yeart) -0.090 0.085 -0.18 -0.065 -0.058 -0.01 Math (yeart−1) -0.049 0.087 -0.14 -0.028 -0.027 -0.00 Math (yeart−2) -0.041 0.090 -0.14 -0.041 -0.015 -0.03 Math (yeart−3) -0.085 0.099 -0.20 -0.080 -0.053 -0.03 Math (yeart−4) -0.080 0.094 -0.19 -0.053 -0.015 -0.04 Math (yeart−5) -0.044 0.099 -0.16 -0.042 -0.018 -0.03 ELA (yeart) -0.154 0.085 -0.25 -0.112 -0.099 -0.01 ELA (yeart−1) -0.108 0.087 -0.20 -0.089 -0.072 -0.02 ELA (yeart−2) -0.079 0.094 -0.18 -0.074 -0.039 -0.04 ELA (yeart−3) -0.058 0.107 -0.17 -0.052 -0.004 -0.05 ELA (yeart−4) -0.065 0.111 -0.19 -0.041 0.001 -0.04 ELA (yeart−5) -0.071 0.123 -0.21 -0.060 -0.015 -0.05 Prin Transition (yeart−1) 0.144 0.177 -0.09 0.147 0.159 -0.04 Prin Transition (yeart−2) 0.191 0.171 0.05 0.196 0.192 0.01 Prin Transition (yeart−3) 0.221 0.166 0.14 0.217 0.201 0.04 Prin Transition (yeart−4) 0.210 0.159 0.13 0.199 0.202 -0.01 Prin Transition (yeart−5) 0.185 0.152 0.09 0.181 0.188 -0.02 Prop New Tch (yeart) 0.174 0.149 0.25 0.170 0.173 -0.03 Prop New Tch (yeart−1) 0.158 0.147 0.11 0.158 0.158 0.01 Prop New Tch (yeart−2) 0.166 0.147 0.19 0.164 0.161 0.03 Prop New Tch (yeart−3) 0.172 0.152 0.19 0.167 0.168 -0.00 Prop New Tch (yeart−4) 0.174 0.156 0.17 0.171 0.172 -0.01 Prop New Tch (yeart−5) 0.265 0.261 0.01 0.259 0.265 -0.02 Notes: “Treat” are schools who did not change principals in yeartand “Comp” are comparison schools who did not change principals in yeart. “Std Diff” refers to the standardized difference between treatment and comparison schools, which compares the difference in means in units of the pooled standard deviation.
Table III.A8: Matching by Year (Exits)
Treated Comparison
Year Matched Unmatched Used Unused Bandwidth
Missouri
2001 122 0 1332 2 0.035
2002 129 6 1180 158 0.005
2003 123 2 1307 1 0.030
2004 138 1 1306 0 0.055
2005 113 5 1276 65 0.006
2006 113 9 1292 42 0.013
2007 109 6 1344 4 0.016
2008 169 1 1305 1 0.035
2009 124 4 1208 8 0.015
2010 119 14 1251 3 0.025
2011 104 5 1317 31 0.013
2012 146 1 1283 1 0.035
2013 141 5 1270 1 0.035
2014 93 3 1371 1 0.017
2015 117 5 1314 4 0.030
All 1860 67 19356 322 .
Tennessee
2007 90 1 1013 49 0.005
2008 91 4 1042 2 0.030
2009 91 2 1087 2 0.045
2010 87 2 1066 9 0.009
2011 101 1 1047 2 0.055
2012 108 0 1030 1 0.035
2013 82 3 1028 2 0.040
2014 106 1 1023 2 0.017
2015 90 4 1034 1 0.050
All 846 18 9370 70 .
Notes: Kernel matching (epanechnikov) performed separately by year. Bandwidth chosen via cross-validation using the
“kmatch” package in Stata.
(a) Missouri
(b) Tennessee
Figure III.A13: Propensity Score Distribution (Exits)
Table III.A9: Covariate Balance (Exits)
Unmatched Matched
Treat Comp Std Diff Treat Comp Std Diff Missouri
Math (yeart) -0.145 0.111 -0.27 -0.087 -0.094 0.01 Math (yeart−1) -0.106 0.117 -0.24 -0.054 -0.064 0.01 Math (yeart−2) -0.082 0.124 -0.22 -0.031 -0.041 0.01 Math (yeart−3) -0.066 0.125 -0.22 -0.016 -0.023 0.01 Math (yeart−4) -0.051 0.126 -0.21 -0.002 -0.005 0.00 Math (yeart−5) -0.028 0.119 -0.19 0.016 0.003 0.02 ELA (yeart) -0.144 0.118 -0.28 -0.076 -0.091 0.02 ELA (yeart−1) -0.100 0.120 -0.24 -0.047 -0.060 0.01 ELA (yeart−2) -0.059 0.121 -0.20 -0.012 -0.016 0.01 ELA (yeart−3) -0.058 0.123 -0.21 -0.015 -0.029 0.02 ELA (yeart−4) -0.053 0.125 -0.22 -0.000 -0.015 0.02 ELA (yeart−5) -0.026 0.119 -0.19 0.015 0.009 0.01 Prin Transition (yeart−1) 0.103 0.179 -0.22 0.099 0.106 -0.02 Prin Transition (yeart−2) 0.135 0.181 -0.13 0.135 0.139 -0.01 Prin Transition (yeart−3) 0.155 0.168 -0.04 0.151 0.149 0.01 Prin Transition (yeart−4) 0.147 0.167 -0.06 0.146 0.144 0.01 Prin Transition (yeart−5) 0.154 0.162 -0.02 0.154 0.155 -0.00 Prop New Tch (yeart) 0.163 0.152 0.10 0.161 0.161 -0.00 Prop New Tch (yeart−1) 0.164 0.153 0.09 0.162 0.162 0.00 Prop New Tch (yeart−2) 0.162 0.155 0.06 0.160 0.161 -0.00 Prop New Tch (yeart−3) 0.166 0.157 0.07 0.164 0.164 0.00 Prop New Tch (yeart−4) 0.170 0.160 0.08 0.168 0.168 -0.00 Prop New Tch (yeart−5) 0.175 0.167 0.05 0.173 0.173 0.01 Tennessee
Math (yeart) -0.048 0.084 -0.14 -0.041 -0.046 0.01 Math (yeart−1) -0.031 0.087 -0.12 -0.022 -0.048 0.03 Math (yeart−2) -0.018 0.090 -0.12 -0.011 -0.020 0.01 Math (yeart−3) -0.019 0.098 -0.12 -0.011 -0.045 0.03 Math (yeart−4) 0.012 0.093 -0.09 0.026 -0.017 0.05 Math (yeart−5) 0.015 0.099 -0.09 0.034 -0.024 0.06 ELA (yeart) -0.027 0.084 -0.11 -0.017 -0.032 0.02 ELA (yeart−1) -0.005 0.088 -0.09 0.003 -0.012 0.02 ELA (yeart−2) 0.002 0.094 -0.10 0.013 0.000 0.01 ELA (yeart−3) 0.000 0.106 -0.11 0.012 -0.001 0.01 ELA (yeart−4) 0.042 0.111 -0.07 0.064 0.023 0.04 ELA (yeart−5) 0.043 0.122 -0.08 0.065 -0.001 0.07 Prin Transition (yeart−1) 0.072 0.176 -0.32 0.073 0.081 -0.03 Prin Transition (yeart−2) 0.110 0.173 -0.18 0.111 0.118 -0.02 Prin Transition (yeart−3) 0.130 0.167 -0.10 0.126 0.128 -0.01 Prin Transition (yeart−4) 0.127 0.161 -0.10 0.125 0.140 -0.04 Prin Transition (yeart−5) 0.139 0.153 -0.04 0.138 0.139 -0.00 Prop New Tch (yeart) 0.154 0.149 0.05 0.153 0.156 -0.02 Prop New Tch (yeart−1) 0.151 0.148 0.03 0.149 0.152 -0.03 Prop New Tch (yeart−2) 0.154 0.147 0.07 0.150 0.151 -0.02 Prop New Tch (yeart−3) 0.156 0.152 0.04 0.154 0.157 -0.03 Prop New Tch (yeart−4) 0.159 0.157 0.02 0.157 0.161 -0.03 Prop New Tch (yeart−5) 0.262 0.261 0.00 0.260 0.264 -0.01 Notes: “Treat” are schools who did not change principals in yeartand “Comp” are comparison schools who did not change principals in yeart. “Std Diff” refers to the standardized difference between treatment and comparison schools, which compares the difference in means in units of the pooled standard deviation.
Table III.A10: Matching by Year (Promotions)
Treated Comparison
Year Matched Unmatched Used Unused Bandwidth
Missouri
2001 66 0 1155 130 0.005
2002 63 2 1337 1 0.035
2003 62 5 1303 5 0.014
2004 71 0 1299 7 0.015
2005 61 5 1336 5 0.019
2006 86 0 1334 0 0.030
2007 69 1 1347 1 0.030
2008 71 1 1305 1 0.080
2009 46 4 1185 31 0.008
2010 60 3 1194 60 0.005
2011 69 1 1344 4 0.045
2012 57 2 946 338 0.007
2013 76 3 1270 1 0.030
2014 57 3 1366 6 0.014
2015 77 6 1302 16 0.014
All 991 36 19023 606 .
Tennessee
2007 40 4 1036 26 0.011
2008 37 2 1021 23 0.011
2009 34 4 1070 19 0.011
2010 18 4 1037 24 0.013
2011 47 0 1034 0 0.070
2012 40 1 964 5 0.025
2013 37 3 988 9 0.011
2014 41 3 996 1 0.080
2015 40 6 1002 28 0.009
All 334 27 9148 135 .
Notes: Kernel matching (epanechnikov) performed separately by year. Bandwidth chosen via cross-validation using the
“kmatch” package in Stata.
(a) Missouri
(b) Tennessee
Figure III.A14: Propensity Score Distribution (Promotions)
Table III.A11: Covariate Balance (Promotions)
Unmatched Matched
Treat Comp Std Diff Treat Comp Std Diff Missouri
Math (yeart) 0.048 0.112 -0.08 0.073 0.050 0.03
Math (yeart−1) 0.062 0.118 -0.07 0.093 0.071 0.03 Math (yeart−2) 0.088 0.125 -0.05 0.106 0.090 0.02 Math (yeart−3) 0.083 0.125 -0.05 0.094 0.074 0.03 Math (yeart−4) 0.053 0.126 -0.10 0.076 0.059 0.02 Math (yeart−5) 0.066 0.119 -0.07 0.086 0.075 0.02
ELA (yeart) 0.067 0.118 -0.06 0.094 0.075 0.03
ELA (yeart−1) 0.106 0.120 -0.02 0.132 0.104 0.04 ELA (yeart−2) 0.132 0.122 0.01 0.161 0.137 0.03 ELA (yeart−3) 0.076 0.123 -0.06 0.096 0.078 0.03 ELA (yeart−4) 0.088 0.125 -0.05 0.110 0.096 0.02 ELA (yeart−5) 0.087 0.119 -0.05 0.104 0.093 0.02 Prin Transition (yeart−1) 0.105 0.179 -0.21 0.103 0.107 -0.01 Prin Transition (yeart−2) 0.142 0.180 -0.10 0.141 0.144 -0.01 Prin Transition (yeart−3) 0.173 0.168 0.01 0.170 0.166 0.01 Prin Transition (yeart−4) 0.176 0.167 0.02 0.174 0.178 -0.01 Prin Transition (yeart−5) 0.195 0.162 0.08 0.193 0.186 0.02 Prop New Tch (yeart) 0.164 0.152 0.11 0.162 0.161 0.00 Prop New Tch (yeart−1) 0.163 0.153 0.09 0.161 0.162 -0.01 Prop New Tch (yeart−2) 0.163 0.155 0.07 0.161 0.160 0.01 Prop New Tch (yeart−3) 0.167 0.157 0.09 0.165 0.164 0.01 Prop New Tch (yeart−4) 0.166 0.160 0.05 0.163 0.165 -0.01 Prop New Tch (yeart−5) 0.176 0.167 0.06 0.173 0.177 -0.03 Tennessee
Math (yeart) 0.052 0.088 -0.04 0.103 0.089 0.02
Math (yeart−1) 0.095 0.091 0.00 0.123 0.106 0.02 Math (yeart−2) 0.129 0.095 0.04 0.162 0.129 0.04 Math (yeart−3) 0.112 0.102 0.01 0.151 0.135 0.02 Math (yeart−4) 0.162 0.098 0.07 0.192 0.191 0.00 Math (yeart−5) 0.225 0.103 0.13 0.259 0.240 0.02
ELA (yeart) 0.028 0.088 -0.06 0.082 0.065 0.02
ELA (yeart−1) 0.097 0.092 0.01 0.125 0.107 0.02 ELA (yeart−2) 0.116 0.098 0.02 0.149 0.130 0.02 ELA (yeart−3) 0.125 0.110 0.02 0.154 0.139 0.02 ELA (yeart−4) 0.167 0.116 0.06 0.189 0.177 0.02 ELA (yeart−5) 0.214 0.127 0.10 0.227 0.211 0.02 Prin Transition (yeart−1) 0.100 0.176 -0.22 0.093 0.100 -0.03 Prin Transition (yeart−2) 0.150 0.171 -0.06 0.150 0.157 -0.02 Prin Transition (yeart−3) 0.152 0.165 -0.04 0.153 0.156 -0.01 Prin Transition (yeart−4) 0.161 0.160 0.00 0.156 0.161 -0.01 Prin Transition (yeart−5) 0.163 0.151 0.03 0.159 0.162 -0.01 Prop New Tch (yeart) 0.141 0.148 -0.08 0.143 0.146 -0.03 Prop New Tch (yeart−1) 0.143 0.147 -0.06 0.141 0.146 -0.06 Prop New Tch (yeart−2) 0.149 0.147 0.03 0.147 0.147 0.00 Prop New Tch (yeart−3) 0.150 0.152 -0.02 0.152 0.150 0.02 Prop New Tch (yeart−4) 0.162 0.156 0.05 0.158 0.157 0.01 Prop New Tch (yeart−5) 0.264 0.262 0.01 0.259 0.267 -0.03 Notes: “Treat” are schools who did not change principals in yeartand “Comp” are comparison schools who did not change principals in yeart. “Std Diff” refers to the standardized difference between treatment and comparison schools, which compares the difference in means in units of the pooled standard deviation.
Table III.A12: Matching by Year (Demotions)
Treated Comparison
Year Matched Unmatched Used Unused Bandwidth
Missouri
2001 39 2 1226 13 0.013
2002 37 8 1239 12 0.011
2003 50 7 1301 7 0.014
2004 29 8 1293 13 0.010
2005 45 2 1319 22 0.007
2006 43 4 1292 42 0.008
2007 49 6 1336 12 0.008
2008 33 5 1280 26 0.012
2009 28 6 1199 17 0.012
2010 49 6 1232 22 0.009
2011 26 10 1274 74 0.006
2012 34 7 1147 75 0.008
2013 36 6 1256 15 0.008
2014 35 6 1230 28 0.009
2015 43 7 1267 51 0.009
All 576 90 18891 429 .
Tennessee
2007 34 2 1020 5 0.014
2008 51 2 931 100 0.008
2009 33 8 1051 38 0.008
2010 48 2 1036 9 0.015
2011 34 6 956 64 0.007
2012 34 5 986 11 0.013
2013 41 3 1027 12 0.014
2014 43 9 992 20 0.014
2015 29 7 1015 17 0.014
All 347 44 9014 276 .
Notes: Kernel matching (epanechnikov) performed separately by year. Bandwidth chosen via cross-validation using the
“kmatch” package in Stata.
(a) Missouri
(b) Tennessee
Figure III.A15: Propensity Score Distribution (Demotions)
Table III.A13: Covariate Balance (Demotions)
Unmatched Matched
Treat Comp Std Diff Treat Comp Std Diff Missouri
Math (yeart) -0.303 0.113 -0.44 -0.123 -0.123 -0.00 Math (yeart−1) -0.240 0.119 -0.39 -0.085 -0.095 0.01 Math (yeart−2) -0.209 0.127 -0.37 -0.071 -0.092 0.03 Math (yeart−3) -0.181 0.128 -0.36 -0.048 -0.053 0.01 Math (yeart−4) -0.154 0.127 -0.34 -0.002 -0.024 0.03 Math (yeart−5) -0.073 0.120 -0.25 0.049 0.024 0.04 ELA (yeart) -0.296 0.120 -0.45 -0.105 -0.114 0.01 ELA (yeart−1) -0.259 0.122 -0.41 -0.075 -0.097 0.03 ELA (yeart−2) -0.224 0.123 -0.39 -0.070 -0.096 0.03 ELA (yeart−3) -0.193 0.126 -0.38 -0.061 -0.074 0.02 ELA (yeart−4) -0.146 0.127 -0.34 -0.019 -0.033 0.02 ELA (yeart−5) -0.111 0.121 -0.30 0.012 0.009 0.00 Prin Transition (yeart−1) 0.201 0.180 0.05 0.188 0.199 -0.03 Prin Transition (yeart−2) 0.252 0.181 0.17 0.247 0.234 0.03 Prin Transition (yeart−3) 0.260 0.169 0.22 0.245 0.251 -0.02 Prin Transition (yeart−4) 0.191 0.168 0.06 0.186 0.189 -0.01 Prin Transition (yeart−5) 0.188 0.164 0.06 0.189 0.186 0.01 Prop New Tch (yeart) 0.177 0.151 0.22 0.169 0.172 -0.02 Prop New Tch (yeart−1) 0.181 0.153 0.25 0.174 0.176 -0.02 Prop New Tch (yeart−2) 0.182 0.155 0.23 0.171 0.175 -0.03 Prop New Tch (yeart−3) 0.177 0.157 0.17 0.171 0.174 -0.03 Prop New Tch (yeart−4) 0.186 0.160 0.21 0.176 0.177 -0.00 Prop New Tch (yeart−5) 0.185 0.167 0.12 0.180 0.182 -0.01 Tennessee
Math (yeart) -0.316 0.086 -0.42 -0.258 -0.220 -0.04 Math (yeart−1) -0.278 0.088 -0.38 -0.200 -0.180 -0.02 Math (yeart−2) -0.269 0.090 -0.38 -0.199 -0.185 -0.02 Math (yeart−3) -0.229 0.098 -0.35 -0.164 -0.167 0.00 Math (yeart−4) -0.151 0.096 -0.27 -0.068 -0.052 -0.02 Math (yeart−5) -0.202 0.098 -0.33 -0.121 -0.090 -0.04 ELA (yeart) -0.301 0.086 -0.40 -0.245 -0.208 -0.04 ELA (yeart−1) -0.271 0.089 -0.37 -0.207 -0.192 -0.02 ELA (yeart−2) -0.243 0.093 -0.35 -0.171 -0.143 -0.03 ELA (yeart−3) -0.268 0.105 -0.39 -0.189 -0.158 -0.03 ELA (yeart−4) -0.245 0.112 -0.37 -0.135 -0.115 -0.02 ELA (yeart−5) -0.235 0.122 -0.38 -0.138 -0.113 -0.03 Prin Transition (yeart−1) 0.217 0.177 0.10 0.222 0.210 0.03 Prin Transition (yeart−2) 0.217 0.172 0.12 0.216 0.199 0.04 Prin Transition (yeart−3) 0.228 0.164 0.16 0.219 0.239 -0.05 Prin Transition (yeart−4) 0.179 0.159 0.05 0.173 0.164 0.02 Prin Transition (yeart−5) 0.225 0.153 0.18 0.222 0.224 -0.00 Prop New Tch (yeart) 0.169 0.148 0.20 0.163 0.163 0.01 Prop New Tch (yeart−1) 0.162 0.147 0.16 0.158 0.156 0.02 Prop New Tch (yeart−2) 0.171 0.147 0.25 0.166 0.167 -0.01 Prop New Tch (yeart−3) 0.162 0.152 0.11 0.160 0.160 -0.01 Prop New Tch (yeart−4) 0.169 0.156 0.11 0.165 0.169 -0.04 Prop New Tch (yeart−5) 0.246 0.258 -0.04 0.246 0.253 -0.02 Notes: “Treat” are schools who did not change principals in yeartand “Comp” are comparison schools who did not change principals in yeart. “Std Diff” refers to the standardized difference between treatment and comparison schools, which compares the difference in means in units of the pooled standard deviation.