(Translated by https://www.hiragana.jp/)
Targeting the Wrong Teachers? Linking Measurement with Theory to Evaluate Teacher Incentive Schemes
IDEAS home Printed from https://ideas.repec.org/p/uwo/hcuwoc/20171.html
   My bibliography  Save this paper

Targeting the Wrong Teachers? Linking Measurement with Theory to Evaluate Teacher Incentive Schemes

Author

Abstract

Measurement is crucial to the implementation of output-based incentive schemes. This paper uses models to study the performance of teacher quality estimators that enter teacher incentive schemes. I model an administrator tasked with (i) categorizing teachers with respect to a cutoff, (ii) retaining teachers in a hidden type environment, and (iii) compensating teachers in a hidden action environment. The preferred estimator would be the same in each model and depends on the relationship between teacher quality and class size. I use data from Los Angeles to show that simple fixed effects would almost always outperform more popular empirical Bayes.

Suggested Citation

  • Nirav Mehta, 2017. "Targeting the Wrong Teachers? Linking Measurement with Theory to Evaluate Teacher Incentive Schemes," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20171, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    • Handle: RePEc:uwo:hcuwoc:20171
    as

    Download full text from publisher

    File URL: https://ir.lib.uwo.ca/cgi/viewcontent.cgi?article=1114&context=economicscibc
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rothschild, Michael, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 689-711, July/Aug..
    2. Daniel Player, 2010. "Nonmonetary Compensation in the Public Teacher Labor Market," Education Finance and Policy, MIT Press, vol. 5(1), pages 82-103, January.
    3. Lazear, Edward P & Rosen, Sherwin, 1981. "Rank-Order Tournaments as Optimum Labor Contracts," Journal of Political Economy, University of Chicago Press, vol. 89(5), pages 841-864, October.
    4. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, March.
    5. Thomas Dohmen & Armin Falk, 2010. "You Get What You Pay For: Incentives and Selection in the Education System," Economic Journal, Royal Economic Society, vol. 120(546), pages 256-271, August.
    6. Patrick Bolton & Mathias Dewatripont, 2005. "Contract Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262025760, April.
    7. Babcock, Bruce A. & Choi, E. Kwan & Feinerman, Eli, 1993. "Risk And Probability Premiums For Cara Utility Functions," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 18(1), pages 1-8, July.
    8. Tahir Andrabi & Jishnu Das & Asim Ijaz Khwaja & Tristan Zajonc, 2011. "Do Value-Added Estimates Add Value? Accounting for Learning Dynamics," American Economic Journal: Applied Economics, American Economic Association, vol. 3(3), pages 29-54, July.
    9. Buddin, Richard, 2011. "Measuring teacher and school effectiveness at improving student achievement in Los Angeles elementary schools," MPRA Paper 31963, University Library of Munich, Germany.
    10. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    11. Joseph E. Stiglitz, 1991. "Symposium on Organizations and Economics," Journal of Economic Perspectives, American Economic Association, vol. 5(2), pages 15-24, Spring.
    12. Jesse Rothstein, 2009. "Student Sorting and Bias in Value-Added Estimation: Selection on Observables and Unobservables," Education Finance and Policy, MIT Press, vol. 4(4), pages 537-571, October.
    13. Carl Nadler & Matthew Wiswall, 2011. "Risk Aversion and Support for Merit Pay: Theory and Evidence from Minnesota's Q Comp Program," Education Finance and Policy, MIT Press, vol. 6(1), pages 75-104, January.
    14. Barrett, Nathan & Toma, Eugenia F., 2013. "Reward or punishment? Class size and teacher quality," Economics of Education Review, Elsevier, vol. 35(C), pages 41-52.
    15. Daniel F. McCaffrey & Tim R. Sass & J. R. Lockwood & Kata Mihaly, 2009. "The Intertemporal Variability of Teacher Effect Estimates," Education Finance and Policy, MIT Press, vol. 4(4), pages 572-606, October.
    16. Stinebrickner, Todd R, 2001. "A Dynamic Model of Teacher Labor Supply," Journal of Labor Economics, University of Chicago Press, vol. 19(1), pages 196-230, January.
    17. Alma Cohen & Liran Einav, 2007. "Estimating Risk Preferences from Deductible Choice," American Economic Review, American Economic Association, vol. 97(3), pages 745-788, June.
    18. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    19. Jere R. Behrman & Michela M. Tincani & Petra E. Todd & Kenneth I. Wolpin, 2016. "Teacher Quality in Public and Private Schools under a Voucher System: The Case of Chile," Journal of Labor Economics, University of Chicago Press, vol. 34(2), pages 319-362.
    20. Kevin Lang, 2010. "Measurement Matters: Perspectives on Education Policy from an Economist and School Board Member," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 167-182, Summer.
    21. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
    22. Cassandra M. Guarino & Mark D. Reckase & Jeffrey M. Woolrdige, 2014. "Can Value-Added Measures of Teacher Performance Be Trusted?," Education Finance and Policy, MIT Press, vol. 10(1), pages 117-156, November.
    23. Christopher Ferrall & Bruce Shearer, 1999. "Incentives and Transactions Costs Within the Firm: Estimating an Agency Model Using Payroll Records," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 66(2), pages 309-338.
    24. C. Kirabo Jackson, 2014. "Teacher Quality at the High School Level: The Importance of Accounting for Tracks," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 645-684.
    25. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    26. repec:mpr:mprres:7407 is not listed on IDEAS
    27. Kane, Thomas J. & Rockoff, Jonah E. & Staiger, Douglas O., 2008. "What does certification tell us about teacher effectiveness? Evidence from New York City," Economics of Education Review, Elsevier, vol. 27(6), pages 615-631, December.
    28. Peter Z. Schochet & Hanley S. Chiang, "undated". "What Are Error Rates for Classifying Teacher and School Performance Using Value-Added Models?," Mathematica Policy Research Reports 8cc459dd9c574c3d832ed4182, Mathematica Policy Research.
    29. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
    30. Imberman, Scott A. & Lovenheim, Michael F., 2016. "Does the market value value-added? Evidence from housing prices after a public release of school and teacher value-added," Journal of Urban Economics, Elsevier, vol. 91(C), pages 104-121.
    31. Christopher Jepsen & Steven Rivkin, 2009. "Class Size Reduction and Student Achievement: The Potential Tradeoff between Teacher Quality and Class Size," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    32. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    33. Cassandra M. Guarino & Michelle Maxfield & Mark D. Reckase & Paul N. Thompson & Jeffrey M. Wooldridge, 2015. "An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 190-222, April.
    34. Douglas O. Staiger & Jonah E. Rockoff, 2010. "Searching for Effective Teachers with Imperfect Information," Journal of Economic Perspectives, American Economic Association, vol. 24(3), pages 97-118, Summer.
    35. repec:mpr:mprres:6829 is not listed on IDEAS
    36. Brian A. Jacob & Lars Lefgren, 2008. "Can Principals Identify Effective Teachers? Evidence on Subjective Performance Evaluation in Education," Journal of Labor Economics, University of Chicago Press, vol. 26(1), pages 101-136.
    37. Karthik Muralidharan & Venkatesh Sundararaman, 2011. "Teacher Performance Pay: Experimental Evidence from India," Journal of Political Economy, University of Chicago Press, vol. 119(1), pages 39-77.
    38. Steven Glazerman & Hanley Chiang & Alison Wellington & Jill Constantine & Dan Player, "undated". "Impacts of Performance Pay Under the Teacher Incentive Fund: Study Design Report," Mathematica Policy Research Reports 0b5ad90028e54c259d54a1bf0, Mathematica Policy Research.
    39. Michael Rothschild, 1974. "Searching for the Lowest Price When the Distribution of Prices Is Unknown: A Summary," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 3, number 1, pages 293-294, National Bureau of Economic Research, Inc.
    40. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2006. "Teacher-Student Matching and the Assessment of Teacher Effectiveness," Journal of Human Resources, University of Wisconsin Press, vol. 41(4).
    41. Wiswall, Matthew, 2013. "The dynamics of teacher quality," Journal of Public Economics, Elsevier, vol. 100(C), pages 61-78.
    42. John Cawley & James Heckman & Edward Vytlacil, 1999. "On Policies To Reward The Value Added By Educators," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 720-727, November.
    43. Michael J. Podgursky & Matthew G. Springer, 2007. "Teacher performance pay: A review," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(4), pages 909-950.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Gilraine & Jiaying Gu & Robert McMillan, 2020. "A New Method for Estimating Teacher Value-Added," NBER Working Papers 27094, National Bureau of Economic Research, Inc.
    2. Johannes S. Kunz & Carol Propper & Kevin E. Staub & Rainer Winkelmann, 2023. "Assessing the Quality of Public Services: For-profits, Chains, and Concentration in the Hospital Market," Papers 2023-01, Centre for Health Economics, Monash University.
    3. Propper, Carol & Kunz, Johannes & Staub, Kevin & Winkelmann, Rainer, 2020. "Assessing the Quality of Public Services: Does Hospital Competition Crowd Out the For-Profit Quality Gap?," CEPR Discussion Papers 15045, C.E.P.R. Discussion Papers.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    2. Nirav Mehta, 2014. "Targeting the Wrong Teachers: Estimating Teacher Quality for Use in Accountability Regimes," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20143, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    3. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    4. Dan Goldhaber & Michael Hansen, 2013. "Is it Just a Bad Class? Assessing the Long-term Stability of Estimated Teacher Performance," Economica, London School of Economics and Political Science, vol. 80(319), pages 589-612, July.
    5. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    6. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    7. Harris, Douglas N. & Sass, Tim R., 2014. "Skills, productivity and the evaluation of teacher performance," Economics of Education Review, Elsevier, vol. 40(C), pages 183-204.
    8. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    9. Audra J. Bowlus & Eda Bozkurt & Lance Lochner, 2017. "Wages and Employment: The Canonical Model Revisited," University of Western Ontario, Centre for Human Capital and Productivity (CHCP) Working Papers 20179, University of Western Ontario, Centre for Human Capital and Productivity (CHCP).
    10. Mehta, Nirav, 2018. "The potential output gains from using optimal teacher incentives: An illustrative calibration of a hidden action model," Economics of Education Review, Elsevier, vol. 66(C), pages 67-72.
    11. Gershenson, Seth, 2021. "Identifying and Producing Effective Teachers," IZA Discussion Papers 14096, Institute of Labor Economics (IZA).
    12. Stacy, Brian, 2014. "Ranking Teachers when Teacher Value-Added is Heterogeneous Across Students," EconStor Preprints 104743, ZBW - Leibniz Information Centre for Economics.
    13. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    14. Azam, Mehtabul & Kingdon, Geeta Gandhi, 2015. "Assessing teacher quality in India," Journal of Development Economics, Elsevier, vol. 117(C), pages 74-83.
    15. Hanushek, Eric A. & Rivkin, Steven G. & Schiman, Jeffrey C., 2016. "Dynamic effects of teacher turnover on the quality of instruction," Economics of Education Review, Elsevier, vol. 55(C), pages 132-148.
    16. Hanushek, Eric A., 2011. "The economic value of higher teacher quality," Economics of Education Review, Elsevier, vol. 30(3), pages 466-479, June.
    17. Sean Corcoran & Dan Goldhaber, 2013. "Value Added and Its Uses: Where You Stand Depends on Where You Sit," Education Finance and Policy, MIT Press, vol. 8(3), pages 418-434, July.
    18. Marine de Talancé, 2015. "Better Teachers, Better Results? Evidence from Rural Pakistan," Working Papers DT/2015/21, DIAL (Développement, Institutions et Mondialisation).
    19. Cory Koedel & Mark Ehlert & Eric Parsons & Michael Podgursky, 2012. "Selecting Growth Measures for School and Teacher Evaluations," Working Papers 1210, Department of Economics, University of Missouri.
    20. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.

    More about this item

    Keywords

    Teacher Incentive Pay; Teacher Quality;

    JEL classification:

    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwo:hcuwoc:20171. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://nest.uwo.ca/chcp/research/working_papers.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.