(Translated by https://www.hiragana.jp/)
The Dual Approach to Recursive Optimization: Theory and Examples
IDEAS home Printed from https://ideas.repec.org/a/wly/emetrp/v86y2018i1p133-172.html
   My bibliography  Save this article

The Dual Approach to Recursive Optimization: Theory and Examples

Author

Listed:
  • Nicola Pavoni
  • Christopher Sleet
  • Matthias Messner

Abstract

We develop a recursive dual method for solving dynamic economic problems. The method uses a Lagrangian to pair a dynamic recursive economic problem with a dual problem. We show that such dual problems can be recursively decomposed with costates (i.e., Lagrange multipliers on laws of motion) functioning as state variables. In dynamic contracting and policy settings, the method often replaces an endogenous state space of forward†looking utilities with an exogenously given state space of costates. We provide a principle of optimality for dual problems and give conditions under which the dual Bellman operator is a contraction with the optimal dual value function its unique fixed point. We relate economic problems to their duals, address computational issues, and give examples.

Suggested Citation

  • Nicola Pavoni & Christopher Sleet & Matthias Messner, 2018. "The Dual Approach to Recursive Optimization: Theory and Examples," Econometrica, Econometric Society, vol. 86(1), pages 133-172, January.
    • Handle: RePEc:wly:emetrp:v:86:y:2018:i:1:p:133-172
    DOI: 10.3982/ECTA11905
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/ECTA11905
    Download Restriction: no
    File URL: https://libkey.io/10.3982/ECTA11905?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Thomas Cooley & Ramon Marimon & Vincenzo Quadrini, 2004. "Aggregate Consequences of Limited Contract Enforceability," Journal of Political Economy, University of Chicago Press, vol. 112(4), pages 817-847, August.
    2. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    3. Yili Chien & Harold Cole & Hanno Lustig, 2011. "A Multiplier Approach to Understanding the Macro Implications of Household Finance," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 78(1), pages 199-234.
    4. Matthias Messner & Nicola Pavoni & Christopher Sleet, "undated". "Contractive Dual Methods for Incentive Problems," GSIA Working Papers 2012-E26, Carnegie Mellon University, Tepper School of Business.
    5. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    6. Kenneth L. Judd & Sevin Yeltekin & James Conklin, 2003. "Computing Supergame Equilibria," Econometrica, Econometric Society, vol. 71(4), pages 1239-1254, July.
    7. Daron Acemoglu & Mikhail Golosov & Aleh Tsyvinski, 2010. "Dynamic Mirrlees Taxation under Political Economy Constraints," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(3), pages 841-881.
    8. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    9. Ramon Marimon & Vincenzo Quadrini, 2005. "Competition, innovation and growth with limited commitment," Economics Working Papers 933, Department of Economics and Business, Universitat Pompeu Fabra.
    10. Hopenhayn, Hugo A & Nicolini, Juan Pablo, 1997. "Optimal Unemployment Insurance," Journal of Political Economy, University of Chicago Press, vol. 105(2), pages 412-438, April.
    11. Rustichini, Aldo, 1998. "Dynamic Programming Solution of Incentive Constrained Problems," Journal of Economic Theory, Elsevier, vol. 78(2), pages 329-354, February.
    12. S. Rao Aiyagari & Albert Marcet & Thomas J. Sargent & Juha Seppala, 2002. "Optimal Taxation without State-Contingent Debt," Journal of Political Economy, University of Chicago Press, vol. 110(6), pages 1220-1254, December.
    13. Patrick J. Kehoe & Fabrizio Perri, 2002. "International Business Cycles with Endogenous Incomplete Markets," Econometrica, Econometric Society, vol. 70(3), pages 907-928, May.
    14. Marinacci, Massimo & Montrucchio, Luigi, 2010. "Unique solutions for stochastic recursive utilities," Journal of Economic Theory, Elsevier, vol. 145(5), pages 1776-1804, September.
    15. Narayana R. Kocherlakota, 1996. "Implications of Efficient Risk Sharing without Commitment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(4), pages 595-609.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Marimon, Ramon & Werner, Jan, 2021. "The envelope theorem, Euler and Bellman equations, without differentiability," Journal of Economic Theory, Elsevier, vol. 196(C).
    2. Gaetano Bloise, 2020. "Unique Markov Equilibrium Under Limited Commitment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 61(2), pages 721-751, May.
    3. Golosov, M. & Tsyvinski, A. & Werquin, N., 2016. "Recursive Contracts and Endogenously Incomplete Markets," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 725-841, Elsevier.
    4. Gaetano Bloise & Paolo Siconolfi, 2022. "A Negishi Approach to Recursive Contracts," Econometrica, Econometric Society, vol. 90(6), pages 2821-2855, November.
    5. Clayton, Christopher & Schaab, Andreas, 2022. "A Theory of Dynamic Inflation Targets," TSE Working Papers 22-1389, Toulouse School of Economics (TSE).
    6. François Le Grand & Xavier Ragot, 2022. "Managing Inequality Over Business Cycles: Optimal Policies With Heterogeneous Agents And Aggregate Shocks," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(1), pages 511-540, February.
    7. Fabio Blasutto, 2020. "Cohabitation vs Marriage: Mating Strategies by Education in the USA," LIDAM Discussion Papers IRES 2020023, Université catholique de Louvain, Institut de Recherches Economiques et Sociales (IRES).
    8. François Le Grand & Xavier Ragot, 2022. "Managing Inequality Over Business Cycles: Optimal Policies With Heterogeneous Agents And Aggregate Shocks," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(1), pages 511-540, February.
    9. Yu, Meng & Zhang, Junnan, 2019. "Equilibrium in production chains with multiple upstream partners," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 1-10.
    10. Meng Yu & Junnan Zhang, 2019. "Equilibrium in Production Chains with Multiple Upstream Partners," Papers 1908.08208, arXiv.org.
    11. Lilia Maliar & Serguei Maliar, 2016. "Ruling Out Multiplicity of Smooth Equilibria in Dynamic Games: A Hyperbolic Discounting Example," Dynamic Games and Applications, Springer, vol. 6(2), pages 243-261, June.
    12. Can Urgun, 2021. "Restless Contracting," Working Papers 2021-88, Princeton University. Economics Department..
    13. Jean Guillaume Forand & Jan Zapal, 2017. "The Demand and Supply of Favours in Dynamic Relationships," Working Papers 1705, University of Waterloo, Department of Economics, revised Sep 2017.
    14. Fabio Blasutto & Egor Kozlov, 2020. "(Changing) Marriage and Cohabitation Patterns in the US: do Divorce Laws Matter?," 2020 Papers pbl245, Job Market Papers.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "On the Dual Approach to Recursive Optimization," GSIA Working Papers 2012-E12, Carnegie Mellon University, Tepper School of Business.
    2. Matthias Messner & Nicola Pavoni & Christopher Sleet, 2012. "Recursive Methods for Incentive Problems," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 501-525, October.
    3. Messner Matthias & Pavoni Nicola & Sleet Christopher, "undated". "Recursive Methods for Dynamic Incentive Problems," GSIA Working Papers 2012-E13, Carnegie Mellon University, Tepper School of Business.
    4. Miao, Jianjun & Zhang, Yuzhe, 2015. "A duality approach to continuous-time contracting problems with limited commitment," Journal of Economic Theory, Elsevier, vol. 159(PB), pages 929-988.
    5. Albert Marcet & Ramon Marimon, 2019. "Recursive Contracts," Econometrica, Econometric Society, vol. 87(5), pages 1589-1631, September.
    6. Scholl, Almuth, 2005. "Limited enforceable international loans, international risk sharing and trade," SFB 649 Discussion Papers 2005-055, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    7. Almuth Scholl, 2002. "Limited Enforceable International Loans, International Risk Sharing and Trade," SFB 649 Discussion Papers SFB649DP2005-055, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany, revised Aug 2005.
    8. Matthias Messner & Nicola Pavoni, 2004. "On the Recursive Saddle Point Method," Working Papers 255, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    9. Harold Cole & Felix Kubler, 2012. "Recursive Contracts, Lotteries and Weakly Concave Pareto Sets," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 15(4), pages 479-500, October.
    10. YiLi Chien & Harold L. Cole & Hanno Lustig, 2014. "Implications of heterogeneity in preferences, beliefs and asset trading technologies for the macroeconomy," Working Papers 2014-14, Federal Reserve Bank of St. Louis.
    11. Bauducco, Sofia & Caprioli, Francesco, 2014. "Optimal fiscal policy in a small open economy with limited commitment," Journal of International Economics, Elsevier, vol. 93(2), pages 302-315.
    12. Almuth Scholl, 2018. "Debt Relief for Poor Countries: Conditionality and Effectiveness," Economica, London School of Economics and Political Science, vol. 85(339), pages 626-648, July.
    13. Mele, Antonio, 2014. "Repeated moral hazard and recursive Lagrangeans," Journal of Economic Dynamics and Control, Elsevier, vol. 42(C), pages 69-85.
    14. Scholl, Almuth, 2005. "Aid effectiveness and limited enforceable conditionality," SFB 649 Discussion Papers 2005-054, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    15. Golosov, M. & Tsyvinski, A. & Werquin, N., 2016. "Recursive Contracts and Endogenously Incomplete Markets," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 725-841, Elsevier.
    16. Almuth Scholl, 2009. "Aid Effectiveness and Limited Enforceable Conditionality," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 12(2), pages 377-391, April.
    17. Abraham Arpad & Nicola Pavoni, 2004. "Efficient Allocations, with Moral Hazard and Hidden Borrowing and Lending," Levine's Bibliography 122247000000000138, UCLA Department of Economics.
    18. Yili Chien & Harold Cole & Hanno Lustig, 2016. "Implications of Heterogeneity in Preferences, Beliefs and Asset Trading Technologies in an Endowment Economy," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 20, pages 215-239, April.
    19. Gaetano Bloise & Paolo Siconolfi, 2022. "A Negishi Approach to Recursive Contracts," Econometrica, Econometric Society, vol. 90(6), pages 2821-2855, November.
    20. David Martimort & Aggey Semenov & Lars Stole, 2017. "A Theory of Contracts with Limited Enforcement," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(2), pages 816-852.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:emetrp:v:86:y:2018:i:1:p:133-172. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.