Value function iteration with two continuous state variables

Forums General questions about Fortran programming Value function iteration with two continuous state variables

This topic contains 1 reply, has 2 voices, and was last updated by Fabian Kindermann October 28, 2021 at 9:08 am.

Viewing 2 posts - 1 through 2 (of 2 total)
  • Author
  • #1957

    Alessandro Di Nola

    When solving lifecycle models with earnings-based pensions, one has to include an additional state variable: accumulated earnings. Then you end up having a model with two continuous states: (1) financial assets a_j and (2) accumulated earnings ep_j, where j denotes age as usual. My question is how to implement the value function iteration procedure in such a case. The VF is V_j(a,ep,shocks) and (ignoring the discrete shocks) is defined on a bidimensional grid A \times P. I have found a paper by Fehr and Uhde “On the Optimal Design of Pension Systems” link with a very nice numerical appendix that suggests the following approach:
    1) Split the bi-dimensional grid into p_a \times p_p sections, and for each section find local optimum using Powell’s algorithm
    2) Find the local optimum with the highest value of V

    The procedure described above should work even if the value function is not globally concave, as in my case.

    So I’m wondering if if this procedure or anything similar is implemented somewhere in the book/exercise manual files. Moreover, is Powell’s algorithm referenced in Fehr and Uhde (2013) available in the toolbox as “fminsearch”?

    Many thanks in advance!



    Fabian Kindermann

    Dear Alessandro,

    sorry for not getting back to you earlier. I am not exactly sure what you’re trying to do here, but it sounds like very advanced and dark magic 😉

    I think the answer to this problem would be too long to post here. But the codes to Fehr and Uhde (2013) are certainly a starting point. Alternatively, you could start from the codes to Fehr, Kallweit, Kindermann (2013).

    Btw, yes Powell’s algorithm is the one underlying fminsearch in the toolbox.


Viewing 2 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.