Convergence rate of Picard iterations

Given a first order ODE $y'(x)=f(x,y)$ with the initial condition $y(x_0)=x_0$ such that it satisfies Picard thoerem of existence and uniquness, one can compute the solution by Picard iterations :

$$y_0 (x) \equiv y_0 \, ,$$ and $$y_{n+1}(x) = y_0 + \int\limits_{x_0}^x f(t,y_n (t)) \, dt \, .$$

Computationally speaking, how fast is this method? Do we have a theorem about its convergence rate? Do we have particulary "bad" examples for its convergence?

Generally speaking, I know this method is not the usual go-to for numerical solutions of ODE's, but why?

• Specifically, how do you intend to evaluate that integral? If I understand your notation correctly, you have simply stated a formal definition of what it means to solve that ODE. Specific numerical methods make certain choices about evaluating the integral. If I am misunderstanding, please clarify your notation and the specific algorithm you have in mind. – Bill Greene Apr 5 '17 at 18:14
• @BillGreene , At each step both $f$ and $y_n$ are given. Assume, for the sake of this discussion, that we can use an arbitrarily accurate numerical integration scheme. Even if we had it analytically, we still know nothing about how these iterations converge. – Amir Sagiv Apr 6 '17 at 9:50
• That said, Picard's iteration converges linearly. – Wolfgang Bangerth Apr 8 '17 at 12:32
• @WolfgangBangerth ,Thanks! Can you refer to the proof or show it, as an answer? – Amir Sagiv Apr 9 '17 at 5:19
• Picard iteration is a fixed point iteration. If you can show that it's a contraction, then linear convergence follows immediately based on a theorem that you will find in most introductory textbooks on numerical analysis (e.g. Kincaid and Cheney). – Wolfgang Bangerth Apr 10 '17 at 0:23
The text passage discusses the convergence rate of Picard iterations for solving first-order ODEs and includes a question about the convergence rate and a response indicating that it converges linearly.
single_question_with_answer
Given a text passage, determine:
    1. If it contains a mathematical question (including word problems or calculations)
    2. If an answer to that mathematical question is provided in the text

First, describe the content structure you found in 1-2 sentences.

Then provide your analysis in the following format:
TYPE: <one of the following values>
- NO_QUESTION
- SINGLE_QUESTION
- SINGLE_QUESTION_WITH_ANSWER
- MULTIPLE_QUESTIONS
- MULTIPLE_QUESTIONS_WITH_ANSWERS
system
Convergence rate of Picard iterations

Given a first order ODE $y'(x)=f(x,y)$ with the initial condition $y(x_0)=x_0$ such that it satisfies Picard thoerem of existence and uniquness, one can compute the solution by Picard iterations :

$$y_0 (x) \equiv y_0 \, ,$$ and $$y_{n+1}(x) = y_0 + \int\limits_{x_0}^x f(t,y_n (t)) \, dt \, .$$

Computationally speaking, how fast is this method? Do we have a theorem about its convergence rate? Do we have particulary "bad" examples for its convergence?

Generally speaking, I know this method is not the usual go-to for numerical solutions of ODE's, but why?

• Specifically, how do you intend to evaluate that integral? If I understand your notation correctly, you have simply stated a formal definition of what it means to solve that ODE. Specific numerical methods make certain choices about evaluating the integral. If I am misunderstanding, please clarify your notation and the specific algorithm you have in mind. – Bill Greene Apr 5 '17 at 18:14
• @BillGreene , At each step both $f$ and $y_n$ are given. Assume, for the sake of this discussion, that we can use an arbitrarily accurate numerical integration scheme. Even if we had it analytically, we still know nothing about how these iterations converge. – Amir Sagiv Apr 6 '17 at 9:50
• That said, Picard's iteration converges linearly. – Wolfgang Bangerth Apr 8 '17 at 12:32
• @WolfgangBangerth ,Thanks! Can you refer to the proof or show it, as an answer? – Amir Sagiv Apr 9 '17 at 5:19
• Picard iteration is a fixed point iteration. If you can show that it's a contraction, then linear convergence follows immediately based on a theorem that you will find in most introductory textbooks on numerical analysis (e.g. Kincaid and Cheney). – Wolfgang Bangerth Apr 10 '17 at 0:23
user
The text passage discusses the convergence rate of Picard iterations for solving first-order ODEs and includes a question about the convergence rate and a response indicating that it converges linearly.

TYPE: SINGLE_QUESTION_WITH_ANSWER