The Derivative
We begin with the definition of the derivative of a function.
Let be an interval and let . We say that is differentiable at or has a derivative at if
exists. We say that is differentiable on if is differentiable at every point in .
By definition,
Let for . Prove that .
Let for . Prove that .
Recall that
and that . Therefore,
Hence for all and thus .
Prove by definition that is differentiable on .
We have that
Now
Hence, exists for all and the derivative function of is
Prove that if .
We have that . Therefore, . This proves that for all .
Compute the derivative function of for .
If then and thus for . If then and therefore for . Now consider . We have that
We claim that the limit does not exist and thus does not exist. To see this, consider . Then and for all . On the other hand, consider . Then and . Hence, , and thus the claim holds by the Sequential criterion for limits. The derivative function of is therefore defined on and is given by
Hence, even though is continuous at every point in its domain , it is not differentiable at every point in its domain. In other words, continuity is not a sufficient condition for differentiability.
Suppose that is differentiable at . Then is continuous at .
To prove that is continuous at we must show that . By assumption exists, and clearly . Hence we can apply the Limits laws and compute
and the proof is complete.
Let and be differentiable at . The following hold:
- If
then is differentiable and . is differentiable at and . is differentiable at and .- If
then is differentiable at and
Parts (i) and (ii) are straightforward. We will prove only (iii) and (iv). For (iii), we have that
Now because is differentiable at . Therefore,
To prove part (iv), since , then there exist a -neighborhood such that for all . If then
Since , it follows that
and the proof is complete.
We now prove the Chain Rule.
Let and be functions such that and let . If exists and exists then exists and .
Suppose that there exists a neighborhood of where . Otherwise, the composite function is constant in a neighborhood of , and then clearly differentiable at . Consider the function defined by
Now
Hence, is differentiable at and therefore is at . Now,
and therefore
Therefore, as claimed.
Compute if
Where is continuous?
When , is the composition and product of differentiable functions at , and therefore is differentiable at . For instance, on , the functions , and are differentiable at every . Hence, if we have that
Consider now . If exists it is equal to
Using the Squeeze Theorem, we deduce that . Therefore,
From the above formula obtained for , we observe that when is continuous since it is the product/difference/composition of continuous functions. To determine continuity of at consider . Consider the sequence , which clearly converges to . Now, . Now, for all and therefore . The sequence does not converge and therefore does not exist. Thus, is not continuous at .
Compute if
Where is continuous?
When , is the composition and product of differentiable functions, and therefore is differentiable at . For instance, on , the functions , and are differentiable on . Hence, if we have that
Consider now . If exists it is equal to
and using the Squeeze Theorem we deduce that . Therefore,
When , is continuous since it is the product/difference/composition of continuous functions. To determine continuity of at we consider the limit . Now using the Squeeze Theorem, and similarly using the Squeeze Theorem. Therefore, exists and is equal to , which is equal to . Hence, is continuous at , and thus continuous everywhere.
Consider the function
Show that .
Exercises
Use the definition of the derivative of a function to find if . Clearly state the domain of .
Use the definition of the derivative of a function to find if . Clearly state the domain of .
Let be defined by
- Show that
is differentiable at and find . - Prove that if
then is not differentiable at .
Let for . Determine whether , exist and if yes find them. Hint: Consider writing as a piecewise function and use the definition of the derivative.
If is differentiable at , explain why
Give an example of a function and a number such that
exists but does not exist.
The Mean Value Theorem
Let be a function and let .
A point - We say that
has a relative maximum at if there exists such that for all . - We say that
has a relative minimum at if there exists such that for all .
Let be a function and let be an interior point of . Suppose that has a relative maximum (or minimum) at . If is differentiable at then is a critical point of , that is, .
Suppose that has a relative maximum at ; the relative minimum case is similar. Then for , it holds that for and some . Consider the function defined by for and . Then the function is continuous at because . Now for it holds that and therefore . Similarly, for it holds that and therefore . Thus .
If has a relative maximum (or minimum) at then either or does not exist.
The function has a relative minimum at , however, is not differentiable at .
Let be continuous on and differentiable on . If then there exists such that .
Since is continuous on it achieves its maximum and minimum at some point and , respectively, that is for all . If is constant then for all . If is not constant then . Since it follows that at least one of and is not contained in , and hence by Theorem 6.2.2 there exists such that .
We now state and prove the main result of this section.
Let be continuous on and differentiable on . Then there exists such that .
If then the result follows from Rolle's Theorem ( for some ). Let be the line from to , that is,
and define the function
for . Then and , and thus . Clearly, is continuous on and differentiable on , and it is straightforward to verify that . By Rolle's Theorem, there exists such that , and therefore .
Let be continuous on and differentiable on . If for all then is constant on .
Let . Now restricted to satisfies all the assumptions needed in the Mean Value Theorem. Therefore, there exists such that . But and thus . This holds for all and thus is constant on .
Show by example that Theorem 6.2.7 is not true for a function if is not a closed and bounded interval.
If are continuous and differentiable on and for all then for some constant .
Use the Mean Value theorem to show that for all .
Suppose that and let so that . By the MVT, there exists such that , that is . Now and therefore . Therefore, . The case can be treated similarly.
The function is increasing if whenever . Similarly, is decreasing if whenever . In either case, we say that is monotone.
The sign of the derivative
Suppose that is differentiable.
- Then
is increasing if and only if for all . - Then
is decreasing if and only if for all .
Suppose that is increasing. Then for all with it holds that and therefore . Hence, this proves that for all .
Now suppose that for all . Suppose that . Then by the Mean Value Theorem, there exists such that . Therefore, since it follows that .
Part (ii) is proved similarly.
Exercises
Use the Mean Value Theorem to show that
In general, suppose that is such that exists on and is continuous on . Prove that is Lipschitz on .
Give an example of a uniformly continuous function on that is differentiable on but whose derivative is not bounded on . Justify your answer.
Let be an interval and let be differentiable on . Prove that if for then is strictly increasing on .
Let be continuous on and differentiable on . Show that if then exists and equals . Hint: Use the definition of , the Mean Value Theorem, and the Sequential Criterion for limits.
Let be continuous and suppose that exists on . Prove that if for then is strictly increasing on .
Suppose that is continuous on and differentiable on . We proved that if for all then is constant on . Give an example of a function such that for all but is not constant on .
Let be differentiable. Prove that if on then is injective.
Taylor's Theorem
Taylor's theorem is a higher-order version of the Mean Value Theorem and it has abundant applications in numerical analysis. Taylor's theorem involves Taylor polynomials which you are familiar with from calculus.
Let and suppose that is such that the derivatives , , , , exist for some positive integer . Then the polynomial
is called the th order Taylor polynomial of based at . Using summation convention, can be written as
By construction, the derivatives of
Let be a function such that for some the functions are continuous on and exists on . Fix . Then for any there exists between and such that
where
If then and then can be chosen arbitrarily. Thus, suppose that , let , and define the function by
Since exists on then exists on . Moreover, since for then for . Now and therefore since by Rolle's theorem there exists in between and such that . Now we can apply Rolle's theorem to since and , and therefore there exists in between and such that . By applying this same argument repeatedly, there exists in between and such that . Now,
and since then
from which we conclude that
and the proof is complete.
Consider the function given by . Use based at to estimate and give a bound on the error with your estimation.
Note that and so the estimate of using is . To determine we need . We compute
Therefore,
Now and therefore
The error is which is unknown but we can approximate it using Taylor's theorem. To that end, by Taylor's theorem, for any there exists in between and such that
Therefore, for , there exists such that
Therefore, a bound for the error is
since .
Let be the sine function, that is, .
- Approximate
using centered at and give a bound on the error. - Restrict
to a closed and bounded interval of the form . Show that for any there exists such that if then for all .
(a) It is straightforward to compute that
and . Thus, by Taylor's theorem for any there exists in between and such that
The estimate for is
By Taylor's theorem, there exists such that and
Now since for all , we have
(b) Since has derivatives of all orders, for any we have by Taylor's theorem that
where is in between and . Now, the derivative of of any order is one of or , and therefore . Since then and therefore . Therefore, for all we have
Consider the sequence . Applying the Ratio test we obtain
Therefore, by the Ratio test . Hence, for any there exists such that for all . Therefore, for all we have that
for all .
Taylor's theorem can be used to derive useful inequalities.
Prove that for all it holds that
Let . Applying Taylor's theorem to at we obtain
where
and is in between and . Now, if then and then , from which it follows that . If on the other hand then and then , from which it follows that . Hence, the inequality holds for . Now if then
Hence the inequality holds for all .
Exercises
Use Taylor's theorem to prove that if then
Then use these inequalities to approximate and , and for each case determine a bound on the error of your approximation.
Let be such that exists for all and for all (such a function is called infinitely differentiable on ). Suppose further that there exists such that for all and all . Let be the th order Taylor polynomial of centered at . Let , where . Prove that for any fixed there exists such that for it holds that
for all . Hint: is continuous on for every .
Euler's number is approximately . Use Taylor's theorem at on and the estimate to show that, for all ,
Let be the cosine function . Approximate using centered at and give a bound on the error of your estimation.