This volume builds upon the foundations set in Volumes 1 and 2. Chapter 13 introduces the basic concepts of stochastic control and dynamic programming as the fundamental means of synthesizing optimal stochastic control laws.
Theory and application of a variety of mathematical techniques in economics are presented in this volume. Topics discussed include: martingale methods, stochastic processes, optimal stopping, the modeling of uncertainty using a Wiener process, Itô's Lemma as a tool of stochastic calculus, and basic facts about stochastic differential equations. The notion of stochastic ability and the methods of stochastic control are discussed, and their use in economic theory and finance is illustrated with numerous applications. The applications covered include: futures, pricing, job search, stochastic capital theory, stochastic economic growth, the rational expectations hypothesis, a stochastic macroeconomic model, competitive firm under price uncertainty, the Black-Scholes option pricing theory, optimum consumption and portfolio rules, demand for index bonds, term structure of interest rates, the market risk adjustment in project valuation, demand for cash balances and an asset pricing model.
This book contains about 500 exercises consisting mostly of special cases and examples, second thoughts and alternative arguments, natural extensions, and some novel departures. With a few obvious exceptions they are neither profound nor trivial, and hints and comments are appended to many of them. If they tend to be somewhat inbred, at least they are relevant to the text and should help in its digestion. As a bold venture I have marked a few of them with a * to indicate a "must", although no rigid standard of selection has been used. Some of these are needed in the book, but in any case the reader's study of the text will be more complete after he has tried at least those problems.