Buy new:
$134.50$134.50
FREE delivery Friday, March 6
Advertisement
Ships from: Amazon.com Sold by: Amazon.com
Save with Used - Good
$112.30$112.30
FREE delivery Friday, March 6
Advertisement
Ships from: Amazon Sold by: TextbookAgent
Return this item for free
We offer easy, convenient returns with at least one free return option: no shipping charges. All returns must comply with our returns policy.
Learn more about free returns.- Go to your orders and start the return
- Select your preferred free shipping option
- Drop off and leave!
Sorry, there was a problem.
There was an error retrieving your Wish Lists. Please try again.Sorry, there was a problem.
List unavailable.
Download the free Kindle app and start reading Kindle books instantly on your smartphone, tablet, or computer - no Kindle device required.
Read instantly on your browser with Kindle for Web.
Using your mobile phone camera - scan the code below and download the Kindle app.
Follow the author
OK
Dynamic Programming and Optimal Control 4th Edition
Purchase options and add-ons
- ISBN-101886529086
- ISBN-13978-1886529083
- Edition4th
- PublisherAthena Scientific
- Publication dateJune 18, 2012
- LanguageEnglish
- Dimensions6.5 x 2 x 9.25 inches
- Print length1270 pages
Frequently bought together

Deals on related products
Customers also bought or read
- Reinforcement Learning and Stochastic Optimization: A Unified Framework for Sequential Decisions
Hardcover$92.47$92.47FREE delivery Fri, Mar 6 - Introduction to Linear Optimization (Athena Scientific Series in Optimization and Neural Computation, 6)
Hardcover$89.00$89.00FREE delivery Fri, Mar 6 - Optimal Control Theory: An Introduction (Dover Books on Electrical Engineering)
Paperback$30.64$30.64Delivery Fri, Mar 6 - Optimization by Vector Space Methods (Wiley Professional)
Paperback$89.08$89.08FREE delivery Fri, Mar 6 - Probabilistic Machine Learning: Advanced Topics (Adaptive Computation and Machine Learning series)
Hardcover$130.88$130.88FREE delivery Fri, Mar 6 - Lectures on Stochastic Programming: Modeling and Theory, Third Edition
Hardcover$104.00$104.00FREE delivery Fri, Mar 6 - Distributional Reinforcement Learning (Adaptive Computation and Machine Learning)
Hardcover$60.00$60.00FREE delivery Fri, Mar 6 - The MILP Optimization Handbook: An Introduction to Linear and Integer Programming for Practitioners
Paperback$16.99$16.99Delivery Fri, Mar 6 - Linear Algebra Done Right (Undergraduate Texts in Mathematics)
Hardcover$59.21$59.21FREE delivery Fri, Mar 6 - Stochastic Differential Equations: An Introduction with Applications (Universitext)
Paperback$55.16$55.16FREE delivery Fri, Mar 6 - The Feynman Lectures on Physics, boxed set: The New Millennium Edition#1 Best SellerThermodynamics
Hardcover$153.99$153.99FREE delivery Fri, Mar 6 - Large Deviations Techniques and Applications (Stochastic Modelling and Applied Probability, 38)
Paperback$63.99$63.99FREE delivery Fri, Mar 6 - Feedback Control Theory (Dover Books on Electrical Engineering)
Paperback$12.29$12.29Delivery Fri, Mar 6
Editorial Reviews
Review
In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces
In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics
In this two-volume work Bertsekas caters equally effectively to theoreticians who care for proof of such concepts as the existence and the nature of optimal policies and to practitioners interested in the modeling and the quantitative and numerical solution aspects of stochastic dynamic programming. --Michael Caramanis, in Interfaces
In conclusion, this book is an excellent source of reference ... The main strengths of the book are the clarity of the exposition, the quality and variety of the examples, and its coverage of the most recent advances. --T. W. Archibald, in IMA Jnl. of Mathematics
About the Author
Product details
- Publisher : Athena Scientific
- Publication date : June 18, 2012
- Edition : 4th
- Language : English
- Print length : 1270 pages
- ISBN-10 : 1886529086
- ISBN-13 : 978-1886529083
- Item Weight : 3.3 pounds
- Dimensions : 6.5 x 2 x 9.25 inches
- Best Sellers Rank: #1,540,542 in Books (See Top 100 in Books)
- #668 in Mathematical Physics (Books)
- #1,345 in Physics (Books)
- #7,652 in Computer Science (Books)
- Customer Reviews:
About the author

DIMITRI P. BERTSEKAS
Biographical Sketch
Dimitri P. Bertsekas undergraduate studies were in engineering at the National Technical University of Athens, Greece. He obtained his MS in electrical engineering at the George Washington University, Wash. DC in 1969, and his Ph.D. in system science in 1971 at the Massachusetts Institute of Technology.
Dr. Bertsekas has held faculty positions with the Engineering-Economic Systems Dept., Stanford University (1971-1974) and the Electrical Engineering Dept. of the University of Illinois, Urbana (1974-1979). Since 1979 he has been teaching at the Electrical Engineering and Computer Science Department of the Massachusetts Institute of Technology (M.I.T.), where he is currently McAfee Professor of Engineering. He has held editorial positions in several journals. His research at M.I.T. spans several fields, including optimization, control, large-scale computation, and data communication networks, and is closely tied to his teaching and book authoring activities. He has written numerous research papers, and sixteen books and research monographs, several of which are used as textbooks in MIT classes.
Professor Bertsekas was awarded the INFORMS 1997 Prize for Research Excellence in the Interface Between Operations Research and Computer Science for his book "Neuro-Dynamic Programming" (co-authored with John Tsitsiklis), the 2000 Greek National Award for Operations Research, the 2001 ACC John R. Ragazzini Education Award, the 2009 INFORMS Expository Writing Award, the 2014 ACC Richard E. Bellman Control Heritage Award for "contributions to the foundations of deterministic and stochastic optimization-based methods in systems and control," the 2014 Khachiyan Prize for Life-Time Accomplishments in Optimization, and the SIAM/MOS 2015 George B. Dantzig Prize. In 2001, he was elected to the United States National Academy of Engineering for "pioneering contributions to fundamental research, practice and education of optimization/control theory, and especially its application to data communication networks."
Dr. Bertsekas' recent books are "Introduction to Probability: 2nd Edition" (2008), "Convex Optimization Theory" (2009), "Dynamic Programming and Optimal Control, Vol. I, (2017), and Vol. II: Approximate Dynamic Programming" (2012), "Abstract Dynamic Programming" (2013), and "Convex Optimization Algorithms" (2015), all published by Athena Scientific.
Besides his professional activities, Professor Bertsekas is interested in travel, portrait, and landscape photography. His pictures have been exhibited on several occasions at M.I.T., and can also be accessed from his www site.
Related products with free delivery on eligible orders
Customer reviews
Customer Reviews, including Product Star Ratings help customers to learn more about the product and decide whether it is the right product for them.
To calculate the overall star rating and percentage breakdown by star, we don’t use a simple average. Instead, our system considers things like how recent a review is and if the reviewer bought the item on Amazon. It also analyzed reviews to verify trustworthiness.
Learn more how customers reviews work on AmazonTop reviews from the United States
There was a problem filtering reviews. Please reload the page.
- Reviewed in the United States on August 28, 2016Format: HardcoverVerified PurchaseI've read the textbook dealing with DP up to chapter 6. Since this book is approached mathematically, I think it is very well made except a few typos. A bit of unsatisfactoriness for me is the style of the book. I prefer the style introducing the general result first, and then proves why they are derived and where they are derived from. And then, many examples are very helpful for readers like me. However, this book introduces examples first, and then constructs the general form from and using the examples. I am sure that everybody has different styles. My word is just not my type. Nevertheless, the contents that textbook handles are wonderful.
- Reviewed in the United States on March 15, 2019Format: HardcoverVerified PurchaseThis set of two books is just an absolute archive of knowledge. Everything you need to know on Optimal Control and Dynamic programming from beginner level to advanced intermediate is here. Plus worked examples are great. They aren't boring examples as well.
This set pairs well with Simulation-Based Optimization by Abhijit Gosavi.
I guess the point is, this book should be the central framework of any graduate course in optimal control and operations research.
- Reviewed in the United States on October 9, 2024Format: HardcoverSeems like someone scanned it in while very drunk or something. Publisher really should lift its game this is just embarrassing for them.
- Reviewed in the United States on August 27, 2008Format: Hardcover*This is easily the best book on dynamic programming. It certainly is the most up-to-date book on this topic. The first volume covers numerous topics such as deterministic control, HJB equation for the deterministic case, Pontryagin principle, finite horizon MDPs, partially observable MDPs, and rollout heuristics. The second volume treats the infinite horizon case for the regular MDP --- average reward, discounted reward, semi-Markov control, and even some reinforcement learning.
*I love the notation. The proofs in this book are much easier than those you will find elsewhere. (This opinion is based on my study of proofs in other texts.) The treatment is very sophisticated and yet very accessible! Furthermore, what is really a bonus here --- something you won't find in the other books --- is a discussion on the stochastic shortest path (SSP). The SSP makes it so easy to analyze the average reward problem and the finite horizon problem with a stationary transition probability structure.
*I strongly recommend this book to all readers interested in understanding the basics of DP and the convergence proofs underlying the DP machinery. It is a must on your book shelf if you are working on research in DP or topics related to DP such as reinforcement learning or adaptive (approximate) DP.
- Reviewed in the United States on April 19, 2000This book does a very good job presenting both deterministic and stochastic optimal control. The author does a particularly good job in presenting the derivation of the Bellman equation and its relation to variational formulations for deterministic optimal control. There are also many very good problems with which the reader can test her understanding, and the author has made many solutions available on his web page. Problems range from testing theoretical understanding to determinig optimal policies for various control problems. There are even some exercises which ask the reader to develop parallel codes to solve some problems, so I think there is something in this book for everybody. Richard Bellman once said that there is considerably more to optimal control than just locating the eigenvalues of some matrix in the complex plane. I believe that Bertsekas has remained faithful to Bellman's view with the broad range of problems which he attacks through dynamic programming. I am currently doing a PhD thesis in mathematics studying Bellman equations, and I cannot think of a better source for intuition about control problems than Bertsekas' book. He even does a nice job in pointing out where he has omitted technicalities in the mathematical treatment for those who wish a very rigorous approach to control. If there is a better book out there, I am not aware of it.
- Reviewed in the United States on November 3, 2006Format: Hardcoverreally nice book on dynamic programming... easy to understand and contains all requisite details.
- Reviewed in the United States on December 9, 2017Format: HardcoverVerified PurchaseProf. Bertsekas is definitely the top-level researcher in this domain. It is a good start to study reinforcement learning and its beyond.
Top reviews from other countries
LizReviewed in Mexico on September 18, 20241.0 out of 5 stars Do not waste your money on the kindle edition
Format: KindleVerified PurchaseI wasted my money on this kindle book. I thought that by being a kindle edition it was gonna be well formated, but It is not even readable.
It looks like a scanned book. I attached pics of how it looks on my kindle and on the kindle app on my tablet.
I wasted my money on this kindle book. I thought that by being a kindle edition it was gonna be well formated, but It is not even readable.1.0 out of 5 stars
LizDo not waste your money on the kindle edition
Reviewed in Mexico on September 18, 2024
It looks like a scanned book. I attached pics of how it looks on my kindle and on the kindle app on my tablet.
Images in this review
MGReviewed in Canada on January 25, 20165.0 out of 5 stars Happy grad student
Format: HardcoverVerified PurchaseIndispensable for my research in grad school.
amznusrReviewed in Germany on July 31, 20232.0 out of 5 stars Probably a good textbook...
Format: HardcoverVerified PurchaseI was looking forward to working with this two-volume book. Professor Bertsekas is considered a good teacher (in the classroom and in his books).
Volume 1, however, has skewed text on many pages (see picture 1) and also two pages hanging together which will result in damaged paper when fully opening the book in this place (see picture 2). I informed the publisher about the not perfectly centered pages and they told me that they "look to us exactly as they are supposed to look" (skewed) and with regards to the binding they replied: "Also the binding flaw mentioned does not seem to be of the type that we can guarantee against. Therefore if you ask for a book replacement from Amazon, we cannot guarantee that the replacement book will be more satisfactory."
Athena Scientific's motto is "A Publisher of Fine Scientific Books". Good one. Not fine with me. I'll sadly have to return those fine books.
I was looking forward to working with this two-volume book. Professor Bertsekas is considered a good teacher (in the classroom and in his books).2.0 out of 5 stars
amznusrProbably a good textbook...
Reviewed in Germany on July 31, 2023
Volume 1, however, has skewed text on many pages (see picture 1) and also two pages hanging together which will result in damaged paper when fully opening the book in this place (see picture 2). I informed the publisher about the not perfectly centered pages and they told me that they "look to us exactly as they are supposed to look" (skewed) and with regards to the binding they replied: "Also the binding flaw mentioned does not seem to be of the type that we can guarantee against. Therefore if you ask for a book replacement from Amazon, we cannot guarantee that the replacement book will be more satisfactory."
Athena Scientific's motto is "A Publisher of Fine Scientific Books". Good one. Not fine with me. I'll sadly have to return those fine books.
Images in this review
FReviewed in Canada on April 10, 20155.0 out of 5 stars Rr
Format: HardcoverVerified PurchaseGreat book needed it for class
































