Dynamic Programming and Its Applications - 1st Edition - ISBN: 9780125681506, 9781483258942

Dynamic Programming and Its Applications

1st Edition

Proceedings of the International Conference on Dynamic Programming and Its Applications, University of British Columbia, Vancouver, British Columbia, Canada, April 14-16, 1977

Editors: Martin L. Puterman
eBook ISBN: 9781483258942
Imprint: Academic Press
Published Date: 1st January 1978
Page Count: 426
Sales tax will be calculated at check-out Price includes VAT/GST
25% off
25% off
25% off
25% off
25% off
20% off
20% off
25% off
25% off
25% off
25% off
25% off
20% off
20% off
25% off
25% off
25% off
25% off
25% off
20% off
20% off
54.95
41.21
41.21
41.21
41.21
41.21
43.96
43.96
72.95
54.71
54.71
54.71
54.71
54.71
58.36
58.36
43.99
32.99
32.99
32.99
32.99
32.99
35.19
35.19
Unavailable
Price includes VAT/GST
× DRM-Free

Easy - Download and start reading immediately. There’s no activation process to access eBooks; all eBooks are fully searchable, and enabled for copying, pasting, and printing.

Flexible - Read on multiple operating systems and devices. Easily read eBooks on smart phones, computers, or any eBook readers, including Kindle.

Open - Buy once, receive and download all available eBook formats, including PDF, EPUB, and Mobi (for Kindle).

Institutional Access

Secure Checkout

Personal information is secured with SSL technology.

Free Shipping

Free global shipping
No minimum order.

Description

Dynamic Programming and Its Applications provides information pertinent to the theory and application of dynamic programming. This book presents the development and future directions for dynamic programming.

Organized into four parts encompassing 23 chapters, this book begins with an overview of recurrence conditions for countable state Markov decision problems, which ensure that the optimal average reward exists and satisfies the functional equation of dynamic programming. This text then provides an extensive analysis of the theory of successive approximation for Markov decision problems. Other chapters consider the computational methods for deterministic, finite horizon problems, and present a unified and insightful presentation of several foundational questions. This book discusses as well the relationship between policy iteration and Newton's method. The final chapter deals with the main factors severely limiting the application of dynamic programming in practice.

This book is a valuable resource for growth theorists, economists, biologists, mathematicians, and applied management scientists.

Table of Contents


Contributors

Preface

Surveys

Recurrence Conditions in Denumerable State Markov Decision Processes

Discounted and Undiscounted Value-Iteration in Markov Decision Problems: A Survey

Computational Advances in Dynamic Programming

The Analytic Theory of Policy Iteration

Dynamic Programming in Borei Spaces

Elimination of Nonoptimal Actions in Markov Decision Processes

Applications

On Renewal Decisions

Steady-State Policies, Dynamic Programming, and Optimal Economic Growth

Comments on the Origin and Application of Markov Decision Processes

The Application of Markov Decision Processes to Forest Management

An Application of Dynamic Programming in Statistics

Some Dynamic Programming Applications in Fisheries Management

Theory

Buckets, Shortest Paths, and Integer Programming

Affine Dynamic Programming

Optimal Control of a Diffusion Process with Reflecting Boundaries and both Continous and Lump Costs

On Approximate Solutions of Finite-Stage Dynamic Programs

An Inverse Theorem between Main and Inverse Dynamic Programming: Infinite-Stage Case

On the Transient Case for Markov Decision Chains with General State Spaces

An Operator-Theoretical Treatment of Negative Dynamic Programming

Existence of Average Optimal Strategies in Markovian Decision Problems with Strictly Unbounded Costs

International Conference on Dynamic Programming: Panel Discussion

Comments Of Karl Hinderer

Comments Of Eric V. Denardo

Comments Of Arthur F. Veinott, Jr.

Participants

Details

No. of pages:
426
Language:
English
Copyright:
© Academic Press 1978
Published:
Imprint:
Academic Press
eBook ISBN:
9781483258942

About the Editor

Martin L. Puterman

Ratings and Reviews