Optimization Techniques in Statistics

Optimization Techniques in Statistics

1st Edition - April 25, 1994

Write a review

  • Author: Jagdish Rustagi
  • eBook ISBN: 9781483295718

Purchase options

Purchase options
DRM-free (PDF)
Sales tax will be calculated at check-out

Institutional Subscription

Free Global Shipping
No minimum order


Statistics help guide us to optimal decisions under uncertainty. A large variety of statistical problems are essentially solutions to optimization problems. The mathematical techniques of optimization are fundamentalto statistical theory and practice. In this book, Jagdish Rustagi provides full-spectrum coverage of these methods, ranging from classical optimization and Lagrange multipliers, to numerical techniques using gradients or direct search, to linear, nonlinear, and dynamic programming using the Kuhn-Tucker conditions or the Pontryagin maximal principle. Variational methods and optimization in function spaces are also discussed, as are stochastic optimization in simulation, including annealing methods. The text features numerous applications, including:Finding maximum likelihood estimatesMarkov decision processesProgramming methods used to optimize monitoring of patients in hospitalsDerivation of the Neyman-Pearson lemmaThe search for optimal designsSimulation of a steel millSuitable as both a reference and a text, this book will be of interest to advanced undergraduate or beginning graduate students in statistics, operations research, management and engineering sciences, and related fields. Most of the material can be covered in one semester by students with a basic background in probability and statistics.

Key Features

  • Covers optimization from traditional methods to recent developments such as Karmarkars algorithm and simulated annealing
  • Develops a wide range of statistical techniques in the unified context of optimization
  • Discusses applications such as optimizing monitoring of patients and simulating steel mill operations
  • Treats numerical methods and applications
  • Includes exercises and references for each chapter
  • Covers topics such as linear, nonlinear, and dynamic programming, variational methods, and stochastic optimization


Researchers, practitioners, and students in applied statistics and operations research; advanced undergraduate and graduate level courses in these areas

Table of Contents

  • Synopsis: Classical Optimization Techniques. Optimization and Inequalities. Numerical Methods of Optimization. Linear Programming Techniques. Nonlinear Programming Techniques. Dynamic Programming Methods. Variational Methods. Stochastic Approximation Procedures. Optimization in Simulation. Optimization in Function Spaces. Classical Optimization Techniques: Preliminaries. Necessary and Sufficient Conditions for an Extremum. Constrained Optimization--Lagrange Multipliers. Statistical Applications. Optimization and Inequalities: Classical Inequalities. Matrix Inequalities. Applications. Numerical Methods of Optimization: Numerical Evaluation of Roots of Equations. Direct Search Methods. Gradient Methods. Convergence of Numerical Procedures. Nonlinear Regression and Other Statistical Algorithms. Linear Programming Techniques: Linear Programming Problem. Standard Form of the Linear Programming Problem. Simplex Method. Karmarkar's Algorithm. Zero-Sum TwoPerson Finite-Games and Linear Programming. Integer Programming. Statistical Applications. Nonlinear Programming Methods: Statistical Examples. Kuhn-Tucker Conditions. Quadratic Programming. Convex Programming. Applications. Statistical Control ofOptimization. Stochastic Programming. Geometric Programming. Dynamic Programming Methods: Regulation and Control. Functional Equation and Principles of Optimality. Dynamic Programming and Approximation. Patient Care through Dynamic Programming. Pontryagin Maximum Principle. Miscellaneous Applications. Variational Methods: Statistical Applications. Euler-Lagrange Equations. Neyman-Pearson Technique. Robust Statistics and Variational Methods. Penalized Maximum Likelihood Estimates. StochasticApproximation Procedures: Robbins-Monro Procedure. General Case. Kiefer-Wolfowitz Procedure. Applications. Stochastic Approximation and Filtering. Optimization in Simulation: Optimization Criteria. Optimality of Regression Experiments. ResponseSurface Methods. Miscellaneous Stochastic Methods. Application. Optimization in Function Spaces: Preliminaries. Optimization Results. Splines in Statistics. Chapter Exercises. Bibliography. Author Index. Subject Index.

Product details

  • No. of pages: 359
  • Language: English
  • Copyright: © Academic Press 1994
  • Published: April 25, 1994
  • Imprint: Academic Press
  • eBook ISBN: 9781483295718

About the Author

Jagdish Rustagi

Affiliations and Expertise

The Ohio State University

Ratings and Reviews

Write a review

There are currently no reviews for "Optimization Techniques in Statistics"