Description

This is the first comprehensive introduction to computational learning theory. The author's uniform presentation of fundamental results and their applications offers AI researchers a theoretical perspective on the problems they study. The book presents tools for the analysis of probabilistic models of learning, tools that crisply classify what is and is not efficiently learnable. After a general introduction to Valiant's PAC paradigm and the important notion of the Vapnik-Chervonenkis dimension, the author explores specific topics such as finite automata and neural networks. The presentation is intended for a broad audience--the author's ability to motivate and pace discussions for beginners has been praised by reviewers. Each chapter contains numerous examples and exercises, as well as a useful summary of important results. An excellent introduction to the area, suitable either for a first course, or as a component in general machine learning and advanced AI courses. Also an important reference for AI researchers.

Table of Contents

Machine Learning: A Theoretical Approach
Balas K. Natarajan
  • Chapter 1 Introduction
    • 1.1 Bibliographic Notes
  • Chapter 2 Learning Concept on Countable Domains
    • 2.1 Preliminaries
    • 2.2 Sample Complexity
    • 2.3 Dimension and Learnability
    • 2.4 Learning Concepts with One-Sided Error
    • 2.5 Summary
    • 2.6 Appendix
    • 2.7 Exercises
    • 2.8 Bibliographic Notes
  • Chapter 3 Time Complexity of Concept Learning
    • 3.1 Preliminaries
    • 3.2 Polynomial-Time Learnability
    • 3.3 Occam's Razor
    • 3.4 One-Sided Error
    • 3.5 Hardness Results
    • 3.6 Summary
    • 3.7 Appendix
      • 3.7.1 Randomized Algorithms
      • 3.7.2 Chabyshev's Inequality
    • 3.8 Exercises
    • 3.9 Bibliographic Notes
  • Chapter 4 Learning Concepts on Uncoutable Domains
    • 4.1 Preliminaries
    • 4.2 Uniform Convergence and Learnability
    • 4.3 Summary
    • 4.4 Appendix
      • 4.4.1 Measurability and Probability Distributions
      • 4.4.2 Bounds for the Binomial Distribution
    • 4.5 Exercises
  • Chapter 5 Learning Functions
    • 5.1 Learning Functions on Countable Domains
      • 5.1.1 Dimension and Learnability
      • 5.1.2 Time Complexity of Function Learning
    • 5.2 Lear

Details

No. of pages:
217
Language:
English
Copyright:
© 1991
Published:
Imprint:
Morgan Kaufmann
eBook ISBN:
9780080510538
Print ISBN:
9781558601482
Print ISBN:
9781493305858

About the author

Reviews

This is the first comprehensive introduction to computational learning theory. The author's uniform presentation of fundamental results and their applications offers AI researchers a theoretical perspective on the problems they study. The book presents tools for the analysis of probabilistic models of learning, tools that crisply classify what is and is not efficiently learnable. After a general introduction to Valiant's PAC paradigm and the important notion of the Vapnik-Chervonenkis dimension, the author explores specific topics such as finite automata and neural networks. The presentation is intended for a broad audience--the author's ability to motivate and pace discussions for beginners has been praised by reviewers. Each chapter contains numerous examples and exercises, as well as a useful summary of important results. An excellent introduction to the area, suitable either for a first course, or as a component in general machine learning and advanced AI courses. Also an important reference for AI researchers.