Machine Learning

Machine Learning: A Constraint-Based Approach provides readers with a refreshing look at the basic models and algorithms of machine learning, with an emphasis on current topics of interest that includes neural networks and kernel machines.

The book presents the information in a truly unified manner that is based on the notion of learning from environmental constraints. While regarding symbolic knowledge bases as a collection of constraints, the book draws a path towards a deep integration with machine learning that relies on the idea of adopting multivalued logic formalisms, like in fuzzy systems. A special attention is reserved to deep learning, which nicely fits the constrained- based approach followed in this book.

This book presents a simpler unified notion of regularization, which is strictly connected with the parsimony principle, and includes many solved exercises that are classified according to the Donald Knuth ranking of difficulty, which essentially consists of a mix of warm-up exercises that lead to deeper research problems. A software simulator is also included.

• Presents fundamental machine learning concepts, such as neural networks and kernel machines in a unified manner
• Provides in-depth coverage of unsupervised and semi-supervised learning
• Includes a software simulator for kernel machines and learning from constraints that also includes exercises to facilitate learning
• Contains 250 solved examples and exercises chosen particularly for their progression of difficulty from simple to complex

Upper level undergraduate and graduate students taking a machine learning course in computer science departments and professionals involved in relevant areas of artificial intelligence

1. The Big Picture
2. Learning Principles
3. Linear-Threshold Machines
4. Kernel Machines
5. Deep Architectures
6. Learning and Reasoning with Constraints
7. Epilogue
8. Answers to selected exercises

Appendices:

• Constrained optimization in Finite Dimensions
• Regularization operators
• Calculus of variations
• Index to Notations