Data Mining: Practical Machine Learning Tools and Techniques

3rd Edition

Authors: Ian Witten Eibe Frank Mark Hall
Paperback ISBN: 9780123748560
eBook ISBN: 9780080890364
Imprint: Morgan Kaufmann
Published Date: 6th January 2011
Page Count: 664
Tax/VAT will be calculated at check-out
Compatible Not compatible
VitalSource PC, Mac, iPhone & iPad Amazon Kindle eReader
ePub & PDF Apple & PC desktop. Mobile devices (Apple & Android) Amazon Kindle eReader
Mobi Amazon Kindle eReader Anything else

Institutional Access


Data Mining: Practical Machine Learning Tools and Techniques offers a thorough grounding in machine learning concepts as well as practical advice on applying machine learning tools and techniques in real-world data mining situations. This highly anticipated third edition of the most acclaimed work on data mining and machine learning will teach you everything you need to know about preparing inputs, interpreting outputs, evaluating results, and the algorithmic methods at the heart of successful data mining.

Thorough updates reflect the technical changes and modernizations that have taken place in the field since the last edition, including new material on Data Transformations, Ensemble Learning, Massive Data Sets, Multi-instance Learning, plus a new version of the popular Weka machine learning software developed by the authors. Witten, Frank, and Hall include both tried-and-true techniques of today as well as methods at the leading edge of contemporary research.

Key Features

Provides a thorough grounding in machine learning concepts as well as practical advice on applying the tools and techniques to your data mining projects
Offers concrete tips and techniques for performance improvement that work by transforming the input or output in machine learning methods
*Includes downloadable Weka software toolkit, a collection of machine learning algorithms for data mining tasks—in an updated, interactive interface. Algorithms in toolkit cover: data pre-processing, classification, regression, clustering, association rules, visualization


Information systems practitioners, programmers, consultants, developers, information technology managers, specification writers, data analysts, data modelers, database R&D professionals, data warehouse engineers, data mining professionals, as well as professors and students of upper-level undergraduate and graduate-level data mining and machine learning courses who want to incorporate data mining as part of their data management knowledge base and expertise.

Table of Contents

  • PART I. Introduction to Data Mining
    • CHAPTER 1. What’s It All About?
      • 1.1. Data mining and machine learning
      • 1.2. Simple examples: the weather and other problems
      • 1.3. Fielded applications
      • 1.4. Machine learning and statistics
      • 1.5. Generalization as search
      • 1.6. Data mining and ethics
      • 1.7. Further reading

    • CHAPTER 2. Input
      • 2.1. What’s a concept?
      • 2.2. What’s in an example?
      • 2.3. What’s in an attribute?
      • 2.4. Preparing the input
      • 2.5. Further reading

    • CHAPTER 3. Output
      • 3.1. Tables
      • 3.2. Linear models
      • 3.3. Trees
      • 3.4. Rules
      • 3.5. Instance-based representation
      • 3.6. Clusters
      • 3.7. Further Reading

    • CHAPTER 4. Algorithms
      • 4.1. InFerring rudimentary rules
      • 4.2. Statistical modeling
      • 4.3. Divide-and-conquer: constructing decision trees
      • 4.4. Covering algorithms: constructing rules
      • 4.5. Mining association rules
      • 4.6. Linear models
      • 4.7. Instance-based learning
      • 4.8. Clustering
      • 4.9. Multi-instance learning
      • 4.10. Further reading
      • 4.11. Weka implementations

    • CHAPTER 5. Credibility
      • 5.1. Training and testing
      • 5.2. Predicting performance
      • 5.3. Cross-validation
      • 5.4. Other estimates
      • 5.5. Comparing data mining schemes
      • 5.6. Predicting probabilities
      • 5.7. Counting the cost
      • 5.8. Evaluating numeric prediction
      • 5.9. Minimum description length principle
      • 5.10. Applying the MDL principle to clustering
      • 5.11. Further reading

  • PART II. Advanced Data Mining


No. of pages:
© Morgan Kaufmann 2011
Morgan Kaufmann
eBook ISBN:
Paperback ISBN:

About the Author

Ian Witten

Ian H. Witten is a professor of computer science at the University of Waikato in New Zealand. He directs the New Zealand Digital Library research project. His research interests include information retrieval, machine learning, text compression, and programming by demonstration. He received an MA in Mathematics from Cambridge University, England; an MSc in Computer Science from the University of Calgary, Canada; and a PhD in Electrical Engineering from Essex University, England. He is a fellow of the ACM and of the Royal Society of New Zealand. He has published widely on digital libraries, machine learning, text compression, hypertext, speech synthesis and signal processing, and computer typography. He has written several books, the latest being Managing Gigabytes (1999) and Data Mining (2000), both from Morgan Kaufmann.

Affiliations and Expertise

Professor, Computer Science Department, University of Waikato, New Zealand.

Eibe Frank

Eibe Frank lives in New Zealand with his Samoan spouse and two lovely boys, but originally hails from Germany, where he received his first degree in computer science from the University of Karlsruhe. He moved to New Zealand to pursue his Ph.D. in machine learning under the supervision of Ian H. Witten, and joined the Department of Computer Science at the University of Waikato as a lecturer on completion of his studies. He is now an associate professor at the same institution. As an early adopter of the Java programming language, he laid the groundwork for the Weka software described in this book. He has contributed a number of publications on machine learning and data mining to the literature and has refereed for many conferences and journals in these areas.>

Affiliations and Expertise

Associate Professor, Department of Computer Science, University of Waikato, Hamilton, New Zealand

Mark Hall

Mark A. Hall holds a bachelor’s degree in computing and mathematical sciences and a Ph.D. in computer science, both from the University of Waikato. Throughout his time at Waikato, as a student and lecturer in computer science and more recently as a software developer and data mining consultant for Pentaho, an open-source business intelligence software company, Mark has been a core contributor to the Weka software described in this book. He has published a number of articles on machine learning and data mining and has refereed for conferences and journals in these areas.

Affiliations and Expertise

Honorary Research Associate, Computer Science Department, University of Waikato, New Zealand


"...offers a thorough grounding in machine learning concepts as well as practical advice on applying machine learning tools and techniques in real-world data mining situations."

"Co-author Witten is the author of other well-known books on data mining, and he and his co-authors of this book excel in statistics, computer science, and mathematics. Their in- depth backgrounds and insights are the strengths that have permitted them to avoid heavy mathematical derivations in explaining machine learning algorithms so they can help readers from different fields understand algorithms. I strongly recommend this book to all newcomers to data mining, especially to those who wish to understand the fundamentals of machine learning algorithms."--INFORMS Journal of Computing

"The third edition of this practical guide to machine learning and data mining is fully updated to account for technological advances since its previous printing in 2005 and is now even more closely aligned with the use of the Weka open source machine learning, data mining and data modeling application. Beginning with an introduction to data mining, the volume explores basic inputs, outputs and algorithms, the implementation of machine learning schemes and in-depth exploration of the many uses of the Weka data analysis software. Numerous illustration, tables and equations are included throughout and additional resources are available through a companion website. Witten, Frank and Hall are academics with the department of computer science at the University of Waikato, New Zealand, the home of the Weka software project."--Book News, Reference & Research

"I would recommend this book to anyone who is getting started in either data mining or machine learning and wants to learn how the fundamental algorithms work. I liked that the book slowly teaches you the different algorithms piece by piece and that there are also a lot of examples. I plan on taking