Decision Trees
Definition
A decision tree makes a statement, and then makes a decision based on whether that statement is true or false.
Visual example of a decision tree structure
Types of Decision Trees
Classification Trees
Classifies things into categories. For example, the decision tree shown in the image above categorizes outcomes into distinct groups.
Regression Trees
Decision trees that predict numerical values instead of categories.
Terminology
- Root Node/Root:This is the base of the decision tree. It's where the decision-making process begins.
- Node:This has arrows pointing to and away from it. Essentially a stepping stone to the end.
- Leaf:The final stage in a decision tree. It has arrows pointing to it but not away from it.
- Stump:This is a decision tree with only one node or only a root node.