Decision Boundary is a problem of classifying a set to two classes. It divides the examples into two classes, all the points on one side of the boundary are classified as class A and all the points from the other side of the boundary are classified as class B. In the illustration below, the separating line is a decision boundary.