Cost Function is a mechanism utilized in supervised machine learning. The cost function returns the error between predicted outcomes and actual outcomes. The aim of supervised machine learning is to minimize the overall cost, thus optimizing the correlation of the model to the system it attempts to represent.
Next: Kernel