Overview of the Cost Function

A detailed tutorial on the cost function. Step by step tutorial including several examples of the cost function for reference.

The cost function is a name for a function that is being used in optimization. It is a very important part of an optimization problem. The cost function can be any graph, because all it refers to is the function – the function could be different every time, and it could still be called the cost function. What we learn from this is that the cost function is not unique.