The importance of optimization cannot be overstated in the context of machine learning and deep learning. Most, if not all, of machine learning involves fitting a model to data, a process that involves optimization.
Optimization is a broad research area with many open challenges. Through interactive tutorials, we intend to cover most of the important concepts in constrained and unconstrained optimization.
Before venturing into this article, it is strongly recommended that you are well familiar with the concepts introduced in our previous modules on Linear Algebra and Calculus for machine Learning.