logo Insalogo Insa

Summer school in Applied Mathematics

Title: Optimization for Machine Learning

Duration: 1 week (20-30h courses)

Date: May, 14th -18th, 2018

Location : Campus of INSA de Toulouse

ECTS credits: 2 to 3



Description : The aim of this series of Lectures is to provide the basic background for dealing with Optimization issues in deterministic and stochastic environment. More specifically, we address the main features of smooth optimization algorithms with and without constraints: in addition to the theoretical material, we describe deterministic and stochastic gradient algorithms, Newton-type algorithms, least square algorithms. This part will be completed by an introduction to nonsmooth optimization algorithms (sub gradient algorithms and proximal algorithms). All these optimization algorithms will be implemented during practice classes with application to image processing. The second part of the Lectures will be devoted to actual Statistical issues related to Machine Learning. 


Contents :  

[1]   Optimality conditions

[2]   Algorithms for differentiable optimization without constraints

  1. Gradient algorithms
  2. Stochastic gradient algorithm
  3. Newton-type algorithms
  4. d.         Least squares issues

[3]   First algorithms for nondifferentiable optimization

  1. a.         LASSO, proximal algorithm.

[4]   Introduction to Statistical Learning: Ridge Regression, Lasso, Support Vector Machines

[5]   Imaging applications: image registration, compressive sampling, dictionary training, ...


Registration fees : 400€/week

Contact : summer-school @ insa-toulouse.fr
Special partners have to contact
summer-school @ insa-toulouse.fr before registration


Registration (Deadline registration : March 18th, 2018)