Deep Learning for Artificial Intelligence

Master Course at Universitat Politècnica de Catalunya (Autumn 2017)

Deep learning technologies are at the core of the current revolution in artificial intelligence for multimedia data analysis. The convergence of large-scale annotated datasets and affordable GPU hardware has allowed the training of neural networks for data analysis tasks which were previously addressed with hand-crafted features. Architectures such as convolutional neural networks, recurrent neural networks or Q-nets for reinforcement learning have shaped a brand new scenario in signal processing. This course will cover the basic principles of deep learning from both an algorithmic and computational perspectives.

Instructors
Syllabus

IMPORTANT: The current version is temptative.

Lectures (click for slides) - Room: D5-010

Course will be divided in modules of one hour covering the following topics (draft):

  • 19/09: Welcome (XG) - Perceptron (XG)
  • 26/09: Multi-Layer Perceptron (ES)
  • 03/10: Basic Layers (ES) - Frameworks (JT)
  • 10/10: Backpropagation (VV) - Software Stack (JT)
  • 17/10: Optimizers (VV) - Computational requirements (JT)
  • 24/10: Loss functions (JR) - Transfer learning (RM)
  • 31/10: Methodology (JR) - Incremental learning (RM)
  • 07/11: Midterm exam -15% (ES)
  • 14/11: RNNs (MRC) - Gated RNNs (MRC)
  • 21/11: Attention models (MRC) - Reinforcement learning (XG)
  • 28/11: Unsupervised learning (XG) - Generative models (SP)
  • 05/12: Holiday
  • 12/12: Project Presentations (XG, MRC, ES)
  • 19/12: Guest lectures: Jose M. Álvarez (Toyota, Mountain View, CA; USA) & Cristian Canton (Facebook, Seattle, WA, USA)
  • ??/01: Final exam -30% (ES)

Labs (15%) - Rooms: D5-004, D5-005 & D5-007

The course will contain guided hands on lab that will lead the students in their first steps in deep learning frameworks. A summary can be found on this site by Prof. Jordi Torres.:

Project (40%) - Rooms: D5-004, D5-005 & D5-007

Students will work in teams to develop a machine learning research project that will be presented both in an oral presentation and as a poster during the final session open to the general public.

  • 26/09: Guidelines for Project (XG)
  • 17/10: Project Proposals (XG)
  • 07/11: Project Development (XG)
  • 14/11: Project Critical Review (XG)
  • 21/11: Project Development (XG)
  • 12/12: Project oral presentations
  • 19/12: Poster presentations (open session)

Students can get inspiration from the following resources:

Practical

Practical details

Registration

Registration

Registration procedure depends on the student profile:

  • Master students at ETSETB and FIB: Follow the regular schedule from your academic office.
  • Mobility students: If your host institution has signed an agreement with UPC ETSETB Telecom BCN school, you can request a mobility from your host institution and sign up for the course under the same conditions as ETSETB students.
  • Students at UPC but not in ETSETB: Contact the your academic office and request being allowed to take this course. If accepted, contact ETSETB academic office and request more details.
  • Non UPC nor mobility students: You must apply for being accepted in the course and cover the 100% cost of the ECTS credits, without the support of the public funds. This corresponds to 143,08 € per ECTS credit (Summer 2016). If you are interested in this option, please contact the ETSETB Telecom BCN academic office, with an e-mail to secretaria@etsetb.upc.edu or calling at 93 405 4174 / 93 401 6772 / 93 401 5966 or 93 401 6750 in the morning (Monday to Thursday from 11 to 14 and Fridays from 11 to 13) or noons (Wednesdays and Thursdays from 16 to 17h).
Open Session

Open Session

(registration required)

This 2017 edition of the course will include invited talks on Tuesday 19 December at 5pm in Aula Master, in street level floor of building A3, in Campus Nord UPC (directions). This session is open to the general public, but attendees will need to register (more info one month before the lecture). The lecture will conclude with a poster session where students will present their projects.

Sponsors

BSC

AWS Educate

GitHub Education

Nvidia

Organizers

ETSETB
ETSETB Telecom BCN

UPC
Universitat Politècnica de Catalunya