Syllabuses - PG

CS826 - Deep Learning Theory and Practice

TIMETABLETEACHING MATERIAL
Credits20
Level5
SemesterSemester 1
AvailabilityMandatory
PrerequisitesN/A
Learning Activities BreakdownLectures: 20 hours | Labs: 20 hours
Homework / Private Study: 160
AssessmentOne individual assignment worth 60%, and a class test worth 40%.
LecturerNur Muhamad Naim

Aims and Objectives

The aim of this module is to endow students with:

  • an understanding of the key algorithms and techniques with deep learning.
  • an understanding of the limitations of the current technologies and their future trend.

Learning Outcomes

After completing this module participants will be able to:

  • Understand the challenges in the training of deep neural network and how to overcome the challenges with few shot learning techniques.
  • Understand how to process sequential data with deep neural network and the applications in natural language processing.
  • Develop understanding of the potentials and generalisation of deep neural networks through theoretical analysis.
  • Understand deep generative models and their main approaches.
  • Understand how to build Deep Neural Networks in Python using packages such as PyTorch and implement such networks.

Syllabus

  • Review of fundamentals and basics (neural networks, math).
  • Training models in deep learning with small examples and approaches for lifelong learning (i.e. transfer Learning, metal learning, few shot learning).
  • Attentions and transformers in deep learning, their relations with recurrent neural network, LSTM and GRU, and their applications (e.g. language translation and sentimental analysis).
  • Universal Approximation Theorem, the potentials of deep neural networks, the major challenges in the training and their generalisations.
  • Unsupervised learning and generative models (e.g. flow based models, variational autoencoder and generative adversarial networks, their pros and cons).

Recommended Reading

This list is indicative only – the class lecturer may recommend alternative reading material. Please do not purchase any of the reading material listed below until you have confirmed with the class lecturer that it will be used for this class.

Deep Learning (Adaptive Computation and Machine Learning Series) Hardback by Ian Goodfellow Deep Learning with Python, Chollet, F.

Last updated: 2022-09-09 13:43:33