Skip to main content
 

COMP3547: DEEP LEARNING

Please ensure you check the module availability box for each module outline, as not all modules will run in each academic year. Each module description relates to the year indicated in the module availability box, and this may change from year to year, due to, for example: changing staff expertise, disciplinary developments, the requirements of external bodies and partners, and student feedback. Current modules are subject to change in light of the ongoing disruption caused by Covid-19.

Type Open
Level 3
Credits 10
Availability Available in 2023/24
Module Cap None.
Location Durham
Department Computer Science

Prerequisites

  • (COMP2261 Artificial Intelligence AND COMP2271 Data Science)

Corequisites

  • None

Excluded Combinations of Modules

  • None

Aims

  • To enable students to be able to approach complex ill-defined problems that require deep layers of learning, and understand how this relates to learning in nature.
  • To equip students with the ability to use modern deep learning libraries in order to effectively design, train, and test neural networks in different applications.

Content

  • Foundations of deep learning and learning in nature
  • PyTorch programming
  • Designing deep neural network architectures
  • Adversarial models
  • Energy-based models and Flow models
  • Sequential models and Transformers
  • Implicit representations
  • Generalisation theory
  • Meta and manifold learning

Learning Outcomes

Subject-specific Knowledge:

  • On completion of the module, students will be able to demonstrate:
  • an understanding of state-of-the-art deep neural network architectures and neural network architecture components.
  • an understanding of statistical learning theory with deep learning approaches.
  • an understanding of the algorithms and approaches to design and evaluate deep neural networks.

Subject-specific Skills:

  • On completion of the module, students will be able to demonstrate:
  • an ability to use modern deep learning libraries to design, train, validate and test deep neural networks.
  • an ability to design neural networks with respect to the task or dataset.
  • an ability to identify inherent issues in dataset bias prior to training or architecture design.

Key Skills:

  • On completion of the module, students will be able to demonstrate:
  • the scientific approach to design, training, validation, and testing of deep neural networks in a broad range of applications.
  • an ability to learn, understand, and visualise the underlying structure of datasets.
  • an ability to design and implement state-of-the-art generative models and bespoke deep neural network architectures.

Modes of Teaching, Learning and Assessment and how these contribute to the learning outcomes of the module

  • Lectures enable the students to learn new material relevant to deep learning, manifold learning and meta learning as well as their applications.
  • Practicals enable students to acquire necessary coding skills, learn about the relevant libraries and packages and receive feedback on their work.
  • Summative assessments assess the knowledge of deep learning libraries and application of methods and techniques.

Teaching Methods and Learning Hours

ActivityNumberFrequencyDurationTotalMonitored
lectures101 per week1 hour10 
practicals101 per week1 hour10 
preparation and reading80 
total100 

Summative Assessment

Component: CourseworkComponent Weighting: 100%
ElementLength / DurationElement WeightingResit Opportunity
Summative Assignment100No

Formative Assessment

Example formative exercises are given during the course. The first few lab practicals are specifically dedicated to formative assignments aimed at familiarising students with state-of-the-art deep learning packages and libraries. Feedback will be provided to the students on the summative assignments and lecture materials during the practicals. Additional revision lectures may be arranged in the module's lecture slots in the 3rd term.

More information

If you have a question about Durham's modular degree programmes, please visit our FAQ webpages, Help page or our glossary of terms. If you have a question about modular programmes that is not covered by the FAQ, or a query about the on-line Undergraduate Module Handbook, please contact us.

Prospective Students: If you have a query about a specific module or degree programme, please Ask Us.

Current Students: Please contact your department.