Skip to main content

Unit information: Information Theory and Coding in 2024/25

Please note: Programme and unit information may change as the relevant academic field develops. We may also make changes to the structure of programmes and assessments to improve the student experience.

Unit name Information Theory and Coding
Unit code EEMEM0012
Credit points 20
Level of study M/7
Teaching block(s) Teaching Block 1 (weeks 1 - 12)
Unit director Professor. Piechocki
Open unit status Not open
Units you must take before you take this one (pre-requisite units)

None

Units you must take alongside this one (co-requisite units)

None

Units you may not take alongside this one

None

School/department School of Electrical, Electronic and Mechanical Engineering
Faculty Faculty of Engineering

Unit Information

Why is this unit important?

In this unit, we will investigate the fundamental limits of communications and error correction techniques. The role of error correction techniques is to enable reliable communication over inherently unreliable channels. They involve adding suitably constructed redundancy at the transmitter so that the signal is more resilient against possible errors in the channel. Such redundancy in the message description is then used at the receiver to recover the original message. Error-correcting techniques are so important that all modern digital communication systems rely on them. In fact, the very existence of digital transmission and storage systems is contingent on error control coding. This knowledge will not only enhance your technical prowess but also provide a competitive edge in the rapidly evolving landscape of data-enabled engineering and technology.

How does this unit fit into your programme of study

For the communications suite of MSc programmes, this unit is mandatory. It provides grounding in the core concepts of modern digital communication and data systems. It also provides a framework that allows students to logically approach problems related to uncertainty and decision making in information and communication systems and devise reliable solutions under uncertain conditions. The unit is also offered as an option to MEng students in their final year to equip them to move into areas related to digital information transfer.

Your learning on this unit

An overview of content

This unit will cover fundamental concepts in information theory and coding theory including:

  • Principles of information and uncertainty quantification
  • Fundamental limits of communication;
  • Shannon channel capacity;
  • Information storage codes;
  • Sparse graph codes (LDPC / Turbo Codes);
  • Maximum likelihood detection;
  • Belief propagation.

How will students, personally, be different as a result of the unit

After engaging with this unit, students will emerge with a robust understanding of the fundamentals of modern communication systems, refined problem-solving skills for tackling detection in the presence of uncertainty, and a competitive edge in technology sectors. They will gain practical skills in ensuring data integrity and minimising transmission errors, they will understand and appreciate the fundamental limits of communication, and they will be able to apply this knowledge to innovations across various disciplines. This transformative experience will make them adept at designing efficient and reliable digital communication systems.

Learning Outcomes

  1. Compute the fundamental limits of information transfer and data storage.
  2. Describe the details and challenges of fundamental concepts of information and coding theory.
  3. Implement, analyse or numerically evaluate a range of error correcting and error detecting schemes, encoders and decoders.

How you will learn

The unit will have a blended learning approach incorporating a combination of synchronous and asynchronous lectures, seminars, and practical classes, as well as several self-directed exercises. Several series of short lectures with related design problems (in some cases requiring practical realisation) will be used to integrate the various aspects of core knowledge being taught as well as practice in the relevant design and build processes.

How you will be assessed

Tasks which help you learn and prepare you for summative tasks (formative):

You will be given regular practical programming problems that will enable you to gain feedback on your learning within this unit. There will also be formative coursework including annotated programmes and scripts, which will also contribute to preparing you for the unit’s summative assessment.

Tasks which count towards your unit mark (summative):

The unit will be assessed by a single exam. The exam will assess all Learning Outcomes.

When assessment does not go to plan

Re-assessment takes the same form as the original summative assessment.

Resources

If this unit has a Resource List, you will normally find a link to it in the Blackboard area for the unit. Sometimes there will be a separate link for each weekly topic.

If you are unable to access a list through Blackboard, you can also find it via the Resource Lists homepage. Search for the list by the unit name or code (e.g. EEMEM0012).

How much time the unit requires
Each credit equates to 10 hours of total student input. For example a 20 credit unit will take you 200 hours of study to complete. Your total learning time is made up of contact time, directed learning tasks, independent learning and assessment activity.

See the University Workload statement relating to this unit for more information.

Assessment
The Board of Examiners will consider all cases where students have failed or not completed the assessments required for credit. The Board considers each student's outcomes across all the units which contribute to each year's programme of study. For appropriate assessments, if you have self-certificated your absence, you will normally be required to complete it the next time it runs (for assessments at the end of TB1 and TB2 this is usually in the next re-assessment period).
The Board of Examiners will take into account any exceptional circumstances and operates within the Regulations and Code of Practice for Taught Programmes.

Feedback