| Unit name | Information Theory 3 |
|---|---|
| Unit code | MATH34600 |
| Credit points | 10 |
| Level of study | H/6 |
| Teaching block(s) |
Teaching Block 1B (weeks 7 - 12) |
| Unit director | Dr. Wiesner |
| Open unit status | Not open |
| Pre-requisites |
MATH11300 Probability 1 OR Level 2 Physics ( MATH 11400 Statistics 1 is helpful, but not necessary) |
| Co-requisites |
None |
| School/department | School of Mathematics |
| Faculty | Faculty of Science |
Unit aims
To give a rigorous and modern introduction into Shannon's theory of information, with emphasis on fundamental concepts and mathematical techniques.
General Description of the Unit
Shannon's information theory is one of the great intellectual achievements of the 20th century, which half a century after its conception continues to inspire communications engineering and to generate challenging mathematical problems. Recently it has extended dramatically into physics as quantum information theory. The course is about the fundamental ideas of this theory: data compression, communication via channels, error correcting codes, and simulations.
It is a statistical theory, so notions of probability play a great role, and in particular laws of large numbers as well as the concept of entropy are fundamental (and will be discussed in the course). The course contains a discussion of two models of data compression, leading to entropy as the crucial quantity; an introduction to noisy channels and error correcting codes, culminating in Shannon's channel coding theorem; the "reverse Shannon theorem" for noisy channels and rate-distortion coding; information theoretical hypothesis testing - theory of identification.
The course aims at demonstrating information theoretical modelling, and the mathematical techniques required will be rigorously developed.
It is a natural companion to the Quantum Information course offered in Mathematics (MATH M5610), and to a certain degree to Cryptography B (COMSM 0007), offered in Computer Science, and Communications (EENG 22000), in Electrical Engineering. It may also be interesting to physicists having attended Statistical Physics (PHYS 30300).
Relation to Other Units
The probabilistic nature of the problems considered and of the mathematical modellings in information theory relates this unit to the probability and statistics units at Levels 4, 5 and 6. It is very much suited as a companion to the Quantum Information unit.
Related courses in Computer Science: Cryptography B, in Electrical Engineering: Communications, and in Physics: Statistical Physics.
Additional unit information can be found at http://www.maths.bristol.ac.uk/study/undergrad/current_units/index.html
This unit should enable students to:
Transferable skills:
Mathematical - Knowledge of basic information theory; probabilistic reasoning.
General skills - Modelling, problem solving and logical analysis Assimilation and use of complex and novel ideas
Lectures. Exercises to be done by students, problem classes.
100% Examination.
Raw scores on the examinations will be determined according to the marking scheme written on the examination paper. The marking scheme, indicating the maximum score per question, is a guide to the relative weighting of the questions. Raw scores are moderated as described in the Undergraduate Handbook.
Reading and references are available at http://www.maths.bristol.ac.uk/study/undergrad/current_units/index.html
