# Probability 2

## Unit aims

To survey basic models of applied probability and standard methods of analysis of such models.

## Unit description

A wide range of phenomena from areas as diverse as physics, economics and biology can be described by simple probabilistic models. Often, phenomena from different areas share a common mathematical structure. In this course a variety of mathematical structures of wide applicability will be described and analysed. The emphasis will be on developing the tools which are useful to anyone modelling applications, rather than the applications themselves.

Students should have a good knowledge of first year probability and of basic material from first year analysis. As the course builds on Probability 1 it will also deepen students' understanding of the basis of probability theory.

## Relation to other units

This unit develops the probability theory encountered in the first year. It is a prerequisite for the Level H/6 units Introduction to Queuing Networks, Further Topics in Probability 3, Bayesian Modeling and Financial Mathematics, and is relevant to other Level H/6 probabilistic units.

## Learning objectives

At the end of the course the student should should:

- have gained a deeper understanding of and a more sophisticated approach to probability theory than that acquired in the first year
- have learnt standard tools for analysing the properties of a range of model structures within applied probability

## Transferable skills

- construction of probabilistic models
- the translation of practical problems into mathematics
- the ability to integrate a range of mathematical techniques in approaching a problem.

## Syllabus

- Random walks including the gambler's ruin problem and unrestricted random walks. Absorption probabilities, transience and recurrence. The Wald lemma.
- Markov chains. Examples of chains. Chapman-Kolmogorov equations. Classification of states: communicating states, period, transience and recurrence. Mean recurrence times and equilibrium distributions for irreducible aperiodic chains.
- Continuous time Markov processes on discrete state space: theory and examples (Poisson process, Birth and death process).
- Brownian motion: basic theory and properties.
- Introduction to martingales. Statement of the Optional Stopping Theorem and Martingale Convergence Theorem. Applications of these theorems.

## Reading and references

**Recommended**

- Geoffrey Grimmett and David Stirzaker,
*Probability and Random Processes,*OUP, 2001 - Howard M. Taylor, and Samuel Karlin,
*An Introduction to Stochastic Modelling (3rd Ed.),*Academic Press, 1998

**Unit code:** MATH20008

**Level of study:** I/5

**Credit points:** 20

**Teaching block (weeks):** 2 (13-24)

**Lecturers:** To be confirmed.

## Pre-requisites

MATH11005 Linear Algebra and Geometry, MATH10011 Analysis, MATH10013 Probability and Statistics and MATH10012 ODEs, Curves and Dynamics

## Co-requisites

None

## Methods of teaching

Lectures and problems classes. Weekly exercises to be done by the student and handed in for marking.

## Methods of assessment

The pass mark for this unit is 40.

The final mark is calculated as follows:

- 100% Exam

**This exam will consist of five questions. All five questions will be used for assessment.*

NOTE: Calculators are NOT allowed in the examination.

Candidates will be provided with a sheet of notes in the exam.

For information resit arrangements, please see the re-sit page on the intranet.

Please use these links for further information on relative weighting and marking criteria.

Further exam information can be found on the Maths Intranet.