MA409      Half Unit
Continuous Time Optimisation

This information is for the 2021/22 session.

Teacher responsible

Prof Adam Ostoja-Ostaszewski

Availability

This course is available on the MSc in Applicable Mathematics, MSc in Operations Research & Analytics and MSc in Quantitative Methods for Risk Management. This course is available as an outside option to students on other programmes where regulations permit.

Pre-requisites

Students will need adequate background in linear algebra (facility with diagonalization of matrices for the purposes of solving simultaneous first-order differential equations is key here; knowledge of the relation between the range of a matrix transformation and the kernel of its transpose would be helpful), and in advanced calculus (manipulation of Riemann integrals such as `differentiation under the integral’ and the associated Leibniz Rule). Students unsure whether their background is appropriate should seek advice from the lecturer before starting the course. Background revision will be provided in the first two weeks of term.

Course content

This is a course in optimisation theory using the methods of the Calculus of Variations. No specific knowledge of functional analysis will be assumed and the emphasis will be on examples. It introduces key methods of continuous time optimisation in a deterministic context, and later under uncertainty. Calculus of variations and the Euler-Lagrange Equations. Sufficiency conditions. Pontryagin Maximum Principle. Extremal controls. Transversality conditions. Linear time-invariant state equations. Bang-bang control and switching functions. Dynamic programming. Control under uncertainty. Itô's Lemma. Hamilton-Jacobi-Bellman equation. If time allows: Applications to Economics and Finance: Economic Growth models, Consumption and investment, Optimal Abandonment, Black-Scholes model, Singular control, Verification lemma.

Teaching

This course is delivered through a combination of seminars and lectures totalling a minimum of 32 hours across Lent Term and additionally up to 4 hours of revision near the end of Lent Term which might be online. Lectures might be delivered as pre-recorded lecture videos or weekly live online session of at least one hour. Depending on circumstances, seminars might be online

Background review of (i) elementary methods for solving differential equations, and (ii) pertinent linear algebra (diagonalization) will be included in the virtual seminars of Weeks 1 and 2.

This course may have a reading week in LT by arrangement,

Indicative reading

A full set of lecture notes will be provided. Reference will be made to the following essential books: D Burghes & A Graham, Control and Optimal Control Theories with Applications, Horwood; E R Pinch, Optimal Control and the Calculus of Variations, Oxford Science Publications; A. Sasane, Optimization in Function Spaces, Dover; J L Troutman, Variational Calculus and Optimal Control, Springer; and occassionally to: D G Luenberger, Optimization by Vector Space Methods, Wiley.


Further Reading and Advanced Literature: G Leitmann, Calculus of Variations and Optimal Control, Plenum; A K Dixit & R S Pindyck, Investment under Uncertainty, Princeton University Press; D Duffie, Security Markets, Academic Press; D J Bell & D H Jacobsen, Singular Optimal Control, Academic Press; W H Fleming & R W Rishel, Deterministic and Stochastic Optimal Control, Springer; W H Fleming; H M Soner Controlled Markov Processes & Viscosity Solutions, Springer; G Hadley; M C Kemp, Variational Methods in Economics, North Holland; 

Assessment

Exam (100%, duration: 2 hours) in the summer exam period.

In the event of an Online examinations regime, the duration may be amended to include extra time, e.g. for technical preparation of a submission.

Course selection videos

Some departments have produced short videos to introduce their courses. Please refer to the course selection videos index page for further information.

Important information in response to COVID-19

Please note that during 2021/22 academic year some variation to teaching and learning activities may be required to respond to changes in public health advice and/or to account for the differing needs of students in attendance on campus and those who might be studying online. For example, this may involve changes to the mode of teaching delivery and/or the format or weighting of assessments. Changes will only be made if required and students will be notified about any changes to teaching or assessment plans at the earliest opportunity.

Key facts

Department: Mathematics

Total students 2020/21: 24

Average class size 2020/21: 12

Controlled access 2020/21: No

Value: Half Unit

Guidelines for interpreting course guide information

Personal development skills

  • Self-management
  • Problem solving
  • Application of information skills
  • Communication
  • Application of numeracy skills
  • Specialist skills