Introduction to Bayesian statistics

lstat2130  2021-2022  Louvain-la-Neuve

Introduction to Bayesian statistics
4.00 credits
15.0 h + 5.0 h
Main themes
- The Bayesian model: basic principles. - The likelihood function and its a priori specification. - One-parameter models: choice of the a priori distribution, derivation of the a posteriori distribution, summarizing the a posteriori distribution. - Multi-parameter models: choice of the a priori distribution, derivation of the a posteriori distribution, nuisance parameters. Special cases: the multinomial and the multivariate Gaussian models. - Large sample inference and connections with asymptotic frequentist inference. - Bayesian computation.
Learning outcomes

At the end of this learning unit, the student is able to :

1 By the end of the course, the student will be familiar with the principles and the basic techniques in Bayesian statistics. He or she will be able to use and to put forward the advantages and drawbacks of that paradigm in standard problems.
This course is an introduction to Bayesian statistics.
After defining subjective probabilities, the basic principles underlying Bayesian inference are presented through the estimation of a proportion. The same principles are used to compare proportions and rates. The estimation of a mean (variance) in a normal distribution is also studied when the variance (mean) is unknown.
Inference in multiparameter models is also tackled. The concepts of marginal and conditional posterior distributions, credible regions and predictive distributions are defined. It is first illustrated with the joint estimation of the mean and of the variance of a normal distribution. The comparison of two means of a normal distribution with known or unknown variance(s) is also tackled. A solution is obtained with the simulation of a random sample from the joint posterior distribution when the variances cannot be assumed equal. The multiple regression model and the ANOVA I model are also studied in a Bayesian framework.
The basic algorithms enabling to generate a random sample from the posterior distribution are presented as these are fundamental to make inference in complex models.
Teaching methods
The course consists of lectures, supplemented by podcasts available to students on Moodle, and practicals. It is given on a weekly basis and is spread over 11 weeks from the beginning of the 2nd term.
Evaluation methods
The assessment of this course will combine a written exam (on 15 points) and a project (on 5 points). This project will take the form of a written report submitted by each student before the beginning of the 1st exam session, without the possibility to submit it later on. However, the mark obtained for this work will be used in the same way during the two sessions to calculate the final mark.
Other information
Prerequisites: It is assumed that students have a basic background in probability theory, statistical inference and the use of R software.
Online resources
Slides and podcasts are available to students on Moodle
Gelman, A., Carlin, J.B., Stern, H.S., Dunson, D.B., Vehtari, A. and Rubin, D.B. (2013,3nd edition) Bayesian Data Analysis. Chapman and Hall - CRC Press.
Bolstad, W.M. and J.M. Curran (2016) Introduction to Bayesian Statistics. Wiley.
Faculty or entity

Programmes / formations proposant cette unité d'enseignement (UE)

Title of the programme
Learning outcomes
Master [120] in Statistics: General

Master [120] in Data Science Engineering

Master [120] in Mathematics

Master [120] in Data Science: Information Technology

Master [120] in Statistics: Biostatistics

Master [120] in Biomedical Engineering

Approfondissement en statistique et sciences des données

Master [120] in Economics: General

Certificat d'université : Statistique et sciences des données (15/30 crédits)

Master [120] in Mathematical Engineering

Master [120] in Data Science : Statistic