Wolfgang Viechtbauer

Marginally significant (p = .07)

User Tools

Site Tools


This is an old revision of the document!

Meta-Analysis Course

General Information

Course Dates 27-30 October, 2020
Course Times 16:00 - 22:00 CET (check local time)
Course Location online
Registration Deadline 20 October, 2020
Course Fee 200 Euros

Course Description

Researchers trying to summarize the constantly growing body of research in the social, health, and natural sciences are increasingly using a technique called meta-analysis. Meta-analysis encompasses an entire array of statistical methods for aggregating and comparing the results from related studies in a systematic manner. For example, meta-analysis is frequently used to determine whether a particular treatment or intervention is actually effective overall and whether the effectiveness of the treatment or intervention depends on certain study and/or subject characteristics (so-called moderator variables). The focus of this course will be on current methods and techniques for analyzing meta-analytic data.

We will start out with a short overview of the entire meta-analytic process (consisting of seven steps: problem formulation, literature search, information gathering, quality evaluation, analysis, interpretation of findings, and presentation of results). Next, we will examine how the results from a study can be summarized with various effect size or outcome measures. We will then delve into equal-, fixed-, and random/mixed-effects models for combining the observed outcomes and for examining whether the outcomes depend on one or more moderator variables. The use of so-called meta-regression models will be emphasized in this context. Model diagnostics and methods for sensitivity analyses will be covered as well.

A major problem that may distort the results of a meta-analysis is publication bias (the fact that the published literature may not be representative of all the research that has been conducted on a particular topic). Therefore, current methods for detecting and dealing with publication bias will be discussed next. Finally, time permitting (and depending on the interests of the participants), we will examine missing data issues, sequential/cumulative methods in the context of meta-analysis, meta-analytic techniques using individual subject data, multilevel and multivariate models, methods for dealing with dependent/correlated outcomes, and Bayesian approaches to meta-analysis.

The course consists of a mixture of lectures, hands-on tutorials, and computer exercises to cover not only the theoretical background, but also provide practical experience with analyzing real meta-analytic datasets. Emphasis throughout the course is on the application of the various methods and the interpretation of the results obtained (supplementary references can be provided to those interested in the mathematical/statistical details).

Course Schedule

Note: Given the dynamics of a live and interactive course, this schedule is tentative. Also, while the starting time for each day is definite (i.e., 16:00 my local time), the ending times can vary a bit (I would say +-30 minutes).

Day 1
16:00-16:30 Introduction / Logistics
16:30-18:00 Lecture: Introduction to systematic reviews and meta-analysis
18:00-19:30 Lecture: Outcome and effect size measures for meta-analysis
19:30-20:30 Exercise 1
20:30-22:00 Lecture: The meta-analytic equal- and random-effects models
Day 2
16:00-17:00 Lecture: Meta-analysis with R and the metafor package
17:00-18:00 Exercise 2 (part a)
18:00-19:00 Lecture: Conditional vs. unconditional inferences (equal/fixed/random-effects models)
19:00-20:30 Lecture: Moderator analysis (meta-regression and subgrouping)
20:30-22:00 Exercise 2 (part b)
Day 3
16:00-17:00 Lecture: Quantifying and examining heterogeneity
17:00-18:00 Exercise 2 (part c)
18:00-19:00 Lecture: Model diagnostics (residuals, outliers, influential studies)
19:00-20:00 Exercise 2 (part d)
20:00-21:30 Lecture: Publication bias
21:30-22:30 Exercise 3
Day 4
16:00-16:30 Lecture: Refined tests and CIs for random/mixed-effects models
16:30-18:00 Lecture: Multilevel, multivariate, and network meta-analysis
18:00-19:30 Exercise 4 and/or 5
19:30-21:30 Lecture: A mixed bag of other topics
21:30-22:00 Final Q&A session

Course Prerequisites

In general, all efforts will be made to make the course as self-contained as possible. However, there are a couple things one can do to prepare for the course.

First of all, although all aspects of the entire meta-analytic process will be discussed, emphasis will be placed on the analysis and interpretation step of a meta-analysis. Therefore, a general familiarity with how meta-analyses are conducted will help to provide a better understanding of the course contents (reading a few meta-analyses from one's field of interest would be sufficient to obtain a general impression).

Second, some basic knowledge of statistical methods at the undergraduate level (e.g., regression, analysis of variance, hypothesis testing) will also be beneficial. Also, matrix algebra notation will occasionally be used to present certain equations. However, if you are not familiar with matrix algebra, then this is not a problem. We will use software anyway to carry out the computations and the most important aspect for the applied researcher is the interpretation of the results (which will be covered in much detail).

Finally, the primary software package to be used during the course for the analyses will be R (see below for more details). Although everything that you need to know to do the computer exercises will be explained in the course, it would be useful to familiarize yourself with R a little bit ahead of time (here are some notes on preparing to use R). You could also consider following the Intro to R Course first.

How to Prepare for the Course

The course will be given online via the video conferencing platform / software Zoom. While it is possible to join the course simply via your browser, I would not recommend this (certain features are not available via the 'web client' and the video/audio quality tends to be poorer). Therefore, I would highly recommended to install the Zoom client (which you can get here).

We will conduct a number of practical exercises throughout the course where we make use of the statistical software package R. Therefore, please also download R from the Comprehensive R Archive Network (CRAN). Choose the appropriate "Download R" link depending on your operating system (OS) and follow the instructions for downloading and installing R. If you already have R installed, please check that it is the current version (you can check what the 'latest release' of R is by going to CRAN and then compare this with the version shown when you start R). If you do not have the latest version installed, please update.

Although not strictly necessary, it will be useful to also install an integrated development environment (IDE) for R. A popular choice these days is RStudio. So, unless you already have a different setup, please download the appropriate installer of RStudio for your OS from here and install this in the usual manner.

Once R and RStudio are installed, please also install the metafor package (an add-on for conducting meta-analyses with R). More details about the package can be found at the metafor package website. You should be able to install the package by starting RStudio and then typing install.packages("metafor") into the 'Console'.

Course Registration

To register for the course, please complete the registration form (docx or pdf) and send it by e-mail to:

Jolanda Koch
Department of Psychiatry and Neuropsychology
Maastricht University
P.O. Box 616 (VIJV1)
6200 MD Maastricht
The Netherlands

Tel: +31 (43) 388-3511
E-mail: jolanda.koch (at) maastrichtuniversity.nl

We will notify you upon receipt of the form whether there are still open places for the course. If open places are available, then you can complete your registration by paying the registration fee (as described in the registration form).

Other Things / Notes / FAQs

  • If you would like to test whether you will be able to connect via Zoom and the video / audio quality, I will host a test session on September 30th at 17:00 (check local time). If you would like to participate in this test session, send me an email via wvb (at) wvbauer (dot) com and I will provide you with the login details. You do not need to be registered for the course to participate in this test session (i.e., you can use this test session to check whether things will run smoothly on your end and if so register afterwards).
  • The starting time of the course was chosen so that people from Europe, Africa, and North/South America can participate in the course without having to be up in the middle of the night. My apologies to the people further east of Europe for whom these times are probably not feasible. I will consider starting at a different time the next time I offer the course.
  • In the 'in person' courses that I teach, I often end up troubleshooting some general computer problems for one or multiple course participants. I will not be able to do this in this course. Therefore, make sure you sort out any problems with installing the necessary software ahead of time.
  • The course fee (which is ridiculously low to begin with compared to similar courses) is meant to be paid per person. While I won't take active measures to check if a single person is behind each connection during the course (I rather spend the time talking about the difference between fixed- versus random-effects models), I appeal to your sense of fairness to register individually.
  • The course will not be recorded. By registering, you also agree not to make any recordings of the course on your end.

Miscellaneous Information

Instructional Language English
Min/Max Number of Participants 10/50
Certificate for Participation Upon request
Number of European Credit Points 1
course_ma.1593961914.txt.gz · Last modified: 2020/07/05 15:11 by Wolfgang Viechtbauer