Resources for stochastic differential equation mixed-effects models

[tl;dr here is a collection of resources for SDEMEMs]

Mixed-effects models (MEM) are hierarchical models suited for “population inference”, where instead of fitting data from a single experiment, we are interested in learning characteristics common to runs of the same experiment. As an example, we could have data from subjects, and we wish to fit them all together, not separately. This way we learn something at the “population” level, using a statistical model that explicitly takes into account variation from several streams of data. Mixed-effects models are particularly relevant for repeated measurements data.

In MEM, individual experiments (e.g. “subjects”) are modeled by introducing some set of parameters (), which vary randomly between experiments according to a probability distribution, say , depending on some unknown parameter . Here is common to all , hence common to all subjects. Therefore is a “random effect”, and is a “population parameter”. Both and may be vectors. Then there could be other unknown parameters which are not random effects, and we call those .

So we have mixed-effects, as some parameters vary randomly between subjects (, ) and others are common to all subjects ( and ).

Example:

where is the -th measurement recorded on subject (), may be corresponding fixed covariates or even an unobserved  stochastic process, and is some function. Finally is residual variation (measurement error), for example Gaussian error .

When the result from discrete observations of a diffusion process , which is a continuous-time Markov process solution to the stochastic differential equation (SDE) for subject

then we have obtained a stochastic differential equation mixed-effects model (SDEMEM). Some papers consider SDEMEMs written as (2) (no measurement error) others consider it as the system (1)-(2).

This is a powerful class of models, since we can simultaneously consider three sources of variability: (i) variation between subjects: by estimating the parameter underlying the distribution of the individual random effects ; (ii) intrinsic individual stochastic variation, encoded within the “diffusion coefficient” ; (iii) measurement error variation (if (1) is considered). Therefore SDEMEMs enable us to learn characteristics common to all subjects (i.e. “population estimation”), while also taking into account individual systemic (intrinsic) variation and measurement error.

Now,  inference for SDEMEMs is not trivial at all, essentially because inference for SDEs based on discrete observations can be quite tricky. However some literature is available, and the motivation for writing this post is to make reasearchers aware of a collection of resources  for SDEMEMs I have set up.

Please contact me to help with the list, if you find some reference is missing.

 

Advertisement