| Title: | Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy |
|---|---|
| Description: | Tools for Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy (MAIHDA) for intersectional inequality research. Methods are described in Merlo (2018) <doi:10.1016/j.socscimed.2017.12.026> and Evans et al. (2018) <doi:10.1016/j.socscimed.2017.11.011>. The package creates intersectional strata, fits multilevel MAIHDA models, estimates variance partition coefficients, proportional change in variance, stratum effects, and discriminatory-accuracy summaries, and provides diagnostic and presentation plots. |
| Authors: | Hamid Bulut [aut, cre] |
| Maintainer: | Hamid Bulut <[email protected]> |
| License: | MIT + file LICENSE |
| Version: | 0.3.0 |
| Built: | 2026-10-19 13:52:31 UTC |
| Source: | https://github.com/hdbt/maihda |
Calculates the proportional change in between-stratum variance (PCV) between two MAIHDA models. The PCV measures how much the between-stratum variance changes when moving from one model to another, and is calculated as: PCV = (Var_model1 - Var_model2) / Var_model1.
calculate_pcv( model1, model2, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML", "REML") )calculate_pcv( model1, model2, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML", "REML") )
model1 |
A maihda_model object from |
model2 |
A maihda_model object from |
bootstrap |
Logical indicating whether to compute bootstrap confidence
intervals for the PCV. Default is FALSE. lme4 engine only: the
parametric bootstrap relies on lme4's |
n_boot |
Number of bootstrap samples if bootstrap = TRUE. Default is 1000. A value below about 200 warns that the interval's tail endpoints are unstable (the hard minimum is 10). |
conf_level |
Confidence level for bootstrap intervals. Default is 0.95. |
estimation |
Which between-stratum variances are compared: |
The PCV is the proportional change in between-stratum variance when moving from model1 to model2: a positive value means model2 has lower between-stratum variance, a negative value means higher. It is the share of model1's between-stratum variance explained by model2 only in the canonical nested case, where model2 adds fixed-effect predictors to model1 on the same outcome, analytic sample and strata. The function does not require nesting, so for non-nested models the PCV is simply a model-dependent difference in variance, not an explained proportion.
REML vs ML (the estimation argument). estimation sets which
between-stratum variances are compared:
"fitted" (default)each model's own estimate – the REML estimate
for a Gaussian lmer fit, the variance
summary.maihda_model reports.
"ML"REML lmer fits are refitted by maximum likelihood
(refitML) first, and the bootstrap interval is computed on
the same basis. Use it to match an analysis fitted by maximum likelihood.
"REML"REML-type variances. REML lmer fits are used as
fitted. For a binomial or Poisson glmer fit whose only random effect is
the stratum intercept, the between-stratum variance is re-estimated with the
fixed effects integrated out, as REML does for a Gaussian model (see below).
The PCV is a ratio of two variance estimates and uses no likelihood value, so it
does not need maximum-likelihood fits (likelihood-ratio tests and information
criteria do; see maihda_ic). REML estimates each model's
between-stratum variance with little bias. Maximum likelihood makes no allowance for
the degrees of freedom spent on the fixed effects, so it underestimates that
variance, and by more in the adjusted model than in the null model: the PCV is
overstated, most of all with few strata. In a balanced design whose fixed
effects are constant within strata, ML multiplies REML's estimate of the variance of
the stratum means, , by (
strata, fixed-effect coefficients, neither estimate at zero): 23/24 for the
null model of a 2 x 3 x 4 design but 17/24 for the adjusted one. The bootstrap
interval inherits the bias, because it simulates from and refits on the same basis.
"fitted" and "ML" differ for Gaussian lmer fits only.
glmer and the wemix and ordinal engines estimate variances by maximum
likelihood, so under either setting their PCV is overstated in the same way: most
with few strata, and more when strata are small or uneven in size, because the
shortfall applies to the between-stratum variance plus the sampling variance of a
stratum's own estimate. print() notes when the compared variances are
maximum-likelihood estimates.
estimation = "REML" corrects that shortfall for binomial and Poisson
glmer fits. Each variance minimises the Laplace-approximated deviance
evaluated at the joint mode of the fixed and random effects (lme4's
nAGQ = 0 deviance) plus the log-determinant of the fixed-effect information,
which integrates the fixed effects out; for the logit and log links this is the
criterion glmmTMB(REML = TRUE) minimises. The models are not refitted, and
the as-fitted values are returned alongside (pcv_fitted,
var_model1_fitted, var_model2_fitted).
Use it when strata are few but each holds enough observations for its own estimate to be precise: the PCV then has little bias, though with very few strata it stays imprecise. When the strata are small as well, neither basis is dependable. A variance estimate cannot fall below zero, so with that much noise the REML-type estimate averages too high, most in the adjusted model: the PCV then varies widely from sample to sample and can come out far too low, even negative, where the maximum-likelihood PCV stays too high.
estimation = "REML" is an error for the wemix and ordinal engines, for other
glmer families, for a fit with a further random effect such as a
context, for an lmer fit made by maximum likelihood, and with
bootstrap = TRUE on a glmer fit.
A brms fit is a Bayesian posterior: "ML" and "REML" perform no
refit and estimation_used is "posterior". Single-model VPC/ICC
summaries always use the model as fitted.
Latent-scale families and rescaling. For families whose level-1
variance is a fixed latent-scale constant – binomial/Bernoulli
( logit, 1 probit) and the cumulative (ordinal) model – the
linear predictor is identified only up to scale. Adding predictors that
explain within-stratum (individual-level) variation cannot shrink that
fixed level-1 variance; the latent scale stretches instead, inflating the
coefficients and the between-stratum variance alike (Bauer 2009; Mood 2010).
Part of a null-vs-adjusted change in the between-stratum variance is then
rescaling rather than genuinely explained variance, so latent-scale PCVs tend
to be understated and can turn negative on this account alone. The canonical
MAIHDA adjusted model – which adds the stratum dimensions' main effects,
constant within each stratum – is largely unaffected, but the caveat
is first-order whenever an added predictor varies within strata (an
individual-level covariate, as in the stepwise_pcv steps that
add one). The count families' level-1 variance is not a fixed constant, but
as with any non-identity link the same non-collapsibility logic applies in
attenuated form. Gaussian identity-link PCVs are not subject to this.
When bootstrap = TRUE, the function uses a parametric bootstrap: it simulates
new responses from model2 and refits both models with lme4::refit() for
each simulated response to obtain confidence intervals for the PCV estimate.
For negative-binomial models (glmer.nb) refit() holds the
dispersion parameter theta fixed at its original estimate, so the interval is
conditional on the estimated theta.
A bootstrap draw whose null-model between-stratum variance lands on
the zero boundary has no defined PCV (the denominator is zero); such draws
are excluded, so the percentile interval is conditional on estimating
a positive null variance. Whenever any draws hit the boundary the function
warns, reports the count as n_boot_boundary on the result, and
print() repeats the caveat – a sizeable boundary share signals weak
between-stratum variation, and the PCV itself is then fragile.
Bootstrap draws whose refit optimiser reports non-convergence are kept in the
interval (they still have a defined PCV) and counted in
n_boot_nonconverged, which print() shows. When more than half the
contributing draws did not converge the interval is still returned, but with a
warning and interval_reliable = FALSE; treat it as indicative only and
check for singular or failing fits.
The bootstrap is available for the lme4 engine only. For the other
engines the PCV is a point estimate: a brms fit's posterior credible
interval (reported by summary.maihda_model) covers a single
fit's VPC/ICC, not the PCV, which compares two separately fitted models – no
posterior interval for the PCV itself is computed – and a design-based
(wemix) interval would require replicate weights.
brms fits. For two brms fits the variances compared are the
posterior medians of each model's between-stratum variance, the values the
variance-components table of summary.maihda_model shows. The
posterior of a between-stratum variance is
right-skewed when strata are few, and more so in the adjusted model, which spends
degrees of freedom on the main effects. The PCV is therefore understated
with few strata – the opposite direction to maximum likelihood – and with very
few strata it can be negative where the true value is positive. The understatement
shrinks as strata are added.
A list containing:
pcv |
The estimated proportional change in variance |
pvc |
Deprecated duplicate of |
var_model1 |
Between-stratum variance from model1 |
var_model2 |
Between-stratum variance from model2 |
estimation |
The variance-estimation basis requested ( |
estimation_used |
The basis actually used: |
ml_variances |
Logical; |
reml_available |
Logical; |
pcv_fitted, var_model1_fitted, var_model2_fitted
|
Present when
|
adjusted_at_boundary |
Logical; |
ml_refit_failed |
Logical; |
ci_lower |
Lower bound of confidence interval (if bootstrap = TRUE) |
ci_upper |
Upper bound of confidence interval (if bootstrap = TRUE) |
bootstrap |
Logical indicating if bootstrap was used |
n_boot_nonconverged |
Number of contributing bootstrap draws whose refit
optimiser did not converge ( |
interval_reliable |
Logical (bootstrap only); |
Bauer, D. J. (2009). A note on comparing the estimates of models for cluster-correlated or longitudinal data with binary or ordinal outcomes. Psychometrika, 74(1), 97-105.
Mood, C. (2010). Logistic regression: why we cannot do what we think we can do, and what we can do about it. European Sociological Review, 26(1), 67-82.
stepwise_pcv for the sequential (one-variable-at-a-time)
PCV, and maihda which computes the canonical null-vs-adjusted
PCV automatically.
# Create strata and fit two models strata_result <- make_strata(maihda_sim_data, c("gender", "race")) model1 <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) model2 <- fit_maihda(health_outcome ~ age + gender + (1 | stratum), data = strata_result$data) # Calculate PCV without bootstrap pcv_result <- calculate_pcv(model1, model2) print(pcv_result$pcv) # Calculate PCV with bootstrap CI # pcv_boot <- calculate_pcv(model1, model2, bootstrap = TRUE, n_boot = 500) # print(pcv_boot)# Create strata and fit two models strata_result <- make_strata(maihda_sim_data, c("gender", "race")) model1 <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) model2 <- fit_maihda(health_outcome ~ age + gender + (1 | stratum), data = strata_result$data) # Calculate PCV without bootstrap pcv_result <- calculate_pcv(model1, model2) print(pcv_result$pcv) # Calculate PCV with bootstrap CI # pcv_boot <- calculate_pcv(model1, model2, bootstrap = TRUE, n_boot = 500) # print(pcv_boot)
calculate_pvc() is a deprecated alias of calculate_pcv. It
forwards to calculate_pcv() with a deprecation warning and will be removed
in a future release.
calculate_pvc( model1, model2, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML", "REML") )calculate_pvc( model1, model2, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML", "REML") )
model1 |
A maihda_model object from |
model2 |
A maihda_model object from |
bootstrap |
Logical indicating whether to compute bootstrap confidence
intervals for the PCV. Default is FALSE. lme4 engine only: the
parametric bootstrap relies on lme4's |
n_boot |
Number of bootstrap samples if bootstrap = TRUE. Default is 1000. A value below about 200 warns that the interval's tail endpoints are unstable (the hard minimum is 10). |
conf_level |
Confidence level for bootstrap intervals. Default is 0.95. |
estimation |
Which between-stratum variances are compared: |
See calculate_pcv.
Compares variance partition coefficients (VPC/ICC) across multiple MAIHDA models, with optional bootstrap confidence intervals.
compare_maihda( ..., model_names = NULL, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, ic = TRUE )compare_maihda( ..., model_names = NULL, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, ic = TRUE )
... |
Multiple maihda_model objects to compare. |
model_names |
Optional character vector of names for the models. |
bootstrap |
Logical; for lme4 models, compute parametric-bootstrap
VPC confidence intervals. Default FALSE. It does not apply to brms
models, which always return a posterior credible interval (so passing
|
n_boot |
Number of bootstrap samples if bootstrap = TRUE. Default is 1000. |
conf_level |
Confidence level for the VPC interval (lme4 bootstrap CI or brms credible interval). Default is 0.95. |
ic |
Logical; append relative-fit information criteria to the table for
comparing model structures: |
VPCs are only directly comparable when the models share an outcome,
family/link, analytic sample, and strata – the canonical use is nested models
(e.g. null vs covariate-adjusted) on the same data and strata, to show
how the VPC attenuates. If the supplied models differ in any of these,
compare_maihda() still returns the table but issues a single warning,
because the VPCs are then not directly comparable. The appended information
criteria follow the rules of maihda_ic instead: they need the same
outcome, analytic sample and weights but not the same strata, and Poisson and
negative-binomial fits of the same counts, or binomial or cumulative fits
differing in their link, have comparable criteria although their VPCs are not
comparable. In
addition, when the appended criteria mix scales – likelihood AIC/BIC
(lme4/ordinal) shown alongside Bayesian WAIC/LOOIC (brms), which can
happen for a same-family lme4-vs-brms comparison that the family/link check does
not flag – compare_maihda() warns, because those criteria are on different
scales and are not comparable to each other.
A maihda_comparison data frame of VPC/ICC by model. Interval
columns (ci_lower/ci_upper) are included when any model supplies
an interval – an lme4 bootstrap CI or a brms posterior credible interval. When
ic = TRUE, information-criteria columns (AIC/BIC or
WAIC/LOOIC, whichever apply) are appended.
# Canonical use: nested models on the SAME data and strata (null vs adjusted) strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) # Compare without bootstrap comparison <- compare_maihda(null_model, adj_model, model_names = c("Null", "Adjusted")) # Compare with bootstrap CI comparison_boot <- compare_maihda(null_model, adj_model, model_names = c("Null", "Adjusted"), bootstrap = TRUE, n_boot = 500)# Canonical use: nested models on the SAME data and strata (null vs adjusted) strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) # Compare without bootstrap comparison <- compare_maihda(null_model, adj_model, model_names = c("Null", "Adjusted")) # Compare with bootstrap CI comparison_boot <- compare_maihda(null_model, adj_model, model_names = c("Null", "Adjusted"), bootstrap = TRUE, n_boot = 500)
Fits a separate random-intercept MAIHDA model (intercept-only random
effects; any fixed-effect covariates in formula are still used) within
each level of a higher-level grouping variable (for example country, region, or
survey wave) and reports how the variance partition coefficient (VPC/ICC) and
the between-/within-stratum variance components differ across those groups. When
the strata are defined by at least two dimensions it also fits the adjusted model
(the dimensions' additive main effects) within each group and reports the per-group
pcv – the proportional change in between-stratum variance, i.e. the additive
share of that group's intersectional inequality.
compare_maihda_groups( formula, data, group, engine = "lme4", family = "gaussian", shared_strata = TRUE, min_group_n = 30, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, autobin = TRUE, decomposition = c("two-model", "crossed-dimensions"), context = NULL, sampling_weights = NULL, warn_linear = TRUE, estimation = c("fitted", "ML"), ... )compare_maihda_groups( formula, data, group, engine = "lme4", family = "gaussian", shared_strata = TRUE, min_group_n = 30, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, autobin = TRUE, decomposition = c("two-model", "crossed-dimensions"), context = NULL, sampling_weights = NULL, warn_linear = TRUE, estimation = c("fitted", "ML"), ... )
formula |
A model formula. Either the shorthand intersectional form
|
data |
A data frame containing the variables in |
group |
Character string naming the grouping variable in |
engine |
Modeling engine, "lme4" (default), "brms", "wemix" (the
design-weighted fit; requires |
family |
Model family. Default "gaussian". As in |
shared_strata |
Logical. When TRUE (default) intersectional strata are defined once on the full data so that a stratum denotes the same combination in every group; this makes the stratum definitions comparable across groups. Note that a group may still not contain every stratum, so two groups' VPCs can be estimated over different sets of populated strata – they are then not strictly directly comparable, and the function warns when this happens. When FALSE, strata are rebuilt independently within each group (stratum identities are then not comparable across groups at all). |
min_group_n |
Minimum size of the analytic sample a group must have – the rows that survive the model frame (covariate transformations applied, rows with a missing outcome/covariate dropped) – to be modelled. Groups with a smaller usable sample are skipped with a warning, even if they have more raw rows. Default 30. |
bootstrap |
Logical; compute per-group parametric-bootstrap VPC confidence intervals. lme4 engine only. Default FALSE. |
n_boot |
Number of bootstrap samples when |
conf_level |
Confidence level for bootstrap intervals. Default 0.95. |
autobin |
Logical passed to |
decomposition |
Per-group additive-vs-interaction decomposition: the two-model
null -> adjusted PCV ( |
context |
Optional character vector naming higher-level context
column(s) in |
sampling_weights |
Optional name of a sampling-weight column in
|
warn_linear |
Logical; when |
estimation |
Variance-estimation basis for each group's per-group PCV,
|
... |
Additional arguments passed to |
It estimates one VPC per group as a stratified analysis: each group is modelled
independently – the grouping variable itself is not modelled as a crossed
random effect, and the strata are not adjusted for it. (A context
argument, if supplied, does add a crossed contextual random intercept
within each group's model, making each per-group fit contextual
cross-classified; the groups themselves remain independently fitted.)
The VPC is the share of the unexplained variance that lies between strata,
not the absolute magnitude of intersectional inequality. Because it is a ratio,
a group's VPC can differ from another's because the between-stratum variance
differs, because the within-stratum (residual) variance differs, or both – two
groups with the same between-stratum variance can have very different VPCs. To
compare the absolute amount of between-stratum (intersectional) variation across
groups, read the returned var_between column alongside the VPC rather than
treating a higher VPC as "more inequality".
It is descriptive: it reports each group's VPC (with an interval when available – an lme4 bootstrap CI or a brms credible interval) for side-by-side comparison, but does not test whether the VPCs differ between groups. The per-group intervals describe each group's own uncertainty; whether two intervals overlap is not a valid test of the difference between their VPCs, which would require modelling that difference directly.
Robustness: a group whose analytic sample (rows surviving the model
frame) has fewer than min_group_n observations is always skipped with a
warning. A group with fewer than two populated strata is also skipped
(VPC is undefined with a single stratum) when the stratum membership is known
before fitting – that is, when shared_strata = TRUE or data
already carries a stratum column. Under shared_strata = FALSE
strata are rebuilt inside each group, so a degenerate single-stratum group is
instead reported with a "fit failed" status rather than a pre-fit skip. A
singular fit yields a VPC of 0 rather than an error (unlike
calculate_pcv). A hard fit failure in one group records NA
and a status note without aborting the whole comparison; one warning names the
groups whose fit failed and gives each distinct reason once.
Fit-quality diagnostics: on every engine, one warning names the groups with a fit
problem, and such a group keeps a status of "ok" (the fit did
complete). A group is named for a singular fit when its between-stratum variance
is estimated at zero, so that var_between and the VPC are 0. A zero in
another variance component – a context, a further random effect, the interaction
or a dimension of the crossed-dimensions model – leaves them as estimated and does
not name the group. A group is also named when its model did not converge and, in
a two-model decomposition, when its adjusted model did not. The warning says
which: an adjusted model affects the group's PCV, not its VPC, and
pcv_status does not record it. A brms model is named when its
largest R-hat is above 1.01 or its sampler had a divergent transition, and is never
reported as singular.
A data.frame of class maihda_group_comparison with one
row per group and columns group, n, n_strata,
vpc, var_between, var_other, var_residual,
status (and ci_lower/ci_upper whenever a group's
summary supplies an interval: an lme4 bootstrap CI with
bootstrap = TRUE, or a brms posterior credible interval, which is
returned without bootstrapping). When the strata are defined by at least two
dimensions, two further columns report the per-group null -> adjusted
decomposition: pcv (proportional change in between-stratum variance when
the dimensions' additive main effects are added; computed on the variance basis
set by estimation – see calculate_pcv),
var_between_adjusted (a derived coherence quantity, reported as
var_between * (1 - pcv) so it shares the scale of the REML
var_between/vpc and the table satisfies
pcv = (var_between - var_between_adjusted) / var_between exactly – it is
not the adjusted fit's own variance), and
var_between_adjusted_ml (the adjusted model's actual
between-stratum variance, read straight off the adjusted fit on the same basis as
the PCV; under the default estimation = "fitted" this is the REML variance,
coinciding with var_between_adjusted, and under estimation = "ML" it
is the ML variance, differing from var_between_adjusted only by the small
REML-vs-ML gap in the null variance; despite its name it is not always a
maximum-likelihood estimate; for a brms fit it is the posterior median of
the adjusted variance, which var_between_adjusted equals as well). All
three are
NA for a group whose adjusted fit failed. A fourth column,
pcv_status, records the decomposition outcome per group:
"ok" when the PCV was computed, "failed" when the adjusted model
or PCV errored (pcv is then NA and the group is named in a
warning – the group's own status can still be "ok" because its
null VPC model succeeded), and "singular" when the adjusted fit was
singular and the PCV saturated near 100% – not warned about, since a
singular adjusted fit is indistinguishable from genuinely additive strata (a
legitimate, common result), so it is flagged only in this column.
These four columns are omitted entirely when the strata have a single
dimension. When context
is supplied, two further columns report each group's contextual partition:
var_context (the between-context variance, summed over contexts) and
vpc_context (the contexts' share of the group's unexplained variance);
the per-context split is on the "context_per" attribute and the
context name(s) on "context_var". These are dropped when no context is
supplied. n is the analytic sample size used by the
model (after dropping rows with a missing outcome/covariate) for both fitted
and skipped groups, falling back to the raw row count only when the model
frame cannot be built. var_other is the variance of any additional
random effects and is 0 for the canonical single-stratum model. Groups that
were skipped or failed have NA metrics and an explanatory
status; for a failed fit it is "fit failed: " followed by the
first line of the error, whose whole message is in a warning.
compare_maihda for comparing different models on the
same data; plot.maihda_group_comparison for visualising the result.
data(maihda_country_data) # How does gender x SES inequality in PISA math scores differ across countries? cmp <- compare_maihda_groups( math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country" ) print(cmp) plot(cmp, type = "vpc")data(maihda_country_data) # How does gender x SES inequality in PISA math scores differ across countries? cmp <- compare_maihda_groups( math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country" ) print(cmp) plot(cmp, type = "vpc")
Fits a multilevel model for MAIHDA (Multilevel Analysis of Individual
Heterogeneity and Discriminatory Accuracy) using lme4, brms, WeMix (for
design-weighted (survey) data), or – for an ordered-factor outcome – a
cumulative link mixed model via ordinal::clmm().
fit_maihda( formula, data, engine = "lme4", family = "gaussian", autobin = TRUE, context = NULL, sampling_weights = NULL, id = NULL, time = NULL, time_degree = 1, stratum_slope = TRUE, interactions = FALSE, count_approximation = c("lognormal", "delta", "trigamma"), ... )fit_maihda( formula, data, engine = "lme4", family = "gaussian", autobin = TRUE, context = NULL, sampling_weights = NULL, id = NULL, time = NULL, time_degree = 1, stratum_slope = TRUE, interactions = FALSE, count_approximation = c("lognormal", "delta", "trigamma"), ... )
formula |
A formula specifying the model. Can include a random effect
for stratum (e.g., |
data |
A data frame containing the variables in the formula. |
engine |
Character string specifying which engine to use: "lme4"
(default), "brms", "wemix" (design-weighted pseudo-maximum-likelihood via
|
family |
Character string, family object, or family function specifying
the model family. Common options: "gaussian", "binomial", "poisson",
"negbinomial". Default is "gaussian".
|
autobin |
Logical indicating whether numeric variables used only for
automatic strata creation should be binned by |
context |
Optional character vector naming one or more higher-level
context columns in |
sampling_weights |
Optional single character string naming a numeric
column of What this does and does not buy you. A single person-level weight column is all this argument accepts: there is no representation of the sampling hierarchy – no primary sampling units, no sampling strata, no higher-stage or conditional weights, no finite-population corrections, and no replicate weights. Weighting the likelihood makes the point estimates target the population-weighted estimand, which is the main reason to use it. The standard errors, however, are not general design-based standard errors for a multistage or stratified sample, because none of the design features that drive them are supplied. Treat the intervals as approximate unless your design genuinely matches the assumptions below; for full design-based inference on such data, use replicate weights with a survey-specific package. Two engines support them:
Rows with a missing or non-positive sampling weight are dropped with a
warning. The column names |
id |
Optional single character string naming a person/unit identifier
column for a longitudinal (growth-curve) MAIHDA on long-format data
(one row per measurement occasion). Id values must be globally
unique to a person – ids numbered within a site or group (person "1" in
every site) would merge different people's trajectories, and an id
appearing in more than one stratum is rejected with an error. Supplied
together with |
time |
Optional single character string naming a numeric measurement-time
column (e.g. wave 0, 1, 2, ... or age), required for a longitudinal MAIHDA;
see |
time_degree |
Polynomial degree of the growth curve when |
stratum_slope |
Longitudinal only: keep the stratum-level random slope(s)
on |
interactions |
Opt-in per-stratum interaction diagnostic
( |
count_approximation |
Which latent-scale level-1 (observation) variance
approximation the VPC/ICC of a log-link count model uses, from table 1
of Nakagawa, Johnson & Schielzeth (2017): |
... |
Additional arguments passed to |
A maihda_model object containing:
model |
The fitted model object (lme4, brms, WeMix, or ordinal::clmm). An
ordinal fit with a between-stratum variance of zero comes from
|
engine |
The engine used ("lme4", "brms", "wemix", or "ordinal") |
sampling_weights |
The sampling-weight column name when supplied, NULL otherwise |
formula |
The model formula |
data |
The data used for fitting |
family |
The family used |
strata_info |
The strata information from make_strata() if available, NULL otherwise |
context_vars |
The context variable name(s) when |
interactions |
The |
response_recoding |
For a recoded two-level outcome, a data frame mapping each original level to its 0/1 value and role (reference/event); NULL when no recoding occurred |
diagnostics |
Fit-quality diagnostics, surfaced by the print and
summary methods: singular fit / convergence for lme4, WeMix and ordinal
(clmm) fits, and MCMC convergence (maximum Rhat, divergent transitions)
for brms. lme4 checks a |
# Standard approach: manually create strata first strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race", "education")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data, engine = "lme4") # Simplified approach: specify stratifying variables directly in the grouping structure # The function internally calls make_strata() to create intersectionals model2 <- fit_maihda(health_outcome ~ age + (1 | gender:race:education), data = maihda_sim_data, engine = "lme4") # Contextual cross-classified MAIHDA: strata crossed with a higher-level # context (here country) -- the literature's cross-classified MAIHDA. data(maihda_country_data) model3 <- fit_maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, context = "country") summary(model3) # between-stratum vs. between-country vs. residual# Standard approach: manually create strata first strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race", "education")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data, engine = "lme4") # Simplified approach: specify stratifying variables directly in the grouping structure # The function internally calls make_strata() to create intersectionals model2 <- fit_maihda(health_outcome ~ age + (1 | gender:race:education), data = maihda_sim_data, engine = "lme4") # Contextual cross-classified MAIHDA: strata crossed with a higher-level # context (here country) -- the literature's cross-classified MAIHDA. data(maihda_country_data) model3 <- fit_maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, context = "country") summary(model3) # between-stratum vs. between-country vs. residual
A single high-level entry point that runs the standard two-model MAIHDA workflow and returns one bundled object. It fits the null model (covariates plus the intersectional random intercept, excluding the stratum dimensions' main effects) and the adjusted model (the null plus the additive main effects of the stratum-defining dimensions), summarises the variance partition (VPC/ICC) of the null model, and reports the PCV – the proportional change in between-stratum variance from the null to the adjusted model, i.e. the additive share of the intersectional inequality. When a higher-level grouping variable is supplied it also compares this decomposition across that variable's levels.
maihda( formula, data, group = NULL, context = NULL, engine = "lme4", family = "gaussian", decomposition = c("two-model", "crossed-dimensions", "longitudinal"), autobin = TRUE, shared_strata = TRUE, min_group_n = 30, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, response_vpc = FALSE, seed = NULL, sampling_weights = NULL, id = NULL, time = NULL, time_degree = 1, stratum_slope = TRUE, interactions = TRUE, estimation = c("fitted", "ML", "REML"), ... )maihda( formula, data, group = NULL, context = NULL, engine = "lme4", family = "gaussian", decomposition = c("two-model", "crossed-dimensions", "longitudinal"), autobin = TRUE, shared_strata = TRUE, min_group_n = 30, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, response_vpc = FALSE, seed = NULL, sampling_weights = NULL, id = NULL, time = NULL, time_degree = 1, stratum_slope = TRUE, interactions = TRUE, estimation = c("fitted", "ML", "REML"), ... )
formula |
A model formula, using either the intersectional shorthand
|
data |
A data frame with the model variables (and the |
group |
Optional character string naming a higher-level grouping variable
(e.g. |
context |
Optional character vector naming higher-level context
column(s) in |
engine |
Modeling engine, "lme4" (default), "brms", "wemix" (the
design-weighted pseudo-maximum-likelihood fit; requires
|
family |
Model family. Default "gaussian". As in |
decomposition |
How to decompose the intersectional inequality into additive
and interaction parts. |
autobin |
Logical passed to |
shared_strata |
Logical, forwarded to |
min_group_n |
Minimum group size for the per-group comparison, forwarded
to |
bootstrap |
Logical; compute parametric-bootstrap VPC confidence intervals (lme4 only) for both the overall summary and the per-group comparison. Default FALSE. |
n_boot |
Number of bootstrap samples when |
conf_level |
Confidence level for bootstrap intervals. Default 0.95. |
response_vpc |
Logical; for a binomial (lme4) outcome, also attach the
response-scale VPC ( |
seed |
Optional integer seed for the response-scale VPC simulation. It is
NOT forwarded to |
sampling_weights |
Optional name of a sampling-weight column for a
weighted MAIHDA on survey data; see |
id, time, time_degree
|
For a longitudinal MAIHDA: the person/unit
identifier column, the numeric measurement-time column, and the growth-curve
polynomial degree (1 = linear). Supplying |
stratum_slope |
Longitudinal only: keep the stratum-level random slope(s)
on |
interactions |
Whether to compute the per-stratum interaction diagnostic
( |
estimation |
Variance-estimation basis for the PCV ( |
... |
Additional arguments passed to |
Binomial companions. For a binary outcome the model summaries also carry
the discriminatory accuracy (AUC / C-statistic and Median Odds Ratio) – the "DA"
in MAIHDA – automatically, so the null model's strata-only AUC sits alongside its
VPC; set response_vpc = TRUE to add the (simulation-based) response-scale
VPC as well. These are read from summary(x) and the attached
summary_adjusted, and the headline print() shows the null-model AUC.
This is a convenience wrapper around fit_maihda,
calculate_pcv, summary.maihda_model and
compare_maihda_groups. It always runs a decomposition,
never a single plain fit: by default the two-model null/adjusted pair, or –
with decomposition = "crossed-dimensions" – one crossed model whose
additive dimension random effects carry the additive share. For a single
undecomposed fit (e.g. just the null-model VPC / discriminatory accuracy),
call fit_maihda directly.
The dimensions' additive main effects. You may write them in the formula –
the fully-specified, lme4-native adjusted model
outcome ~ covars + var1 + var2 + (1 | var1:var2) – or omit them. Either way
the null excludes the dimension main effects and the adjusted includes
them: when the formula already lists them it is taken as the adjusted model and the
null is derived by dropping them; when they are missing maihda() adds them to
the adjusted model and emits a message() so the decomposition stays explicit.
Only the additive main effects belong here: a fixed interaction among the
stratum dimensions – var1 * var2, which R expands to
var1 + var2 + var1:var2 – duplicates the intersectional stratum random
intercept (it absorbs the between-stratum variance into fixed cell means, which
makes the PCV invalid), so it is rejected with an error. Write
var1 + var2; the intersection is estimated by the stratum random effect (and
quantified by decomposition = "crossed-dimensions" or
maihda_interactions).
The dimensions themselves are read from the random term: the shorthand
(1 | var1:var2) and make_strata both record them, and a numeric
dimension that make_strata() auto-binned enters the adjusted model as its
reconstructed tertile factor (matching the strata), not as a linear term. Because
maihda() is intrinsically a decomposition, it errors (rather than
returning a null-only result) when it cannot build the adjusted model – when the
dimensions cannot be recovered (a hand-built stratum column records none) or
there is only one dimension (no intersection to decompose). Use fit_maihda
for those single-model fits.
An object of class maihda_analysis: a list with
model |
the fitted |
summary |
the model's |
model_adjusted |
the fitted adjusted |
summary_adjusted |
the adjusted model's |
pcv |
the proportional change in variance: the |
decomposition |
the additive/interaction partition (additive and interaction
variances and shares, per-dimension variances and, for a |
groups |
a |
interactions |
the |
mode |
|
context_vars |
the context variable name(s) when |
formula, adjusted_formula, group_var, call
|
bookkeeping for printing |
The stratum-defining dimensions are categorical. A factor or character dimension
enters the adjusted model as a categorical main effect, and a numeric dimension with
more than 10 unique values is tertile-binned when autobin = TRUE (see
make_strata). A numeric dimension that is not auto-binned – a
category code such as education = 1, 2, 3 (few unique values), or a many-valued
numeric fitted with autobin = FALSE – enters the adjusted model as a single
linear fixed effect rather than categorical main effects, which changes the
PCV/decomposition interpretation. maihda() therefore warns in that
case (for three or more distinct values – a binary numeric dimension is exempt, since
with two levels a linear term and a factor are equivalent): wrap category codes in
factor() before fitting, or, for a genuinely continuous variable, use it as a
covariate rather than a stratum dimension.
For a brms crossed-dimensions fit, decomposition$realised and the
"Realised strata" block of print() summarise, over the posterior draws, the
effects of the strata in the data. In each draw stratum has
the effect , the sum of its dimensions' level effects and its
own (interaction) effect. These are finite-population summaries (Gelman 2005): they
describe the strata and levels in the data, where the variance components describe
the distributions those were drawn from. A dimension with two levels says a lot
about the former and little about the latter, so the realised values depend little
on the prior on the standard deviations when each stratum has enough data to pin
down its own effect. With few observations per stratum each draw also carries the
uncertainty about every stratum's effect: the realised variances then come out too
high and move with the prior. Compare the intervals of the stratum estimates with
the spread between the strata. Per draw:
between_var, half the mean squared difference between
two distinct strata.
vpcbetween_var over itself plus the within-stratum
variance: for a logit link, 1 for a probit link,
for a cloglog link, the residual variance of a Gaussian
fit. Not given for a Poisson or
negative-binomial fit, whose within-stratum variance is computed from the
variance components. With a context, the realised variance of the
context effects is added to the denominator (see the section Realised strata
and contexts).
interaction_varthe residual sum of squares of the least-squares
fit of the on an intercept and the dimensions' levels,
divided by its residual degrees of freedom, df_interaction. Strata
missing from the grid of dimension levels are allowed.
additive_share1 minus interaction_var / between_var, and
interaction_share the rest: a mean-square split, like a PCV computed
from REML variances. It is near zero when the dimensions explain none of the
differences between the strata, and can then fall below zero.
per_dimthe variance of each dimension's level effects, with its number of levels minus one as divisor.
morfor a logit link, the median odds ratio between two distinct
strata of the data: the exponential of the median of
over the pairs. With many
strata it is computed from an evenly spaced subset of at least 1000 draws.
Each is the posterior median, with the equal-tailed credible interval at
conf_level in the matching *_ci element. Every stratum counts once,
whatever its size. n_strata is . An lme4
crossed-dimensions fit reports its variance components only.
For a brms fit with a context, summary()$context$realised and
the "Realised strata and contexts" block of print() give the realised
partition: over the posterior draws, the finite-population variances (Gelman 2005)
of the effects of the strata and of each context's levels in the data. A context's
variance component describes the distribution its levels were drawn from, and with
few levels it follows the prior on its standard deviation; the variance of the
effects of the levels in the data describes those levels, which the data pin down
when each level has enough observations. With two contexts it is half the squared
difference between their effects. Per draw, for a grouping factor with
levels in the data and effects :
var_stratumthe realised variance of the strata: of the stratum
intercepts, or of the of a crossed-dimensions fit (its
between_var).
per_contexteach context's
, and
context_var_total their sum.
other_varthe same, summed over any other random effect in the formula; given only when there is one.
vpc_stratumvar_stratum over the sum of the realised
variances and the within-stratum variance (see vpc in Realised strata),
and vpc_context and vpc_context_total each context's and all
contexts' share of that sum. Given for a Gaussian identity fit and for a
binomial, Bernoulli or cumulative fit on its latent scale, not for a Poisson or
negative-binomial fit. For a crossed-dimensions fit vpc_stratum is
decomposition$realised$vpc.
Each is the posterior median, with the equal-tailed credible interval at
conf_level in the matching *_ci element; for per_context and
vpc_context a matrix with a row per context. Every level counts once,
whatever its size. n_strata is the number of strata, and the partition's
context_levels the number of each context's levels. print() of a
two-model analysis shows the realised VPC and context share of the null model.
These values depend little on the prior on the standard deviations when each
context and stratum has enough data. With few observations per context each draw
also carries the uncertainty about every context's effect, and they then move with
the prior. An lme4 fit reports its variance components only.
Gelman, A. (2005). Analysis of variance – why it is more important than ever. The Annals of Statistics, 33(1), 1-53. doi:10.1214/009053604000001048
fit_maihda for the single-model fitter,
compare_maihda_groups for the group comparison, and
summary.maihda_model for the variance summary.
data(maihda_health_data) # One call: null + adjusted fit, VPC summary, and PCV decomposition. Writing the # dimensions' additive main effects (Gender + Race) gives the fully-specified # adjusted model; maihda() derives the null by dropping them. a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) a # VPC (null) and PCV (null -> adjusted) a$pcv # proportional change in between-stratum variance a$formula # null: BMI ~ Age + (1 | stratum) a$adjusted_formula # adjusted: null + Gender + Race main effects # Omitting them is equivalent -- maihda() adds them to the adjusted model and # emits a message; the null and PCV are identical to the explicit form above. a0 <- maihda(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data) plot(a, type = "vpc") # null model plot(a, type = "effect_decomp")# adjusted model (additive vs intersectional) # Crossed-dimensions decomposition: one model, the dimensions' main effects entered # as RANDOM intercepts. The additive and interaction shares of the between-strata # variance are read directly from the single fit (no null/adjusted pair). cc <- maihda(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data, decomposition = "crossed-dimensions") cc # VPC and additive/interaction shares cc$decomposition$additive_share # crossed-dimensions analogue of the PCV cc$formula # BMI ~ Age + (1|Gender) + (1|Race) + (1|stratum) # Add a higher-level grouping variable to also compare across its levels. # maihda_country_data has a real country grouping (PISA achievement data): data(maihda_country_data) a2 <- maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country") a2 plot(a2, type = "group_vpc") plot(a2, type = "group_pcv") # Contextual cross-classified MAIHDA: instead of one model per country (group=), # model the strata CROSSED with country in a single fit. The summary partitions # the unexplained variance into between-stratum vs. between-country vs. residual, # and the PCV is computed with country partialled out. a3 <- maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, context = "country") a3 a3$summary$context$vpc_context_total # the country (general contextual) share plot(a3, type = "context_vpc")data(maihda_health_data) # One call: null + adjusted fit, VPC summary, and PCV decomposition. Writing the # dimensions' additive main effects (Gender + Race) gives the fully-specified # adjusted model; maihda() derives the null by dropping them. a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) a # VPC (null) and PCV (null -> adjusted) a$pcv # proportional change in between-stratum variance a$formula # null: BMI ~ Age + (1 | stratum) a$adjusted_formula # adjusted: null + Gender + Race main effects # Omitting them is equivalent -- maihda() adds them to the adjusted model and # emits a message; the null and PCV are identical to the explicit form above. a0 <- maihda(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data) plot(a, type = "vpc") # null model plot(a, type = "effect_decomp")# adjusted model (additive vs intersectional) # Crossed-dimensions decomposition: one model, the dimensions' main effects entered # as RANDOM intercepts. The additive and interaction shares of the between-strata # variance are read directly from the single fit (no null/adjusted pair). cc <- maihda(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data, decomposition = "crossed-dimensions") cc # VPC and additive/interaction shares cc$decomposition$additive_share # crossed-dimensions analogue of the PCV cc$formula # BMI ~ Age + (1|Gender) + (1|Race) + (1|stratum) # Add a higher-level grouping variable to also compare across its levels. # maihda_country_data has a real country grouping (PISA achievement data): data(maihda_country_data) a2 <- maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country") a2 plot(a2, type = "group_vpc") plot(a2, type = "group_pcv") # Contextual cross-classified MAIHDA: instead of one model per country (group=), # model the strata CROSSED with country in a single fit. The summary partitions # the unexplained variance into between-stratum vs. between-country vs. residual, # and the PCV is computed with country partialled out. a3 <- maihda(math ~ 1 + (1 | gender:ses), data = maihda_country_data, context = "country") a3 a3$summary$context$vpc_context_total # the country (general contextual) share plot(a3, type = "context_vpc")
Computes the AUC / C-statistic as the Mann-Whitney U statistic: the
probability that a randomly chosen case (y == 1) is assigned a higher
predicted value than a randomly chosen non-case (y == 0), with ties
counting as one half. This needs no external package. An AUC of 0.5 is chance;
1 is perfect separation.
maihda_auc(prob, y)maihda_auc(prob, y)
prob |
Numeric vector of predicted probabilities (or any score where larger means more case-like). |
y |
Observed binary outcome as 0/1 numeric or logical, the same length as
|
A single number in [0, 1], or NA_real_ if either class is
absent.
Merlo, J., Wagner, P., Ghith, N., & Leckie, G. (2016). An original stepwise multilevel logistic regression analysis of discriminatory accuracy: the case of neighbourhoods and health. PLOS ONE, 11(4), e0153778.
maihda_auc(c(0.1, 0.4, 0.35, 0.8), c(0, 0, 1, 1))maihda_auc(c(0.1, 0.4, 0.35, 0.8), c(0, 0, 1, 1))
A cross-national dataset for demonstrating how Multilevel Analysis of
Individual Heterogeneity and Discriminatory Accuracy (MAIHDA) can be used to
compare intersectional inequality across a higher-level grouping
variable (here, country) with compare_maihda_groups and
maihda. Each row is a 15-year-old student; the intersectional
strata are formed by gender and socioeconomic status (ses), and
the outcome is the PISA mathematics score.
maihda_country_datamaihda_country_data
A data frame with 3,600 rows (600 students in each of 6 countries) and 7 variables:
Factor; one of Finland, Germany, United Kingdom, Italy, Japan, Mexico. The higher-level grouping variable.
Factor; student gender (female/male). A stratum dimension.
Factor; socioeconomic status as global tertiles (Low/Medium/High)
of escs, computed on the pooled sample so a band means the same in
every country. A stratum dimension.
Numeric; the PISA index of economic, social and cultural status
(the continuous measure underlying ses).
Numeric; PISA mathematics score (first plausible value). The primary outcome.
Numeric; PISA reading score (first plausible value).
Factor; "Yes" if math is below 420 (PISA proficiency
Level 2 baseline), else "No". A binary outcome for logistic examples.
Intersectional inequality (the between-stratum share of variance, VPC/ICC) in mathematics achievement differs across the six countries, which is what makes the dataset a useful showcase for the group-comparison workflow.
The intersectional strata are gender:ses (2 x 3 = 6 strata). A canonical
MAIHDA "null" model is math ~ 1 + (1 | gender:ses); comparing its VPC
across countries quantifies how much joint gender-by-class inequality in
achievement varies between countries.
This is a teaching/illustration dataset only. It uses a single PISA plausible
value for each score and does not carry the PISA survey weights or
complex sampling design, so results are not survey-representative and
should not be used for substantive cross-national inference. (For your own
survey data, the package supports design-weighted MAIHDA via the
sampling_weights argument of fit_maihda /
maihda.)
Derived from the OECD Programme for International Student Assessment (PISA)
2018 student questionnaire data (OECD (2019), PISA 2018 Database),
accessed and cleaned via the learningtower R package (MIT licensed),
https://CRAN.R-project.org/package=learningtower. A balanced random
subsample of 600 complete-case students per country was taken (seed 2026). The
data preparation script is in data-raw/maihda_country_data.R.
data(maihda_country_data) # Compare intersectional (gender x SES) inequality across countries analysis <- maihda( math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country" ) analysis plot(analysis, type = "group_vpc")data(maihda_country_data) # Compare intersectional (gender x SES) inequality across countries analysis <- maihda( math ~ 1 + (1 | gender:ses), data = maihda_country_data, group = "country" ) analysis plot(analysis, type = "group_vpc")
Specifies a cumulative (proportional-odds) model for an ordinal outcome in
fit_maihda / maihda, with a choice of link:
maihda_cumulative("logit") (the default, equivalent to
family = "ordinal") or maihda_cumulative("probit"). It plays the
role a stats family object plays for the other families – there is no
cumulative family constructor in stats, and using
brms::cumulative() would require brms for a frequentist fit.
maihda_cumulative(link = c("logit", "probit"))maihda_cumulative(link = c("logit", "probit"))
link |
The cumulative link: |
A family marker list with elements family = "cumulative" and
link.
maihda_cumulative() maihda_cumulative("probit")maihda_cumulative() maihda_cumulative("probit")
Builds the standard “Table 1” descriptives of a MAIHDA analytic sample
before any model is fitted: the total and complete-case sample sizes,
the observed vs. expected intersectional strata (and which are empty or
small), the distribution of each stratum-defining dimension, family-aware
per-stratum outcome summaries, missing-data accounting, and – for a
contextual cross-classified design – the context units. It is the pre-model
counterpart of maihda_table.
The description comes from the same machinery as the model: the strata
are built by make_strata via the same formula-shorthand
resolution as fit_maihda, the analytic sample reproduces the
engines' own row selection (missing outcome, covariates, stratum dimensions,
context, and – for a weighted design – missing/non-positive sampling
weights), and the outcome family uses the same auto-detection as the fitters.
Stratum IDs, labels, and counts therefore match a subsequent
make_strata() / fit_maihda() / maihda on the same
formula and data exactly.
maihda_describe( x, data = NULL, context = NULL, family = NULL, sampling_weights = NULL, flag_stratum_n = 20, include_empty_strata = TRUE, autobin = TRUE, digits = 3, weights = NULL )maihda_describe( x, data = NULL, context = NULL, family = NULL, sampling_weights = NULL, flag_stratum_n = 20, include_empty_strata = TRUE, autobin = TRUE, digits = 3, weights = NULL )
x |
A model formula (with the intersectional shorthand
|
data |
A data frame with the model variables; required when |
context |
Optional character vector naming higher-level context
column(s), exactly as in |
family |
|
sampling_weights |
Optional single character string naming a numeric
column of |
flag_stratum_n |
Strata with |
include_empty_strata |
Logical; when |
autobin |
Passed to |
digits |
Decimal places used by the |
weights |
Optional precision weights, given as a bare column name of
|
Family-aware outcome summaries. The per-stratum (and overall)
outcome summary depends on the resolved family, and the applied summary type
is recorded in $outcome_summary – a 0/1 outcome is never described
with a Gaussian mean/SD as if continuous:
gaussian (and other continuous families): mean, SD, median, min, max;
binomial (including an aggregated outcome written either as
cbind(success, failure) or, for brms, as
success | trials(n)): event count, trials, and the observed
proportion. Trials are the binomial denominator, so a row with a missing
or non-positive trial count has no observed outcome;
poisson / negative binomial: the same numeric summaries, read as the observed count mean (rate);
cumulative (ordinal): the mean and (lower) median category score
(categories scored 1..K in level order, the same convention as the
package's plots), with the full category distribution in
$outcome_levels.
Intersectional sparsity. $overview contrasts
n_strata_observed with n_strata_expected (the full Cartesian
product of the observed dimension levels) and n_empty_strata; with
include_empty_strata = TRUE the empty combinations are enumerated as
rows of $strata (with stratum = NA, so real stratum IDs stay
identical to a subsequent fit). With many small strata the stratum effects are
shrunk toward the mean and the variance components are imprecise with either
engine.
Missing data. $overview separates the rows lost to a missing
stratum dimension (make_strata() routes them to the NA stratum) from
rows with a missing outcome, and reports the resulting complete-case
n_analytic – computed with the same row mask the engines apply, so it
equals nrow(fit_maihda(...)$data).
Weights. With sampling_weights, weighted counts and weighted
outcome means/proportions are reported alongside the unweighted ones, and
rows with a missing or non-positive weight are excluded from the analytic
sample (as the weighted engines do). As elsewhere in the package, these are
population-weighted point summaries – not a complex survey design; no
design-based variances are computed.
Units. maihda_describe() treats rows as the unit of
description. For longitudinal (long-format) data a row is a measurement
occasion, not a person; describing a fitted longitudinal model
(fit_maihda(id =, time =)) additionally reports n_individuals
and the median occasions per individual in $overview.
Fitted-model input. A maihda_model (or the
maihda_analysis bundle from maihda) can be described
post hoc; the formula, data, family, context, and sampling weights are taken
from the fit, so the description covers the exact analytic sample the model
used. For the wemix/ordinal engines the stored data already
is the pre-filtered analytic sample, so total and analytic counts
coincide there.
An object of class maihda_describe: a list of export-ready
data frames (pass to write.csv() or knitr::kable()) plus
metadata:
overview |
one row: |
dimensions |
counts and percentages for each level of each MAIHDA
dimension ( |
strata |
one row per stratum: |
outcome_overall |
the same family-aware outcome summary over the whole sample |
outcome_levels |
the outcome's category distribution (binomial /
ordinal outcomes; |
context |
one row per context unit: |
missingness |
per variable (outcome, each dimension, each context,
the weight column): |
warnings |
data-quality flags as a data frame of |
observations |
a slim per-row frame (stratum and the outcome
numerator/denominator on the summary scale) kept so |
outcome, family, family_detected, outcome_summary, event_level, strata_vars, context_vars, sampling_weights, source, engine, longitudinal, response_recoding, call, ...
|
metadata used by
|
maihda_table for the post-model tables,
make_strata, fit_maihda,
plot for the descriptive plots.
data(maihda_health_data) desc <- maihda_describe(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data, flag_stratum_n = 20) desc desc$overview head(desc$strata) # Binary outcome: auto-detected binomial, proportions instead of means desc_bin <- maihda_describe(Obese ~ (1 | Gender:Race:Education), data = maihda_health_data) desc_bin$outcome_levels # Contextual cross-classified design (country as context) data(maihda_country_data) desc_ctx <- maihda_describe(math ~ escs + (1 | gender:ses), data = maihda_country_data, context = "country") desc_ctx$context # Export-ready tables # write.csv(desc$strata, "table1_strata.csv", row.names = FALSE)data(maihda_health_data) desc <- maihda_describe(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data, flag_stratum_n = 20) desc desc$overview head(desc$strata) # Binary outcome: auto-detected binomial, proportions instead of means desc_bin <- maihda_describe(Obese ~ (1 | Gender:Race:Education), data = maihda_health_data) desc_bin$outcome_levels # Contextual cross-classified design (country as context) data(maihda_country_data) desc_ctx <- maihda_describe(math ~ escs + (1 | gender:ses), data = maihda_country_data, context = "country") desc_ctx$context # Export-ready tables # write.csv(desc$strata, "table1_strata.csv", row.names = FALSE)
Bundles the individual-level discriminatory-accuracy summaries for a binomial
MAIHDA model: the AUC / C-statistic (how well the model's predicted
probabilities separate cases from non-cases) and the Median Odds Ratio. Applied
to a strata-only (null) model, the AUC is the discriminatory accuracy of the
intersectional strata themselves – Merlo's central quantity; comparing it with
an adjusted model shows whether individual covariates beyond stratum membership
sharpen classification. The AUC is computed for any binomial link; the Median
Odds Ratio is reported only for the logit link and is NA otherwise (e.g.
for a probit fit), since the MOR is an odds-ratio-scale quantity.
The AUC is apparent (in-sample). It scores the same observations used
to estimate the model – the fixed effects, the variance components, and the
shrunken stratum BLUPs – so it is an apparent (resubstitution) AUC and
is optimistically biased, the more so with small or sparse strata. It is
reported as the conventional descriptive MAIHDA discriminatory accuracy
(Merlo 2018), not as a cross-validated estimate of out-of-sample
predictive discrimination; the returned object carries apparent = TRUE
and print() says so. For genuine predictive accuracy, validate with an
out-of-fold (group-aware) scheme or an optimism correction.
Aggregated-binomial fits are supported in all three forms R accepts – an lme4
cbind(success, failure) response, an lme4 response in [0, 1] whose trial
counts are supplied as weights = (see glm), and a brms
y | trials(n) response: the AUC is the count-weighted C-statistic over the
implied individual-level 0/1 data, and n_case / n_control are the
total successes / failures. All three spellings of the same data give the same AUC.
This includes individual 0/1 records collapsed to frequency cells (every row
all-success or all-failure), whose weights are trial counts like any others; see
binomial_weights to override that reading.
Scope. When the model carries random effects beyond the
intersectional partition – a contextual (1 | school) from
fit_maihda(context = ) or an explicit extra grouping such as
(1 | site) – the headline auc is the intersectional-scope
concordance: it excludes those other random effects but keeps the fixed
effects plus the stratum random effect (and, for a crossed-dimensions fit, the
additive dimension effects). The concordance of the full model including the other
random effects is reported separately as auc_full
(auc_scope = "intersectional"). Caveat – this is not strata-only
discrimination. The intersectional-scope score retains the entire
fixed-effects predictor, so when the model is adjusted for individual-level
covariates (e.g. age, income that vary within strata) those
covariates enter this AUC too; it is the concordance of the adjusted fixed effects
plus the intersectional random effect(s), not of the strata alone, and it then
matches the between-stratum MOR's scope only when the fixed part is intercept-only.
For a strata-only discriminatory accuracy, score the null (strata-only) model. For
the canonical single-(1 | stratum) model with no other random effects, the
full and intersectional scopes coincide and only auc is reported
(auc_scope = "model", auc_full absent).
maihda_discriminatory_accuracy( model, binomial_weights = c("auto", "trials", "analytic") )maihda_discriminatory_accuracy( model, binomial_weights = c("auto", "trials", "analytic") )
model |
A |
binomial_weights |
How to read non-unit |
An object of class maihda_da: a list with auc,
auc_scope, auc_full, mor,
n_case, n_control, family, link, engine,
weighted, weight_type, precision_weights_ignored and
apparent (always TRUE – the AUC is in-sample; see Description).
mor is NA for a non-logit binomial link, where the AUC is still
reported. For an aggregated-binomial fit n_case / n_control are the
total successes / failures. weighted is TRUE only when the AUC is a
genuinely weighted (population-mass) concordance, with weight_type
"sampling" for a design-weighted fit (each observation contributes its
sampling weight as case/control mass, estimating the population discriminatory
accuracy); n_case / n_control stay unweighted observation counts.
weight_type is NULL for an unweighted AUC. An
aggregated-binomial fit is reported weighted = FALSE with
weight_type = NULL: its count-weighted AUC equals the ordinary
individual-level concordance over the implied 0/1 data (the trial counts are
real observations, not sampling weights), so it is not a design-weighted
population quantity. Aggregation is recognised from an lme4
cbind(success, failure) matrix response, from non-unit integral lme4
weights= on a response in [0, 1] (the trial counts, see
glm), or from a brms y | trials(n) term. The
weights-based form covers a response of exactly 0/1 – individual records
collapsed to frequency cells – because for the binomial family a prior weight
is a trial count: the weighted log-likelihood of one 0/1 row is exactly
that of w trials sharing its outcome, so the fit equals the row-expanded
one and its AUC should too. Pass binomial_weights to override. When a
response times its trial counts is not a whole number of successes –
a malformed binomial, which glmer itself warns about as "non-integer
#successes" – the fractional case/control mass is carried into the AUC as it
stands, with a warning, rather than rounded into whole observations that were
never collected; n_case / n_control are then fractional.
Weights not read as trial counts – non-integral weights=, or any
weights under binomial_weights = "analytic" – are ignored by the AUC,
which is then the ordinary observation-level concordance
(weighted = FALSE), with precision_weights_ignored = TRUE flagging
that such weights were present.
Merlo, J. (2018). Multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) within an intersectional framework. Social Science & Medicine, 203, 74-80.
# Obese (Yes/No) by intersectional strata of Gender x Race strata <- make_strata(maihda_health_data, vars = c("Gender", "Race")) d <- maihda_health_data d$stratum <- strata$data$stratum m <- fit_maihda(Obese ~ (1 | stratum), data = d, family = "binomial") maihda_discriminatory_accuracy(m)# Obese (Yes/No) by intersectional strata of Gender x Race strata <- make_strata(maihda_health_data, vars = c("Gender", "Race")) d <- maihda_health_data d$stratum <- strata$data$stratum m <- fit_maihda(Obese ~ (1 | stratum), data = d, family = "binomial") maihda_discriminatory_accuracy(m)
glance methods that return the MAIHDA headline as a
one-row tibble: the variance partition coefficient (VPC/ICC), and – for a
maihda_analysis – the proportional change in variance (PCV), plus the
additive/interaction shares and the discriminatory accuracy (AUC, MOR) for a
binomial outcome. The layout is uniform across the lme4, brms, WeMix and ordinal
engines. No other package emits this row from the underlying fit, because PCV
needs the null+adjusted pair that only a maihda_analysis holds.
## S3 method for class 'maihda_summary' glance(x, ...) ## S3 method for class 'maihda_model' glance(x, ...) ## S3 method for class 'maihda_analysis' glance(x, ...)## S3 method for class 'maihda_summary' glance(x, ...) ## S3 method for class 'maihda_model' glance(x, ...) ## S3 method for class 'maihda_analysis' glance(x, ...)
x |
A |
... |
Unused, for S3 consistency. |
A one-row tibble. glance.maihda_analysis adds pcv
(with pcv.conf.low/pcv.conf.high when bootstrapped; a brms
PCV is a point estimate), the adjusted-model auc.adjusted, nobs,
family and mode to the columns produced for a single summary.
maihda_tidiers for the per-estimate tidy() methods.
data("maihda_health_data") a <- maihda(BMI ~ Age + Gender + Race + Education + (1 | Gender:Race:Education), data = maihda_health_data) glance(a)data("maihda_health_data") a <- maihda(BMI ~ Age + Gender + Race + Education + (1 | Gender:Race:Education), data = maihda_health_data) glance(a)
A pedagogical subset of the National Health and Nutrition Examination Survey (NHANES) dataset, serving as a real-world example for Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy (MAIHDA). Contains selected records demonstrating intersectional demographic health inequalities.
maihda_health_datamaihda_health_data
A data frame with 3,000 rows and 7 variables:
Body Mass Index (kg/m^2), a continuous outcome variable.
Factor indicating obesity status (No/Yes).
Age in years at screening, a continuous covariate.
Gender of the participant (male/female).
Self-reported race/ethnicity.
Educational attainment level.
Poverty to income ratio, a continuous covariate. Some values may be missing.
This is a teaching/illustration dataset only. It is a non-random subsample and
does not carry the NHANES survey weights or complex sampling design,
so results are not survey-representative and should not be used for
substantive population inference. (For your own survey data, the package
supports design-weighted MAIHDA via the sampling_weights argument of
fit_maihda / maihda.)
Derived from the NHANES R package. Original data collected by the
Centers for Disease Control and Prevention (CDC).
data(maihda_health_data) # Example usage: # strata_result <- make_strata(maihda_health_data, vars = c("Gender", "Race", "Education")) # model <- fit_maihda(BMI ~ Age + (1 | stratum), data = strata_result$data)data(maihda_health_data) # Example usage: # strata_result <- make_strata(maihda_health_data, vars = c("Gender", "Race", "Education")) # model <- fit_maihda(BMI ~ Age + (1 | stratum), data = strata_result$data)
Reports the relative-fit information criteria for one or more MAIHDA models, to
help choose between model structures (different covariate sets, strata
definitions, or families) – a question the VPC/ICC and PCV do not address. The
criteria reported depend on the engine: AIC and BIC for the
likelihood engines (lme4, and ordinal::clmm), and the Bayesian
WAIC and LOOIC (leave-one-out information criterion) for
brms. Lower is better for all four.
maihda_ic(..., model_names = NULL)maihda_ic(..., model_names = NULL)
... |
One or more |
model_names |
Optional character vector of names, one per |
REML vs ML. lmer fits Gaussian models by REML by default, and a
REML log-likelihood (hence its AIC/BIC) is not comparable across models
with different fixed effects – exactly the canonical MAIHDA null-vs-adjusted
comparison. When more than one model is supplied, maihda_ic() therefore
refits any REML lmer model with maximum likelihood
(refitML) before computing AIC/BIC, matching the behaviour of
anova() on lme4 models; the estimator column records when
this happened. For a single model the criterion is reported as fitted (the
estimator column then reads "REML").
Comparability. Like the VPC, information criteria are only comparable
across models fitted to the same analytic sample (same rows and outcome)
with the same weights – prior (precision) weights and sampling
(design) weights each change which likelihood, or pseudo-likelihood, is being
maximised, so the criteria of a weighted and an unweighted fit of the identical
model are not on a common scale. Unlike the VPC and PCV, they do not always need
the same family: a criterion compares log-likelihoods of the same observations,
so Poisson and negative-binomial fits of the same counts are comparable, as are
binomial or cumulative (ordinal) fits that differ in their link, and a delta is
reported for them. Any other change of family or link withholds it – a Gaussian
vs a Poisson fit compares a density with a probability, and the continuous
families are compared only within the same family and link. Criteria are never
comparable between the likelihood engines and brms (AIC/BIC vs
WAIC/LOOIC are different scales). When the supplied models differ in any of
these respects maihda_ic() warns and omits the delta column,
still reporting each model's own criteria.
Parameter count. df counts the estimated parameters. A
negative-binomial lme4 fit with a fixed theta
(family = MASS::negative.binomial(theta)) therefore has one fewer than
lme4's own count, which includes theta for every negative-binomial
family, so its AIC is 2 and its BIC log(n) below
AIC() and BIC() on the fitted model; glm() counts that
family the same way. A family = "negbinomial" fit estimates theta and
counts it.
lme4 GLMM likelihoods. With nAGQ > 1, lme4's
logLik() leaves out the saturated log-likelihood (?merMod: it is
“only proportional” to the likelihood); maihda_ic() adds it back, so
a quadrature fit's criteria are the complete likelihood and compare with a
Laplace fit's. A glmer fit of a family with a scale parameter – a Gaussian
with a non-identity link, Gamma, inverse Gaussian – reports NA criteria
(estimator "ML (glmer scale family: no likelihood)"): lme4's
logLik() for those families is not the marginal likelihood, and on test
fits it exceeded the largest value that likelihood attains.
Predictive target of the Bayesian criteria. brms::waic() and
brms::loo() are computed from pointwise log-likelihoods
conditional on the fitted random effects, so WAIC/LOOIC assess
prediction of new observations within the strata (and persons or
contexts) already represented in the data – not performance for a new,
unseen intersectional stratum. Choosing between strata definitions on LOOIC
therefore compares conditional predictive fit; generalisation to new strata
is a leave-one-group-out cross-validation question (e.g.
brms::kfold() with group = "stratum"), which this package does
not wrap. AIC/BIC for the likelihood engines are instead computed from the
marginal likelihood (random effects integrated out) – a further
reason the likelihood and Bayesian criteria are never comparable with each
other.
Design-weighted fits. For the wemix (design-weighted) engine the
criteria are reported as NA: a pseudo-likelihood with sampling weights does
not define a standard AIC/BIC. A brms fit with sampling_weights is
treated the same way: its sampling weights enter as likelihood weights, giving a
pseudo-posterior whose weighted pointwise log-likelihoods are not log predictive
densities, so WAIC/LOOIC are likewise reported as NA (the
estimator column reads "Bayesian (weighted pseudo-posterior)").
A data.frame of class maihda_ic with one row per model and
the columns that apply: model, n (analytic sample size),
estimator, df (number of parameters; likelihood engines),
logLik, AIC, BIC (likelihood engines), WAIC,
LOOIC (brms), and – when more than one model is supplied – delta
(the difference from the best model on the primary criterion: AIC for the
likelihood engines, LOOIC for brms). Columns that are entirely NA across
the supplied models are dropped.
compare_maihda, which reports these criteria alongside the
VPC/ICC, and calculate_pcv for the variance decomposition.
strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) # AIC/BIC for two nested structures (REML lmer fits are ML-refitted first) maihda_ic(null_model, adj_model, model_names = c("Null", "Adjusted")) # Or straight from a one-call maihda() analysis (null + adjusted rows) a <- maihda(health_outcome ~ age + gender + race + (1 | gender:race), data = maihda_sim_data) maihda_ic(a)strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) # AIC/BIC for two nested structures (REML lmer fits are ML-refitted first) maihda_ic(null_model, adj_model, model_names = c("Null", "Adjusted")) # Or straight from a one-call maihda() analysis (null + adjusted rows) a <- maihda(health_outcome ~ age + gender + race + (1 | gender:race), data = maihda_sim_data) maihda_ic(a)
Reports, for each intersectional stratum, the interaction component of its outcome – the stratum random effect (BLUP) of an adjusted MAIHDA model, i.e. how far the stratum departs from the additive main-effects prediction of its defining dimensions – and flags the strata whose interaction is credibly different from zero. This is the heart of "where is there genuine intersectionality": a flagged stratum is one whose outcome departs credibly from what the additive parts predict – a descriptive statement about the stratum's outcome, not a causal claim about identity.
maihda_interactions( object, conf_level = 0.95, adjust = "BH", rope = NULL, scale = c("link", "response"), ... )maihda_interactions( object, conf_level = 0.95, adjust = "BH", rope = NULL, scale = c("link", "response"), ... )
object |
A |
conf_level |
Confidence / credible level for the interval and the flag. Default 0.95. |
adjust |
Multiple-comparison adjustment for the per-stratum p-values
(frequentist engines only): |
rope |
Optional equivalence region (a "smallest interaction of interest")
for an "is the interaction negligible?" reading (Schuirmann 1987;
Kruschke 2018), read on the requested |
scale |
Scale the interaction is reported on. |
... |
Currently unused. |
It must be read off the adjusted model. Only when the dimensions'
additive main effects are in the model (the adjusted model of the
two-model decomposition, or the crossed-dimensions model) does the stratum
random effect isolate the pure interaction. On a null model the stratum
random effect is the total between-stratum deviation (additive + interaction),
so passing one is flagged with a warning. The opposite mis-specification is
flagged too: a model that adds a fixed interaction among the dimensions
(e.g. var1 * var2) absorbs the intersectional effect into fixed cell means,
so the stratum random effect is no longer the pure interaction. Passing a
maihda result uses the right model automatically.
Frequentist vs. Bayesian evidence. For the frequentist engines
(lme4, wemix, ordinal) the flag comes from the BLUP's
conditional standard error: a Wald interval at conf_level and a two-sided
p-value, with an optional multiplicity correction (adjust). For
brms the full posterior is already available, so the exact
posterior tail is used – a credible interval at conf_level and the
probability of direction pd = max(P(BLUP > 0), P(BLUP < 0)) (in
[0.5, 1]; the sign is in direction) – and adjust is not
applied: the posterior is already partially pooled, the hierarchical-shrinkage
answer to multiplicity (Gelman, Hill & Yajima 2012). That is a per-stratum
answer; the marginal intervals carry no formal joint error-rate guarantee for
the collective claim "an interaction exists somewhere" (the disjunction
reading below applies to Bayesian flags too).
Multiplicity: partial pooling and a correction are different things, and the experts disagree.
Shrinkage (magnitude/sign). The stratum BLUP is partially pooled, so extreme values are regularised toward the grand mean, attenuating exaggerated-magnitude and wrong-sign (Type M/S) error (Gelman & Carlin 2014). Gelman, Hill & Yajima (2012) argue this shrinkage usually substitutes for a classical multiple-comparisons correction (the problem can "disappear entirely" in the hierarchical model); on that view the flag/no-flag step itself is what to avoid – the null of an exactly zero interaction is rarely the question (McShane, Gelman et al. 2019) – so report the estimate and its interval.
Whether to correct. If you do want an error-rate screen, whether a correction is warranted depends on the inferential structure of the claim. Each stratum as its own pre-specified hypothesis ("does this stratum interact?") is individual testing and needs none – only if you do not also read the flags collectively. Once the question is "is there an interaction somewhere?" – which an automated all-strata scan effectively is – it is disjunction testing and a correction applies.
adjust = "BH" is the default: fitting and flagging every stratum
in one call is the disjunction/screening case, where controlling the expected
proportion of false discoveries (FDR) is the appropriate goal. Pass
adjust = "none" only when each stratum is a genuine, pre-specified
individual hypothesis. The FDR choice (over family-wise
"bonferroni"/"holm") is this package's, matching that screening
goal. The flag itself is a Wald test on a shrunken BLUP whose
conditional SE treats the variance components as known, so it (and any
adjust on it) is an explicit, conservative screen – strict, not
liberal. Partial pooling deflates a truly-null
stratum's BLUP more than its conditional SE, so the null z-statistic is
sub-normal (variance about the shrinkage fraction, below 1) and the screen
under-flags rather than over-flags, degenerating to no flags at the
singular/zero-variance boundary. Lead with the interval (and, for
brms, the probability of direction); the substantive question is often not
whether an interaction differs from zero but whether it exceeds a smallest
interaction of interest (an equivalence reading; Schuirmann 1987; Kruschke 2018),
read from the interval.
The interaction is reported on the model's link (latent) scale – a log-odds deviation for a logistic model, etc. – because the additive/interaction split is only exact there. On a non-identity link that makes it a multiplicative departure, which is a different quantity from a shift in the outcome itself; see the section below before reporting it.
An object of class maihda_interactions (a data frame), one row
per stratum, sorted flagged-first then by abs(interaction). Columns
common to every engine: stratum, label, n (stratum size),
interaction (the BLUP, under the default scale),
lower/upper (the interval),
flagged (logical), and direction ("above"/"below"
the additive expectation). Under scale = "response" the
interaction/lower/upper columns hold and its
interval, and se is dropped: the conditional standard error is a
link-scale quantity, and the response-scale interval is deliberately not
symmetric about the estimate, so no single SE would reproduce it. Frequentist
fits add se (link scale only) and p_value
(and p_adjusted when adjust != "none"). p_value is a
conditional screening statistic – a Wald tail on the
shrunken BLUP's conditional SE, with the variance components treated as known
– not a calibrated frequentist p-value; it is conservative
(stochastically large under a true null), so the BH-adjusted flag under-flags
truly-null strata rather than delivering an exact error-rate guarantee (see
Details). brms instead adds
pd (probability of direction, max(P(>0), P(<0)) in
[0.5, 1]). When rope is set, a
decision column ("relevant"/"negligible"/"inconclusive")
is added. Attributes record conf_level, adjust, rope,
engine, model_type, n_strata, n_flagged,
scale, link (the model's link name, so a caller can tell a
log-odds departure from one in the outcome's own units), response_kind
(what the model's response scale is – "probability", "count",
"score" or "response" – which the link alone does not settle,
since a cumulative fit is logit-linked but scores categories), singular
(a variance of the fit is at zero, in any term), interaction_at_boundary
(the variance of the term the interaction is read from is at zero, so its
standard errors collapse; print() then says so),
and – on a non-identity link under the default scale –
response_interaction, the outcome-scale estimates keyed by stratum. That
last attribute exists so print() can show the outcome-scale size beside
the link-scale one; the columns are the same either way, and
scale = "response" is how to obtain those numbers, with their interval,
as data.
For a Gaussian (identity-link) fit the stratum BLUP is the part
of the stratum's mean outcome attributable to interaction, in the outcome's own
units. For a logistic fit it is not: is a deviation in
log-odds, so what this function reports is the multiplicative,
odds-scale interaction. (What follows is written for the logistic case, the one
the literature works in. The same logic holds on any non-identity link, in its own
units: a Poisson fit's is a log-rate departure and scale =
"response" gives it as a difference in expected counts, and a cumulative
(ordinal) fit's is a latent shift reported as a difference in expected category
score. The printed column is named for whichever applies.) Evans et al. (2024, section 2.5.1)
put it directly – in a logistic MAIHDA one can "no longer directly interpret
as the change in mean outcomes (i.e., shift in probabilities)
attributable to interaction effects".
Three quantities, of which this function reports two. Keeping them apart is the whole of the difficulty:
The multiplicative interaction, – the departure from
additivity in log-odds, i.e. whether a dimension multiplies the odds by
the same factor at every level of the others. This is what the default
scale = "link" reports and what flagged is about.
The same departure in outcome units, – what
scale = "response" returns. Evans et al. (2024) define it as
the gap between a stratum's total predicted probability and the probability
implied by the additive main effects alone, and rank-plot where
the linear case plots . This is quantity 1 re-expressed, not a
second finding: it is zero exactly when is zero and it flags the same
strata, so it changes the units you report, not what you may conclude.
The additive (risk-difference) interaction – whether a dimension
adds the same number of percentage points of risk at every level of the others.
Neither of the above reports this, and it is generally non-zero even
where is exactly zero, because the logistic curve is steeper in the
middle than in the tails. With a baseline and for each of
two dimensions and no interaction at all ( throughout), the second
dimension still adds 9.5 percentage points of risk at one level of the first
and 14.0 at the other. That excess is a property of the link, not a finding.
So "no strata flagged" supports "no credible multiplicative interaction",
not "no interaction": additivity in log-odds does not carry over to probabilities,
so quantity 3 is generally non-zero regardless, and it is often the one a policy
audience cares about. (Generally, not always. The risk-difference
interaction is positive below the curve's midpoint and negative above it, so it
passes through zero: with two dimensions of effect and it vanishes
exactly at an intercept of , where the two comparisons straddle the
midpoint symmetrically. That is a single configuration, not the general case, and
the flags say nothing about which one you are in either way.)
Both scales flag the same strata. Writing for the map from a
stratum's BLUP to its , is strictly increasing with
, so estimate, interval endpoints and zero all carry across
together. flagged, direction, p_value / p_adjusted and
pd are therefore identical under either scale, and the response-scale
interval is the exact image of the link-scale one rather than a delta-method
approximation – inheriting its conditionality (fixed effects and variance
components held at their point estimates), which is why no simulation step is
needed. What does change is the size and the ranking: the same log-odds departure
is worth more probability near than in the tail, so strata are
ordered by the quantity actually reported.
If quantity 3 is what you need, no argument here will give it to you –
fit a linear probability model instead: fit_maihda(..., family = "gaussian")
on a 0/1 outcome, which fit_maihda signposts when it auto-detects a
binary outcome. There the BLUP is the risk-difference interaction by
construction, at the usual costs (predictions outside [0, 1],
heteroskedastic residuals).
Evans, C. R., Williams, D. R., Onnela, J. P., & Subramanian, S. V. (2018). A multilevel approach to modeling health inequalities at the intersection of multiple social identities. Social Science & Medicine, 203, 64-73.
Merlo, J. (2018). Multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) within an intersectional framework. Social Science & Medicine, 203, 74-80.
Evans, C. R., Leckie, G., Subramanian, S. V., Bell, A., & Merlo, J. (2024). A tutorial for conducting intersectional multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA). SSM - Population Health, 26, 101664. doi:10.1016/j.ssmph.2024.101664
Gelman, A., Hill, J., & Yajima, M. (2012). Why we (usually) don't have to worry about multiple comparisons. Journal of Research on Educational Effectiveness, 5(2), 189-211.
Gelman, A., & Carlin, J. (2014). Beyond power calculations: assessing Type S (sign) and Type M (magnitude) errors. Perspectives on Psychological Science, 9(6), 641-651.
Rubin, M. (2021). When to adjust alpha during multiple testing: a consideration of disjunction, conjunction, and individual testing. Synthese, 199(3-4), 10969-11000. doi:10.1007/s11229-021-03276-4
McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L. (2019). Abandon statistical significance. The American Statistician, 73(sup1), 235-245.
Schuirmann, D. J. (1987). A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. Journal of Pharmacokinetics and Biopharmaceutics, 15(6), 657-680.
Kruschke, J. K. (2018). Rejecting or accepting parameter values in Bayesian estimation. Advances in Methods and Practices in Psychological Science, 1(2), 270-280.
maihda, calculate_pcv,
summary.maihda_model; and plot(...,
highlight_interactions = TRUE) to mark the flagged strata on the
effect-decomposition / predicted / shrinkage plots.
data(maihda_health_data) a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) maihda_interactions(a) # FDR-screened (default adjust = "BH") maihda_interactions(a, adjust = "none") # uncorrected per-stratum individual view maihda_interactions(a, rope = 0.1) # equivalence: |interaction| within 0.1? # On a logistic fit the BLUP is a log-odds departure; scale = "response" reports # Evans et al.'s (2024) pi_j - pi^A_j, the same interaction in probability points. b <- maihda(Obese ~ Gender + Race + (1 | Gender:Race), data = maihda_health_data, family = "binomial") maihda_interactions(b, scale = "response")data(maihda_health_data) a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) maihda_interactions(a) # FDR-screened (default adjust = "BH") maihda_interactions(a, adjust = "none") # uncorrected per-stratum individual view maihda_interactions(a, rope = 0.1) # equivalence: |interaction| within 0.1? # On a logistic fit the BLUP is a log-odds departure; scale = "response" reports # Evans et al.'s (2024) pi_j - pi^A_j, the same interaction in probability points. b <- maihda(Obese ~ Gender + Race + (1 | Gender:Race), data = maihda_health_data, family = "binomial") maihda_interactions(b, scale = "response")
A simulated long-format (one row per person-occasion) panel for demonstrating
longitudinal / growth-curve MAIHDA (fit_maihda(id =, time =) and
maihda(decomposition = "longitudinal")). 600 individuals are each
measured over five waves on a continuous wellbeing score, within 12
intersectional strata defined by gender x ethnicity x education. The
between-stratum trajectory differences are constructed to be mostly
additive (each dimension's main effect on the baseline level and on the rate of
change) with one genuine multiplicative interaction, so the longitudinal PCV –
a high but sub-1 PCV_slope – is demonstrable.
maihda_long_datamaihda_long_data
A data frame with 3000 rows (600 persons x 5 waves) and 8 variables:
Person identifier (level 2); repeated across waves.
Measurement occasion, 0 to 4 (the numeric time variable).
Gender (Women/Men); a stratum dimension.
Ethnicity (EthA/EthB/EthC); a stratum dimension.
Education (Low/High); a stratum dimension.
Baseline age in years, a time-invariant covariate.
Continuous wellbeing outcome (the growth-curve response).
Binary companion outcome (1 = bottom 40% of wellbeing), for the logistic longitudinal path.
Simulated for the purpose of the MAIHDA package. The growth structure follows the longitudinal MAIHDA of Bell, Evans, Holman & Leckie (2024) doi:10.1016/j.socscimed.2024.116955.
data(maihda_long_data) # Time-varying VPC from a 3-level growth model: m <- fit_maihda(wellbeing ~ wave + (1 | gender:ethnicity:education), data = maihda_long_data, id = "id", time = "wave") summary(m) # Additive-vs-multiplicative PCV (null vs adjusted growth model): a <- maihda(wellbeing ~ wave + (1 | gender:ethnicity:education), data = maihda_long_data, id = "id", time = "wave", decomposition = "longitudinal") a$pcvdata(maihda_long_data) # Time-varying VPC from a 3-level growth model: m <- fit_maihda(wellbeing ~ wave + (1 | gender:ethnicity:education), data = maihda_long_data, id = "id", time = "wave") summary(m) # Additive-vs-multiplicative PCV (null vs adjusted growth model): a <- maihda(wellbeing ~ wave + (1 | gender:ethnicity:education), data = maihda_long_data, id = "id", time = "wave", decomposition = "longitudinal") a$pcv
The Median Odds Ratio translates the between-stratum variance of a logistic
MAIHDA model onto the odds-ratio scale: the median relative change in the odds
of the outcome when comparing two individuals from randomly chosen strata
(higher- vs lower-risk). MOR = exp(sqrt(2 * V_A) * qnorm(0.75)), where
V_A is the between-stratum (latent, logit-scale) variance. An MOR of 1
indicates no between-stratum heterogeneity. The MOR is defined only for the
logit link (it is the median odds ratio); a non-logit binomial
fit such as probit is rejected, because its latent variance is on a
different scale and the exp(...) above would not be an odds ratio.
For a cumulative-logit (ordinal) MAIHDA model the same formula applies to the latent logit-scale between-stratum variance and is the median cumulative odds ratio: the median relative change in the odds of being at or below any given outcome category between two randomly chosen strata (under the model's proportional-odds assumption it is the same for every category split).
Scope. V_A is the between-stratum variance. Contextual
(context = ) and other non-stratum random effects are never included:
the MOR compares two individuals from randomly chosen strata within
the same context.
Crossed-dimensions fits use a different calculation. The closed form
above assumes the two strata's random effects are independent, which is
what makes their difference . In a crossed-dimensions fit
(from maihda(decomposition = "crossed-dimensions")) a stratum's effect
is the sum of its dimension effects plus the intersection effect, so two
strata sharing a dimension – say two strata that are both "female" – share
that dimension's random effect and are correlated. Their difference
is then a mixture of normals, one component per pattern of shared
dimensions, and applying the closed form to the summed variance overstates the
MOR (substantially so when the variance sits mainly in the additive
dimensions, and not at all when it sits entirely in the interaction).
The MOR reported for such a fit is therefore computed from that mixture, under
an explicit sampling scheme: two distinct strata drawn uniformly at
random from the strata present in the analytic sample. Writing
for dimension 's variance and for the
intersection variance, a pair differing on the dimension set has
difference variance , and the
MOR is exp(x) for the x solving
. For a canonical
single-stratum fit the two calculations coincide, and that closed form is
used.
brms fits. For a brms fit V_A is the posterior median of
the between-stratum variance, the value in the variance-components table of
summary.maihda_model. The closed form is monotone in V_A, so
the MOR is then the posterior median of the Median Odds Ratio itself. A
crossed-dimensions fit evaluates the mixture at the posterior median of each
variance. With few strata the posterior of a variance is right-skewed and its
median overstates the variance, so the MOR runs high; the overstatement shrinks
as strata are added.
maihda_mor(model)maihda_mor(model)
model |
A |
A single number (the MOR, ), or NA_real_ if the
between-stratum variance is unavailable – which for a crossed-dimensions fit
also covers the case where the stratum grid needed for the mixture cannot be
resolved (fewer than two strata, absent dimension columns, or more than 12
dimensions).
Larsen, K., & Merlo, J. (2005). Appropriate assessment of neighborhood effects on individual health: integrating random and fixed effects in multilevel logistic regression. American Journal of Epidemiology, 161(1), 81-88.
maihda_discriminatory_accuracy
Tests the proportional-odds (parallel-lines) assumption of a fitted
cumulative clmm MAIHDA model by calibrating the omnibus
nominal-effects likelihood-ratio statistic against its own null distribution
under the fitted model.
maihda_proportional_odds_test(object, n_sim = 199, seed = NULL)maihda_proportional_odds_test(object, n_sim = 199, seed = NULL)
object |
A |
n_sim |
Number of parametric-bootstrap replicates (default 199). |
seed |
Optional integer seed, for a reproducible bootstrap. |
The statistic is the omnibus nominal-effects likelihood-ratio statistic: the
fixed-effect part of the model is refitted twice with ordinal::clm() –
once with all covariates proportional, once with every covariate entering as a
threshold-specific (nominal) effect – and twice the log-likelihood difference
is taken.
Its usual chi-squared reference (ordinal::nominal_test()) is not valid
here. After the stratum random intercept is integrated out, the marginal
cumulative-logit slopes generally differ across thresholds once the stratum
variance is non-zero. The chi-squared reference also treats the observations
as independent, whereas observations that share a stratum share its random
effect. A correctly specified model is therefore rejected too often, and more
often as the sample grows.
The null distribution is instead simulated under the fitted clmm: each
replicate redraws the stratum random effects from at the
fitted variance, forms the conditional category probabilities from the fitted
thresholds and location predictor, redraws the response, and recomputes the
statistic. The p-value is
over the replicates that refitted. n_sim sets only its Monte
Carlo resolution: the smallest attainable value is .
This is a parametric-bootstrap approximation, not an exact test. The replicates
are drawn at the fitted stratum variance, which is estimated from only as many
units as there are strata, so the test is least reliable when the strata are
few, whatever n_sim is.
The test is expensive – every replicate refits two clm() models – and
is not run at fit time.
An object of class maihda_po_test: a list with lrt,
df, n_terms, p_value (the bootstrap p-value),
p_chisq, n_sim (replicates that produced a usable statistic),
n_failed, and null_lrt (the simulated null statistics).
p_value is the one to report and the only one printed. p_chisq
is the chi-squared p-value of the same statistic; it is not calibrated for a
mixed model (see Details) and is returned for comparison only.
strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) d <- strata$data d$y <- factor(cut(d$health_outcome, 3), labels = 1:3, ordered = TRUE) m <- fit_maihda(y ~ age + (1 | stratum), data = d, family = "ordinal") maihda_proportional_odds_test(m, n_sim = 99, seed = 1)strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) d <- strata$data d$y <- factor(cut(d$health_outcome, 3), labels = 1:3, ordered = TRUE) m <- fit_maihda(y ~ age + (1 | stratum), data = d, family = "ordinal") maihda_proportional_odds_test(m, n_sim = 99, seed = 1)
A simulated dataset for demonstrating Multilevel Analysis of Individual Heterogeneity and Discriminatory Accuracy (MAIHDA).
maihda_sim_datamaihda_sim_data
A data frame with 500 rows and 7 variables:
Unique participant identifier.
Gender of the participant.
Simulated race/ethnicity category.
Educational attainment level.
Age in years, a continuous covariate.
A continuous simulated health outcome.
A binary version of the health outcome.
Simulated for the purpose of the MAIHDA package.
data(maihda_sim_data) strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race", "education"))data(maihda_sim_data) strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race", "education"))
A simulated cross-sectional dataset built to showcase **Bayesian (brms) MAIHDA for sparse intersections** – the regime where many intersectional strata each hold only a handful of individuals. There the maximum-likelihood (lme4) fit of the *interaction* between-stratum variance can be singular, so the additive-vs-interaction split is both unstable and falsely precise; weakly-informative priors ('engine = "brms"') regularise the variance off the boundary and return a credible interval.
maihda_sparse_datamaihda_sparse_data
A data frame with 240 rows and 6 variables:
Strata dimension (Women/Men).
Strata dimension (White/Black/Asian).
Strata dimension (Low/High).
Strata dimension (Young/Mid/Older).
A continuous (Gaussian) outcome. True between-stratum VPC 0.26, of which 40% is the intersectional interaction.
A binary outcome (No/Yes), ~46% "Yes". Its latent-scale between-stratum VPC is 0.31, again 40% interaction.
The exact generative truth is also attached as
attr(maihda_sparse_data, "truth") (additive/interaction variances, shares,
and VPCs for each outcome).
The data carry a **known, non-trivial interaction** so the vignette can claim *recovery* rather than merely report numbers: 4 dimensions form 36 intersectional strata with deliberately skewed sizes (median 6 individuals, 12 of 36 cells below 5, two singletons), and the true interaction accounts for **40 between-stratum variance** on both outcomes. On the binary outcome a genuine 40 interaction is read by lme4 as roughly 3
A purely illustrative dataset. The dimension labels are arbitrary and the interaction is constructed, not estimated from any real population – its only purpose is to make the sparse-cell behaviour of the ML and Bayesian estimators visible against a known answer.
Simulated; see data-raw/maihda_sparse_data.R.
data(maihda_sparse_data) attr(maihda_sparse_data, "truth")$gaussian$interaction_share # 0.40 # ML over-shrinks the interaction under sparse cells (often a singular fit): # m_lme4 <- maihda(y ~ 1 + (1 | gender:ethnicity:education:age_group), # data = maihda_sparse_data, decomposition = "crossed-dimensions") # # Weakly-informative priors regularise it and report an interval: # m_brms <- maihda(y ~ 1 + (1 | gender:ethnicity:education:age_group), # data = maihda_sparse_data, decomposition = "crossed-dimensions", # engine = "brms", # prior = brms::set_prior("normal(0, 0.5)", class = "sd")) # See vignette("bayesian_sparse_maihda").data(maihda_sparse_data) attr(maihda_sparse_data, "truth")$gaussian$interaction_share # 0.40 # ML over-shrinks the interaction under sparse cells (often a singular fit): # m_lme4 <- maihda(y ~ 1 + (1 | gender:ethnicity:education:age_group), # data = maihda_sparse_data, decomposition = "crossed-dimensions") # # Weakly-informative priors regularise it and report an interval: # m_brms <- maihda(y ~ 1 + (1 | gender:ethnicity:education:age_group), # data = maihda_sparse_data, decomposition = "crossed-dimensions", # engine = "brms", # prior = brms::set_prior("normal(0, 0.5)", class = "sd")) # See vignette("bayesian_sparse_maihda").
Assembles the two standard MAIHDA write-up deliverables from a fitted analysis
in one call: (a) a model-results table contrasting the null and adjusted
models (intercept, between-stratum variance and SD, VPC/ICC, the PCV, and – for a
binary outcome – the AUC and Median Odds Ratio), and (b) a ranked-strata
table ordering the intersectional strata by their predicted outcome, so the
best- and worst-off strata can be read directly. It introduces no new estimator:
the model-results table reuses the quantities from summary() (calling
summary() itself for a bare fit_maihda model), and the
ranked-strata table reuses the same stratum predictions as
plot(type = "predicted"), so the table agrees exactly with summary()
and plot().
maihda_table( x, n_strata = 10L, scale = c("response", "link"), which = c("null", "adjusted"), digits = 3, ... )maihda_table( x, n_strata = 10L, scale = c("response", "link"), which = c("null", "adjusted"), digits = 3, ... )
x |
A |
n_strata |
Number of strata to show at each end (top and bottom) in the
printed ranked-strata table. The returned |
scale |
Scale for the predicted stratum values: |
which |
For a two-model analysis, which model's predictions to rank the
strata by: |
digits |
Number of decimal places for the |
... |
For a |
The model-results table is mostly numeric and export-ready (e.g.
write.csv(maihda_table(a)$models, ...) or pass it to knitr::kable()):
statistics are rows, models are columns, and each estimate has accompanying
*_lower/*_upper columns that hold the confidence/credible interval
when one is available (the intercept's interval, the VPC bootstrap or posterior
interval, and the bootstrap PCV interval) and NA otherwise. The intercept
carries the same interval summary() reports for it – a Wald interval
for the likelihood engines, a credible interval for brms. The variance and SD
rows are point estimates. The print() method renders the same table in the familiar
“estimate [low, high]” layout.
For a "crossed-dimensions" analysis (one model, no null/adjusted pair) the
results table has a single estimate column and gains “Additive share” /
“Interaction share” rows instead of the PCV. For a contextual
cross-classified analysis (maihda(context = )) it gains a
“Context share (VPC)” row. A bare fit_maihda model is also
accepted and yields a single-model table (no PCV).
The ranked-strata table ranks every stratum by its model-predicted outcome (on the
scale requested), using the same stratum predictions as
plot(type = "predicted"): the predicted value carries the conditional
(random-effect) interval, and the stratum random effect (BLUP) is reported
alongside it. By default the ranking uses the null model – the headline
intersectional inequality (which strata fare best/worst overall); set
which = "adjusted" to rank by the adjusted model instead. The full ranked
table is returned in $strata; print() shows the top and bottom
n_strata.
An object of class maihda_table: a list with
models |
a data frame of the model-results table (statistics in rows; one
estimate column per model, each with |
strata |
a data frame of all strata ranked by predicted outcome, with
|
strata_note |
a character note explaining why |
models_note |
a character note (or |
model_keys, model_labels
|
the estimate-column keys and their display labels |
family, engine, mode, scale, ranked_by, n_obs, n_strata_total, context_vars
|
metadata used by |
maihda, summary.maihda_model,
calculate_pcv, maihda_discriminatory_accuracy.
data(maihda_health_data) a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) tab <- maihda_table(a) tab # printed: model-results table + top/bottom strata tab$models # the numeric, export-ready results table tab$strata # all strata ranked by predicted BMI # write.csv(tab$models, "results.csv", row.names = FALSE)data(maihda_health_data) a <- maihda(BMI ~ Age + Gender + Race + (1 | Gender:Race), data = maihda_health_data) tab <- maihda_table(a) tab # printed: model-results table + top/bottom strata tab$models # the numeric, export-ready results table tab$strata # all strata ranked by predicted BMI # write.csv(tab$models, "results.csv", row.names = FALSE)
tidy methods that return the MAIHDA estimates as a tidy
tibble, ready for downstream tables (gt, flextable) and
ggplot2. They read the slots that summary.maihda_model
already computes and add no new statistics.
## S3 method for class 'maihda_summary' tidy(x, component = c("strata", "variance", "fixed"), ...) ## S3 method for class 'maihda_model' tidy(x, component = c("strata", "variance", "fixed"), ...) ## S3 method for class 'maihda_analysis' tidy( x, component = c("strata", "variance", "fixed"), which = c("null", "adjusted"), ... )## S3 method for class 'maihda_summary' tidy(x, component = c("strata", "variance", "fixed"), ...) ## S3 method for class 'maihda_model' tidy(x, component = c("strata", "variance", "fixed"), ...) ## S3 method for class 'maihda_analysis' tidy( x, component = c("strata", "variance", "fixed"), which = c("null", "adjusted"), ... )
x |
A |
component |
Which estimates to return:
|
... |
Unused, for S3 consistency. |
which |
For a |
A tibble. For component = "strata": columns
stratum, label, estimate, std.error,
conf.low, conf.high. For "variance": component,
variance, sd, proportion. For "fixed": term,
estimate, std.error, statistic, df, p.value,
conf.low, conf.high.
For the lme4, WeMix and ordinal engines
statistic is the Wald statistic (estimate / std.error),
p.value its two-sided p-value, conf.low/conf.high the
matching Wald interval at the summary's conf_level, and df
the denominator degrees of freedom they were built on.
A Gaussian lme4 fit reports containment (between-within) df
and a ; every other engine leaves df NA and uses a z.
Under summary(df_method = "bootstrap") p.value and the
interval come from the parametric bootstrap and df is NA.
See summary.maihda_model. For brms the estimate is the
posterior mean with its Est.Error and credible interval, and
statistic/df/p.value are NA. Standard errors
are NA where they are undefined (a boundary fit).
glance.maihda_analysis for the one-row model summary.
data("maihda_health_data") m <- fit_maihda(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data) tidy(m) # stratum estimates tidy(m, component = "variance") tidy(m, component = "fixed")data("maihda_health_data") m <- fit_maihda(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data) tidy(m) # stratum estimates tidy(m, component = "variance") tidy(m, component = "fixed")
Computes sensible width and height (in inches) for
plot(object, type = "upset"), so a knitr chunk or
ggsave() call can size the figure to its content. The
UpSet composite grows taller with the number of matrix rows (one per
binary 0/1 dimension, one per level of a multi-level factor) and wider
with the number of strata columns shown, so a single fixed size tends to crop
or stretch it – particularly for multi-level designs (many rows) or a large
n_strata (many columns; UpSet is an inherently wide format).
maihda_upset_size(object, n_strata = 50)maihda_upset_size(object, n_strata = 50)
object |
A |
n_strata |
Maximum number of strata the plot will show – pass the same
value you give |
A list with numeric width and height (inches) plus the
rows (matrix rows) and cols (strata shown) they derive from.
strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ (1 | stratum), data = strata$data) sz <- maihda_upset_size(model, n_strata = 30) ggplot2::ggsave( tempfile(fileext = ".png"), plot(model, type = "upset", n_strata = 30), width = sz$width, height = sz$height)strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ (1 | stratum), data = strata$data) sz <- maihda_upset_size(model, n_strata = 30) ggplot2::ggsave( tempfile(fileext = ".png"), plot(model, type = "upset", n_strata = 30), width = sz$width, height = sz$height)
Computes the variance partition coefficient on the scale of the observed response: the probability scale for a binomial MAIHDA model, the count scale for a Poisson or negative-binomial one.
For a binomial model it uses the simulation method of Goldstein, Browne &
Rasbash (2002). Stratum random effects are
simulated and converted to predicted probabilities
(with the fixed-part linear predictor); the VPC is then the
between-stratum variance of as a share of the total
(between + the binomial within-stratum variance ).
Unlike the latent-scale VPC (fixed level-1 variance for the logit),
the response-scale VPC depends on the overall outcome prevalence, so report it as
a complement to – not a replacement for – the latent-scale value.
For a Poisson or negative-binomial model with the log link it evaluates
the exact expressions of Leckie, Browne, Goldstein, Merlo & Austin (2020). With
the marginal expected count, the
between-stratum variance of the counts is
and their within-stratum variance is
, where
is the negative-binomial overdispersion (0 for a Poisson model); the VPC is the
between-stratum variance as a share of their sum. It is the share of the variance
of the counts themselves that lies between strata, and it involves no
approximation of the level-1 variance. The latent-scale VPC of
summary.maihda_model refers to the log scale instead and depends on
the count_approximation of fit_maihda, so the two answer
different questions. Report the count-scale VPC when the partition should
describe the observed counts, or when the expected count is low and the
latent-scale approximations disagree.
maihda_vpc_response(model, n_sim = 10000, seed = NULL)maihda_vpc_response(model, n_sim = 10000, seed = NULL)
model |
A binomial, Poisson or negative-binomial |
n_sim |
Number of Monte-Carlo draws of the stratum random effect (>= 100) for a binomial model. Default 10000. |
seed |
Optional integer seed for the binomial simulation. |
Binomial models.
The fixed part is collapsed to a single value – the mean linear
predictor over the analytic sample – before the random effect is
simulated around it. The result is therefore a VPC evaluated at the mean
covariate profile (a conditional-at-mean estimate), not one marginalised over the
empirical covariate distribution. For the canonical strata-only (null) model
is constant (the intercept), so the two coincide and the value is
exact. For an adjusted model (one with covariates) they can differ, because
the inverse link is nonlinear and :
read the response-scale VPC from the null model, or interpret an adjusted value as
conditional on the average covariate profile rather than as a covariate-averaged
(marginal) VPC.
The method is binomial-link agnostic: it maps the simulated stratum effects through whichever inverse link the model uses (logit, probit, cloglog, ...), so a non-logit binomial fit is computed on its own scale rather than rejected. Only the family is required to be binomial.
When the model carries random intercepts beyond the stratum (a
contextual (1 | school) or an explicit (1 | site)), the
simulation integrates over them: the reported estimate is the
stratum share of the total
response-scale variance, where the total includes the variation the other
random effects induce in plus the binomial within-variance.
Simulating the stratum effect alone would overstate the stratum share. The
inner integral over the combined non-stratum effect is evaluated by
deterministic Gauss-Hermite quadrature, not an inner Monte-Carlo
sample, so it contributes no simulation error of its own and increasing
n_sim converges the whole estimate (the outer stratum draw is then the
only Monte-Carlo dimension). The number of quadrature nodes used is reported in
inner_nodes.
Count models. is computed for each observation of the
analytic sample from its fixed-part linear predictor, any offset included, so
with covariates or an offset the VPC differs between observations. The
estimate is the mean of the observation-level VPCs; their median,
quartiles and range are returned with it, as are the mean and range of
. Prior weights of the fit enter these summaries as
frequencies. A null model without an offset has a single and a
single VPC. n_sim and seed are not used.
The expressions are those of a model whose only random effect is the stratum
random intercept. A count model with a context or any other additional
random effect, a crossed-dimensions fit, a longitudinal fit, and a link other
than the log are refused.
An object of class maihda_vpc_response: a list with
estimate, scale = "response", method
("simulation" for a binomial model, "closed-form" for a count
model), var_between (the latent-scale between-stratum variance) and
var_other (the summed latent-scale variance of any non-stratum random
intercepts, 0 when there are none).
For a binomial model it also holds n_sim, lp_fixed (the mean
fixed-part linear predictor), inner_method ("gauss-hermite" when
non-stratum effects are integrated out, else "none") and
inner_nodes (the number of Gauss-Hermite quadrature nodes used for that
inner integral, NA when there are no non-stratum effects).
For a count model it also holds family, the median,
quartiles and range of the observation-level VPCs (all equal to
estimate when is the same for every observation),
lambda (the mean marginal expected count), lambda_range and
theta (the negative-binomial dispersion, Inf for a Poisson
model).
Goldstein, H., Browne, W., & Rasbash, J. (2002). Partitioning variation in multilevel models. Understanding Statistics, 1(4), 223-231.
Leckie, G., Browne, W. J., Goldstein, H., Merlo, J., & Austin, P. C. (2020). Partitioning variation in multilevel models for count data. Psychological Methods, 25(6), 787-801. doi:10.1037/met0000265
maihda_discriminatory_accuracy, summary.maihda_model
strata <- make_strata(maihda_health_data, vars = c("Gender", "Race")) d <- maihda_health_data d$stratum <- strata$data$stratum m <- fit_maihda(Obese ~ (1 | stratum), data = d, family = "binomial") maihda_vpc_response(m, seed = 1) # A count outcome: the VPC on the count scale, in closed form set.seed(1) u <- rnorm(max(d$stratum), sd = 0.4) d$visits <- rpois(nrow(d), exp(0.5 + u[d$stratum])) m_count <- fit_maihda(visits ~ (1 | stratum), data = d, family = "poisson") maihda_vpc_response(m_count)strata <- make_strata(maihda_health_data, vars = c("Gender", "Race")) d <- maihda_health_data d$stratum <- strata$data$stratum m <- fit_maihda(Obese ~ (1 | stratum), data = d, family = "binomial") maihda_vpc_response(m, seed = 1) # A count outcome: the VPC on the count scale, in closed form set.seed(1) u <- rnorm(max(d$stratum), sd = 0.4) d$visits <- rpois(nrow(d), exp(0.5 + u[d$stratum])) m_count <- fit_maihda(visits ~ (1 | stratum), data = d, family = "poisson") maihda_vpc_response(m_count)
This function creates strata (intersectional categories) from multiple categorical variables in a dataset.
make_strata( data, vars, sep = " × ", min_n = 1, autobin = TRUE, bin_rows = NULL )make_strata( data, vars, sep = " × ", min_n = 1, autobin = TRUE, bin_rows = NULL )
data |
A data frame containing the variables to create strata from. |
vars |
Character vector of variable names to use for creating strata. |
sep |
Separator to use between variable values when creating stratum labels. Default is " \u00d7 " (a mathematical multiplication sign). |
min_n |
Minimum number of observations required for a stratum to be included. Strata with fewer observations will be coded as NA. Default is 1. |
autobin |
Logical indicating whether to automatically bin numeric grouping
variables with more than 10 unique values into 3 categories (tertiles).
Default is TRUE. When this happens a |
bin_rows |
Optional logical vector, one element per row of |
If any of the specified variables has a missing value (NA) for a given observation, that observation will be assigned to the NA stratum (stratum = NA), rather than creating a stratum that includes the missing value.
The strata_info data frame is also attached as an attribute to the data, which allows fit_maihda() to automatically capture stratum labels for use in plots and summaries.
When autobin discretises a numeric grouping variable v, the
adjusted-model and prediction machinery later add an internal factor column named
.maihda_dim_<v>; the .maihda_dim_ prefix is therefore reserved.
make_strata() errors if data already holds the .maihda_dim_<v>
column for a variable it is about to auto-bin, so an existing user column is never
silently overwritten (rename it, or pass autobin = FALSE).
A numeric grouping variable with 10 or fewer unique values (or any numeric when
autobin = FALSE) is kept as its raw values: distinct values still define
distinct strata, but the variable is not binned. If such a variable is then
used to build an adjusted MAIHDA (maihda), it enters the adjusted model
as a linear fixed effect rather than categorical main effects, and maihda()
warns (when it has three or more distinct values). Wrap category codes in
factor() before creating strata if you want them treated categorically.
An object of class maihda_strata: a list with elements
data |
The original data frame with an added 'stratum' column. The strata_info is also attached as an attribute for use by fit_maihda() |
strata_info |
A data frame with information about each stratum including counts and the combination of variable values |
vars |
The stratum-defining variable names, as supplied. |
sep |
The label separator used. |
min_n |
The minimum stratum size applied. |
autobin_info |
A named list with the |
# Create strata from gender and race variables result <- make_strata(maihda_sim_data, vars = c("gender", "race")) print(result$strata_info)# Create strata from gender and race variables result <- make_strata(maihda_sim_data, vars = c("gender", "race")) print(result$strata_info)
Apportions the between-stratum variance reduction (the PCV) among a set of
predictors. Where stepwise_pcv adds the variables one at a
time – so each variable's contribution depends on its entry order –
pcv_importance() treats the PCV as a value function over variable
subsets and attributes it fairly: the flagship "shapley"
method averages each variable's marginal PCV over every possible entry
order, and "dominance" adds Budescu's pairwise dominance detail (its
general dominance weights coincide with the Shapley values). All methods
satisfy the efficiency identity: the contributions sum exactly to
the full model's total PCV. (The order-dependent "sequential" method
is deprecated; use stepwise_pcv for the sequential
path – see the method argument.)
Two attribution targets are useful in a MAIHDA. Passing the stratum
dimensions (e.g. c("gender", "race", "education")) splits the
additive share – the canonical null-to-adjusted PCV – fairly across the
dimensions: which social dimension drives the additive between-stratum
inequality. Passing individual-level covariates gives an
order-invariant counterpart to stepwise_pcv(): how much each
covariate explains of the between-stratum variance (subject to the
latent-scale caveat below for non-Gaussian families).
pcv_importance( data, outcome, vars, method = c("shapley", "sequential", "dominance"), approx = c("exact", "montecarlo"), n_perm = 2000, engine = "lme4", family = "gaussian", context = NULL, sampling_weights = NULL, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML") )pcv_importance( data, outcome, vars, method = c("shapley", "sequential", "dominance"), approx = c("exact", "montecarlo"), n_perm = 2000, engine = "lme4", family = "gaussian", context = NULL, sampling_weights = NULL, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, estimation = c("fitted", "ML") )
data |
Data frame with observations. Ensure |
outcome |
Character string; the dependent variable. |
vars |
Character vector of predictors (stratum dimensions and/or
covariates) among which the PCV is apportioned. Order does not affect the
|
method |
Attribution method: |
approx |
For |
n_perm |
Number of random permutations for
|
engine |
Modeling engine ("lme4", "brms", "wemix", or "ordinal");
default "lme4". Resolved exactly as in |
family |
Error distribution and link function. Default "gaussian";
a binary or ordered-factor outcome is auto-detected when |
context |
Optional higher-level context column(s) (e.g.
|
sampling_weights |
Optional name of a sampling-weight column for
design-weighted fits; see |
bootstrap |
Logical; compute parametric-bootstrap confidence intervals
for each contribution by refitting every subset model on responses
simulated from the full model. lme4 engine and exact attribution
only; the cost is |
n_boot |
Number of bootstrap draws if |
conf_level |
Confidence level for bootstrap intervals. Default 0.95. |
estimation |
Variance-estimation basis for the between-stratum variances the
attribution differences across subset models, |
Value function and efficiency. Write for the null model's
between-stratum variance and for the between-stratum variance
after adding the variable subset as fixed effects (each put on the
estimation basis – the default "fitted" keeps each lmer
fit's own REML variance, "ML" refits it with maximum likelihood –
exactly as in calculate_pcv and stepwise_pcv, so
all attributions live on the same scale as the rest of the package). The value
function is – the total PCV of the model
that adds – and the Shapley contribution of variable
averages its marginal PCV over all subsets with
the usual Shapley weights. Because every permutation's marginals telescope
to , the contributions of every method here (including the
Monte-Carlo approximation, for any n_perm) sum exactly to the
full-model total PCV. This is the multilevel-PCV analogue of the LMG /
Shorrocks-Shapley decomposition of (Groemping 2006; Shorrocks 2013).
Sequential method (deprecated) vs. stepwise_pcv(). The
"sequential" method is deprecated in favour of
stepwise_pcv, which owns the sequential trajectory and also
reports the Step_PCV column and the discriminatory-accuracy path.
While it remains, its contributions are the increments in total PCV
along the entry order, – i.e.
diff(c(0, Total_PCV)) of the stepwise_pcv table, so
they sum to the same total. They are not the Step_PCV column,
which normalises each step by the previous step's variance rather
than by .
Exact vs. Monte-Carlo cost. The exact attribution fits
non-empty subset models plus the null – fits in
total, with every fit cached and reused across all marginal differences:
256 fits at , 1024 at
. That is feasible for lme4 but quickly infeasible
beyond, and each of those fits is a separate Stan run under
engine = "brms" – exact attribution on brms is therefore strongly
discouraged except for very small . The Monte-Carlo route samples
n_perm entry orders (unbiased for the Shapley values, since a
uniform random permutation reproduces the Shapley weights), reports a
per-variable Monte-Carlo standard error, and warns when the largest
MC_SE exceeds 0.01 on the PCV scale (increase n_perm).
Latent-scale families and rescaling. For binomial/ordinal (and, in
attenuated form, count) families, adding a predictor that varies
within strata rescales the latent metric, so its marginal PCV mixes
explained variance with rescaling (see the latent-scale note in
calculate_pcv); Shapley values of the PCV inherit this.
Attribution among the stratum dimensions – constant within each
stratum – is largely unaffected.
Suppression and negative contributions. The PCV can be negative,
so a contribution (and its Share) can be negative or exceed 100%.
Efficiency still holds; contributions are reported signed and no
non-negative normalisation is applied. A negative Shapley contribution
flags a suppressor-style variable whose inclusion tends to raise the
between-stratum variance.
Bootstrap. With bootstrap = TRUE the whole attribution is
bootstrapped: responses are simulated from the full model and every subset
model is refit per draw (lme4::refit), giving percentile intervals
per contribution – n_boot times n_fits refits, so gate it by
cost. Available for engine = "lme4" with exact attribution (any
method); the Monte-Carlo approximation already carries its own
sampling error and is not combined with the bootstrap. As in
calculate_pcv, refit() holds a glmer.nb
dispersion parameter fixed at its original estimate.
An object of class maihda_pcv_importance: a list with
importance |
Data frame with one row per variable (in the order of
|
total_pcv |
The full-model PCV, |
null_variance, full_variance
|
Between-stratum variance of the null
and the full (all- |
subsets |
Data frame of every subset model fit: the variables in the
subset, its size, between-stratum variance, and PCV |
conditional, complete_dominance
|
|
method, approx, n_perm, n_fits, n_obs, engine, family, context, bootstrap, conf_level, n_boot_ok, n_boot_boundary, n_boot_nonconverged, interval_reliable, estimation, estimation_used
|
Metadata;
|
approx = "montecarlo" draws random permutations with the session RNG;
call set.seed() first for reproducible results. The exact methods are
deterministic.
Budescu, D. V. (1993). Dominance analysis: a new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114(3), 542-551.
Groemping, U. (2006). Relative importance for linear regression in R: the package relaimpo. Journal of Statistical Software, 17(1), 1-27.
Shorrocks, A. F. (2013). Decomposition procedures for distributional analysis: a unified framework based on the Shapley value. Journal of Economic Inequality, 11, 99-126.
stepwise_pcv for the sequential path with the
discriminatory-accuracy trajectory, calculate_pcv for the
two-model PCV and the latent-scale caveat, and maihda for
the canonical null-vs-adjusted decomposition.
strata <- make_strata(maihda_sim_data, c("gender", "race")) # Order-invariant split of the PCV across the two dimensions and age imp <- pcv_importance(strata$data, "health_outcome", c("gender", "race", "age")) print(imp) plot(imp) # Dominance analysis: adds conditional / complete dominance detail pcv_importance(strata$data, "health_outcome", c("gender", "race", "age"), method = "dominance") # Monte-Carlo approximation (set a seed for reproducibility) set.seed(42) pcv_importance(strata$data, "health_outcome", c("gender", "race", "age"), approx = "montecarlo", n_perm = 500)strata <- make_strata(maihda_sim_data, c("gender", "race")) # Order-invariant split of the PCV across the two dimensions and age imp <- pcv_importance(strata$data, "health_outcome", c("gender", "race", "age")) print(imp) plot(imp) # Dominance analysis: adds conditional / complete dominance detail pcv_importance(strata$data, "health_outcome", c("gender", "race", "age"), method = "dominance") # Monte-Carlo approximation (set a seed for reproducibility) set.seed(42) pcv_importance(strata$data, "health_outcome", c("gender", "race", "age"), approx = "montecarlo", n_perm = 500)
Creates an advanced, publication-ready two-panel dashboard for visualizing predicted values and highlighting the most notable cases or strata. What "notable" means depends on the model type, and the labelled points are not statistical outliers in the regression-diagnostic sense:
Gaussian and Poisson (and the ordinal "expected_score" mode):
the cases/strata whose prediction sits furthest from the mean prediction
(largest deviation), ranked by absolute deviation.
Binomial: the cases/strata with the largest absolute deviance residual,
i.e. where the observed 0/1 outcome – for an aggregated binomial
(cbind(successes, failures), a proportion with its trial counts as
prior weights, or a brms y | trials(n) fit), the observed successes
out of trials – is least consistent with the fitted probability (worst-fit
points), ranked by . As in R's binomial family, a
prior weight counts as that many trials, so a 0/1 outcome with weights is
scored as that many successes or failures. Every row's outcome is coded as
the model coded it – by label, whatever the order of a factor's levels in
data – and a factor with more than two levels, as in R's binomial
family, as its first level against all the others. Predictions are per-trial
probabilities for every binomial fit. A row whose outcome or trial count is
unknown has no residual: it is left out of the stratum residual means, is
never labelled, and is drawn as a hollow point.
Ordinal "surprise" mode: the cases/strata with the highest
surprise , i.e. the least probable
observations under the model. It needs the observed response in
data: a row whose response is missing is left out, and one whose
category is not among the model's fitted categories is left out with a
warning.
plot_prediction_deviation_panels( model, data = NULL, type = c("auto", "gaussian", "poisson", "binomial", "ordinal"), ordinal_mode = c("surprise", "expected_score"), top_n_labels = 5, strata_info = NULL )plot_prediction_deviation_panels( model, data = NULL, type = c("auto", "gaussian", "poisson", "binomial", "ordinal"), ordinal_mode = c("surprise", "expected_score"), top_n_labels = 5, strata_info = NULL )
model |
A fitted model object (e.g., from 'lm()', 'glm()', 'MASS::polr()', or 'lme4::glmer()'). |
data |
The original data frame used to fit the model. If 'NULL', attempts to extract from the model. When supplied, everything is computed for its own rows: their predictions, their binomial residuals (from their own outcomes and trial counts) and their weights in the stratum summaries. A row's weight is read from its column in 'data' – the sampling-weight column, or the column a bare model's 'weights =' argument names ('glm()', 'lmer()', 'MASS::polr()', ...) – or else from the fitted row with the same row name and prediction (a ‘fit_maihda()' model stores its weights as values). If any plotted row’s weight cannot be found, every row is weighted equally, with a warning. |
type |
Model type: "auto" (default), "gaussian", "poisson", "binomial", or "ordinal". |
ordinal_mode |
For ordinal models: "surprise" (default, based on observation probability) or "expected_score". |
top_n_labels |
Number of points to label on the plot. The ranking metric depends on the model type (see Description): deviation from the mean prediction for Gaussian/Poisson and the ordinal expected-score mode, absolute deviance residual for binomial, and surprise for the ordinal surprise mode. Default is 5. |
strata_info |
Optional data frame of strata labels, generally extracted from 'maihda_model' objects. |
A 'patchwork' object containing two 'ggplot2' panels.
Dispatches each type to the model it is valid on. The VPC and shrinkage
views ("vpc", "obs_vs_shrunken", "predicted") use the
null model by default; for type = "vpc" the model argument
selects the null model, the adjusted model, or "both" – one combined plot
that shows the null-to-adjusted change with the PCV annotated. The
additive-vs-intersectional views ("effect_decomp",
"prediction_deviation") use the
adjusted model, whose fixed effects carry the dimensions' additive part so
the stratum random effect is the pure interaction; with fewer than two dimensions
(no adjusted model) they fall back to the null model. Group types
("group_vpc", "group_components", "group_between_variance",
"group_pcv", "group_additive_share") use the group comparison when
maihda was called with a group.
## S3 method for class 'maihda_analysis' plot( x, type = "all", highlight_interactions = FALSE, only_flagged = FALSE, highlight_by = c("flag", "rope"), rope = NULL, select = c("order", "deviation"), order_by = c("predicted_desc", "stratum", "predicted_asc", "deviation", "size"), model = c("null", "adjusted", "both"), ... )## S3 method for class 'maihda_analysis' plot( x, type = "all", highlight_interactions = FALSE, only_flagged = FALSE, highlight_by = c("flag", "rope"), rope = NULL, select = c("order", "deviation"), order_by = c("predicted_desc", "stratum", "predicted_asc", "deviation", "size"), model = c("null", "adjusted", "both"), ... )
x |
A |
type |
One of the model types ("all", "vpc", "obs_vs_shrunken", "predicted",
"upset" (the UpSet-style alternative to "predicted"; forwards |
highlight_interactions |
Highlight strata with a credibly non-zero
intersectional interaction on the BLUP-based views (see
|
only_flagged |
Show only the highlighted strata on the |
highlight_by |
Which interaction-screen column defines the highlighted
strata: |
rope |
Equivalence region forwarded to |
select |
When the |
order_by |
Display order of the strata on the |
model |
For |
... |
Additional arguments passed to the underlying plot method. |
A ggplot2 object – including type = "vpc", model = "both", which
is a single combined change plot – or (for type = "all") an invisible
list of them.
Plots VPC/ICC across the models compared by compare_maihda.
Dispatched via plot() on the classed result.
## S3 method for class 'maihda_comparison' plot(x, ...)## S3 method for class 'maihda_comparison' plot(x, ...)
x |
A |
... |
Additional arguments (not used). |
A ggplot2 object.
strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) comparison <- compare_maihda(null_model, adj_model, bootstrap = TRUE) plot(comparison)strata <- make_strata(maihda_sim_data, vars = c("gender", "race")) null_model <- fit_maihda(health_outcome ~ 1 + (1 | stratum), data = strata$data) adj_model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata$data) comparison <- compare_maihda(null_model, adj_model, bootstrap = TRUE) plot(comparison)
Descriptive plots for a maihda_describe object: the
stratum-size distribution (the sparsity of the strata space), the
family-aware outcome distribution, and per-variable missingness.
## S3 method for class 'maihda_describe' plot(x, type = c("stratum_size", "outcome", "missingness"), ...)## S3 method for class 'maihda_describe' plot(x, type = c("stratum_size", "outcome", "missingness"), ...)
x |
A |
type |
One of |
... |
Additional arguments (not used). |
A ggplot2 object, extendable with the usual + grammar.
desc <- maihda_describe(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data) plot(desc, type = "stratum_size") plot(desc, type = "outcome") plot(desc, type = "missingness")desc <- maihda_describe(BMI ~ Age + (1 | Gender:Race:Education), data = maihda_health_data) plot(desc, type = "stratum_size") plot(desc, type = "outcome") plot(desc, type = "missingness")
Visualises the output of compare_maihda_groups as a point/forest
plot of the VPC/ICC by group, as stacked variance-composition bars (between- vs
within-stratum share) by group, as bars of the absolute between-stratum
(intersectional) variance by group, or as bars of the additive share (PCV) by
group. Dispatched via plot() on the classed result.
## S3 method for class 'maihda_group_comparison' plot( x, type = c("vpc", "components", "between_variance", "pcv", "additive_share"), ... )## S3 method for class 'maihda_group_comparison' plot( x, type = c("vpc", "components", "between_variance", "pcv", "additive_share"), ... )
x |
A |
type |
One of "vpc" (default) for VPC by group with optional bootstrap confidence intervals, "components" for stacked variance proportions (additive / interaction / residual for a crossed-dimensions comparison, between / other / residual otherwise, with a separate context slice for a contextual comparison), "between_variance" for the absolute between-stratum variance by group, "pcv" for the two-model additive share (null -> adjusted proportional change in between-stratum variance) by group, or "additive_share" for the crossed-dimensions additive share by group. The VPC is a share of the unexplained variance; "between_variance" shows the magnitude the ratio cannot convey (two groups with very different VPCs can share a between-stratum variance, and vice versa); "pcv" requires strata defined by at least two dimensions. |
... |
Additional arguments (not used). |
A ggplot2 object.
data(maihda_health_data) cmp <- compare_maihda_groups(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data, group = "Education") plot(cmp, type = "vpc") plot(cmp, type = "components") plot(cmp, type = "between_variance")data(maihda_health_data) cmp <- compare_maihda_groups(BMI ~ Age + (1 | Gender:Race), data = maihda_health_data, group = "Education") plot(cmp, type = "vpc") plot(cmp, type = "components") plot(cmp, type = "between_variance")
Creates various plots for visualizing MAIHDA model results including variance partition coefficient comparisons, observed vs. shrunken estimates, and predicted subgroup values with conditional intervals.
## S3 method for class 'maihda_model' plot( x, type = c("all", "vpc", "obs_vs_shrunken", "predicted", "upset", "effect_decomp", "prediction_deviation", "context_vpc", "vpc_trajectory", "trajectories"), summary_obj = NULL, n_strata = 50, highlight_interactions = FALSE, only_flagged = FALSE, highlight_by = c("flag", "rope"), rope = NULL, select = c("order", "deviation"), order_by = c("predicted_desc", "stratum", "predicted_asc", "deviation", "size"), quantity = c("predicted", "interaction"), ... )## S3 method for class 'maihda_model' plot( x, type = c("all", "vpc", "obs_vs_shrunken", "predicted", "upset", "effect_decomp", "prediction_deviation", "context_vpc", "vpc_trajectory", "trajectories"), summary_obj = NULL, n_strata = 50, highlight_interactions = FALSE, only_flagged = FALSE, highlight_by = c("flag", "rope"), rope = NULL, select = c("order", "deviation"), order_by = c("predicted_desc", "stratum", "predicted_asc", "deviation", "size"), quantity = c("predicted", "interaction"), ... )
x |
A maihda_model object from |
type |
Character string specifying plot type:
|
summary_obj |
Optional maihda_summary object from |
n_strata |
Maximum number of strata to display in the predicted plot.
When there are more strata than this, the first |
highlight_interactions |
Highlight the strata that carry a credibly
non-zero intersectional interaction (from |
only_flagged |
Show only the flagged strata rather than dimming the
rest. |
highlight_by |
Which interaction-screen column defines the highlighted
strata: |
rope |
Equivalence region (a "smallest interaction of interest") forwarded
to |
select |
When the |
order_by |
For |
quantity |
For |
... |
Additional arguments (not currently used). |
For a single type, a ggplot2 object that you can extend
with the usual + grammar (themes, labs(),
added layers, or a replacement fill/colour scale). Some types return a
richer object: "prediction_deviation" returns a patchwork of
two panels and "upset" a patchwork of three panels (theme
every panel at once with & theme_*()).
type = "all" returns a named list of ggplot2 objects.
strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) # VPC plot plot(model, type = "vpc") # Single-type plots are ggplot objects -- restyle them with ggplot2: plot(model, type = "vpc") + ggplot2::theme_classic() + ggplot2::labs(title = "Variance partition, restyled") # Generate all plots (a named list); pick one out to restyle it: plots <- plot(model) plots$predicted + ggplot2::theme_bw()strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) # VPC plot plot(model, type = "vpc") # Single-type plots are ggplot objects -- restyle them with ggplot2: plot(model, type = "vpc") + ggplot2::theme_classic() + ggplot2::labs(title = "Variance partition, restyled") # Generate all plots (a named list); pick one out to restyle it: plots <- plot(model) plots$predicted + ggplot2::theme_bw()
Bar chart of the per-variable contributions to the total PCV, ordered by size, with a dashed zero line (negative bars flag suppression) and, when available, parametric-bootstrap confidence intervals. The bars sum to the full-model Total PCV (the efficiency property).
## S3 method for class 'maihda_pcv_importance' plot(x, ...)## S3 method for class 'maihda_pcv_importance' plot(x, ...)
x |
A |
... |
Additional arguments (not used). |
A ggplot object.
Makes predictions from a fitted MAIHDA model, either at the stratum level or individual level.
predict_maihda( object, newdata = NULL, type = c("individual", "strata", "response", "link"), scale = c("response", "link"), allow_new_levels = FALSE, ... )predict_maihda( object, newdata = NULL, type = c("individual", "strata", "response", "link"), scale = c("response", "link"), allow_new_levels = FALSE, ... )
object |
A maihda_model object from |
newdata |
Optional data frame for making predictions. If NULL, uses the original data from model fitting. |
type |
Character string specifying prediction type:
"link" or "response" is also accepted and gives individual-level predictions on that scale. |
scale |
Character string specifying the prediction scale for
individual-level predictions: "response" (default) or "link". For a
cumulative (ordinal) model the "link" scale is the latent location
|
allow_new_levels |
Logical. |
... |
Additional arguments passed to predict method of underlying model. |
Depending on type:
For "individual": A numeric vector of predicted values on the
requested scale, one per row of newdata – or, when
newdata is NULL, one per ANALYTIC row, matching
nrow(object$data). A model fitted with
na.action = na.exclude is not padded back out to the
original input rows the way predict() on the underlying fit is,
so the result can always be bound to object$data.
For "strata": A data frame with stratum ID and predicted random
effect. When newdata is supplied, the result is restricted to the
strata present in newdata (and a stratum the model never saw is an
error, as for "individual"); when newdata is NULL, every
training stratum is returned.
strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) # Individual predictions pred_ind <- predict_maihda(model, type = "individual") # Stratum predictions pred_strata <- predict_maihda(model, type = "strata")strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) # Individual predictions pred_ind <- predict_maihda(model, type = "individual") # Stratum predictions pred_strata <- predict_maihda(model, type = "strata")
S3 predict method for MAIHDA models: a thin alias of
predict_maihda, so predict(model, type = "strata") and
predict_maihda(model, type = "strata") are interchangeable. See
predict_maihda for the full documentation of the arguments
and return value.
## S3 method for class 'maihda_model' predict( object, newdata = NULL, type = c("individual", "strata", "response", "link"), scale = c("response", "link"), allow_new_levels = FALSE, ... )## S3 method for class 'maihda_model' predict( object, newdata = NULL, type = c("individual", "strata", "response", "link"), scale = c("response", "link"), allow_new_levels = FALSE, ... )
object |
A maihda_model object from |
newdata |
Optional data frame for making predictions. If NULL, uses the original data from model fitting. |
type |
Character string specifying prediction type:
"link" or "response" is also accepted and gives individual-level predictions on that scale. |
scale |
Character string specifying the prediction scale for
individual-level predictions: "response" (default) or "link". For a
cumulative (ordinal) model the "link" scale is the latent location
|
allow_new_levels |
Logical. |
... |
Additional arguments passed to predict method of underlying model. |
Depending on type:
For "individual": A numeric vector of predicted values on the
requested scale, one per row of newdata – or, when
newdata is NULL, one per ANALYTIC row, matching
nrow(object$data). A model fitted with
na.action = na.exclude is not padded back out to the
original input rows the way predict() on the underlying fit is,
so the result can always be bound to object$data.
For "strata": A data frame with stratum ID and predicted random
effect. When newdata is supplied, the result is restricted to the
strata present in newdata (and a stratum the model never saw is an
error, as for "individual"); when newdata is NULL, every
training stratum is returned.
Print a MAIHDA Analysis
## S3 method for class 'maihda_analysis' print(x, ...)## S3 method for class 'maihda_analysis' print(x, ...)
x |
A |
... |
Additional arguments (not used). |
No return value, called for side effects.
Print a MAIHDA sample description
## S3 method for class 'maihda_describe' print(x, digits = x$digits, ...)## S3 method for class 'maihda_describe' print(x, digits = x$digits, ...)
x |
A |
digits |
Decimal places (defaults to the value stored on |
... |
Additional arguments (not used). |
Invisibly, x.
Print method for MAIHDA group comparisons
## S3 method for class 'maihda_group_comparison' print(x, ...)## S3 method for class 'maihda_group_comparison' print(x, ...)
x |
A maihda_group_comparison object. |
... |
Additional arguments (not used). |
No return value, called for side effects.
Print MAIHDA information criteria
## S3 method for class 'maihda_ic' print(x, ...)## S3 method for class 'maihda_ic' print(x, ...)
x |
A |
... |
Additional arguments (not used). |
No return value, called for side effects.
Print a MAIHDA interaction diagnostic
## S3 method for class 'maihda_interactions' print(x, ...)## S3 method for class 'maihda_interactions' print(x, ...)
x |
A |
... |
Additional arguments (not used). |
No return value, called for side effects.
Print a longitudinal MAIHDA PCV
## S3 method for class 'maihda_long_pcv' print(x, ...)## S3 method for class 'maihda_long_pcv' print(x, ...)
x |
A |
... |
Unused. |
The object, invisibly.
Print method for maihda_model
## S3 method for class 'maihda_model' print(x, ...)## S3 method for class 'maihda_model' print(x, ...)
x |
A maihda_model object |
... |
Additional arguments |
No return value, called for side effects.
Print a PCV importance attribution
## S3 method for class 'maihda_pcv_importance' print(x, digits = 4, ...)## S3 method for class 'maihda_pcv_importance' print(x, digits = 4, ...)
x |
A |
digits |
Number of digits for the contribution columns. Default 4. |
... |
Additional arguments (not used). |
Invisibly, x.
Print a stepwise MAIHDA table
## S3 method for class 'maihda_stepwise' print(x, ...)## S3 method for class 'maihda_stepwise' print(x, ...)
x |
A |
... |
Additional arguments (not used). |
Invisibly, x.
Print method for maihda_strata objects
## S3 method for class 'maihda_strata' print(x, ...)## S3 method for class 'maihda_strata' print(x, ...)
x |
A maihda_strata object |
... |
Additional arguments (not used) |
No return value, called for side effects.
Print method for maihda_summary objects
## S3 method for class 'maihda_summary' print(x, ...)## S3 method for class 'maihda_summary' print(x, ...)
x |
A maihda_summary object |
... |
Additional arguments (not used) |
No return value, called for side effects.
Print a MAIHDA results table
## S3 method for class 'maihda_table' print(x, digits = x$digits, ...)## S3 method for class 'maihda_table' print(x, digits = x$digits, ...)
x |
A |
digits |
Decimal places (defaults to the value stored on |
... |
Additional arguments (not used). |
Invisibly, x.
Print method for PCV results
## S3 method for class 'pcv_result' print(x, ...) ## S3 method for class 'pvc_result' print(x, ...)## S3 method for class 'pcv_result' print(x, ...) ## S3 method for class 'pvc_result' print(x, ...)
x |
A pcv_result object from |
... |
Additional arguments |
No return value, called for side effects.
Launches a Shiny graphical user interface that exposes core functions of the MAIHDA package, allowing for visual data exploration, model fitting, and performance visualization.
run_maihda_app()run_maihda_app()
No return value, called to launch the shiny app.
## Not run: run_maihda_app() ## End(Not run)## Not run: run_maihda_app() ## End(Not run)
Estimates the proportional change in variance (PCV) sequentially by fitting intermediate (partially-adjusted) models, adding each predictor one-by-one. The step-specific PCV is the change in between-stratum variance contributed by a predictor given the variables already in the model. Because the steps are sequential it is order-dependent: it reflects each variable's marginal, model-dependent change, not an order-invariant “unique” contribution.
stepwise_pcv( data, outcome, vars, engine = "lme4", family = "gaussian", context = NULL, sampling_weights = NULL, estimation = c("fitted", "ML") )stepwise_pcv( data, outcome, vars, engine = "lme4", family = "gaussian", context = NULL, sampling_weights = NULL, estimation = c("fitted", "ML") )
data |
Data frame with observations. Ensure 'make_strata()' was run first so the 'stratum' variable exists. |
outcome |
Character string; the dependent variable. |
vars |
Character vector; predictors (strata groupings & covariates) to add sequentially to the model. |
engine |
Modeling engine ("lme4", "brms", "wemix", or "ordinal"). Default
is "lme4"; switches to "wemix" automatically when |
family |
Error distribution and link function. Default is "gaussian". |
context |
Optional character vector naming one or more higher-level
context columns in |
sampling_weights |
Optional name of a sampling-weight column for
design-weighted stepwise fits; see |
estimation |
Variance-estimation basis for the between-stratum variances
compared across steps, |
All models are fit on the complete cases for 'outcome', 'stratum', and all variables in 'vars' so that each sequential variance comparison uses the same analytic sample.
For a binary (or ordinal) outcome the sequential between-stratum variances
live on the latent scale, whose level-1 variance is fixed by the link: a step
that adds an individual-level variable (one varying within strata)
rescales the latent metric itself, so its Step_PCV mixes explained
variance with rescaling and can be understated or negative on that account –
see the “Latent-scale families and rescaling” note in
calculate_pcv. Steps that add a stratum-constant dimension are
largely unaffected.
For a binary outcome the table additionally tracks discriminatory accuracy
(Merlo et al. 2016): AUC is each model's C-statistic and Step_AUC /
Total_AUC are its absolute change (delta-AUC), in contrast to the
proportional Step_PCV / Total_PCV. The MOR is reported
for the logit link (NA otherwise) and is a monotone transform of the
between-stratum variance already in Variance. For a
design-weighted fit (sampling_weights) the AUC is the design-weighted
(population) C-statistic.
Reuses maihda_discriminatory_accuracy on each step's fitted model, so
no additional models are fit. Note that adding a stratum-defining dimension
(one already encoded by the strata) typically leaves the AUC essentially unchanged:
it re-partitions the between-stratum variance (so the PCV and MOR move) but not the
per-stratum predicted ranking the rank-based AUC depends on. The AUC trajectory is
therefore most informative for individual-level covariates that vary within
strata.
A data.frame (class maihda_stepwise) showing the sequential
models, the between-stratum variance at each step, and both the step-specific
and total PCV. For a binary (binomial/Bernoulli) outcome it also carries
the discriminatory-accuracy trajectory: AUC (the C-statistic of each
step's model – step 0 is the strata-only discriminatory accuracy),
Step_AUC and Total_AUC (the absolute change in AUC,
delta-AUC, versus the previous step and versus the null), and MOR (the
Median Odds Ratio, logit link only). These columns are absent for non-binary
outcomes. When context is supplied, a Context_Variance column
reports the between-context variance held at each step (for a brms fit the
posterior median of each context's variance, summed over the contexts;
Variance is a posterior median too). For a binary
outcome the discriminatory-accuracy trajectory is still reported alongside it: the
AUC and MOR are the intersectional-scope (between-stratum)
quantities – the concordance of the fixed effects plus the stratum interaction,
excluding the context random effect – so they carry the same
net-of-context scope as the Step_PCV / Total_PCV columns, exactly
as summary.maihda_model reports the intersectional-scope AUC for a
contextual fit.
The variance-estimation basis chosen by estimation is recorded as an
"estimation" attribute on the returned table; the basis actually used is
recorded as "estimation_used" ("mixed" when estimation = "ML"
but a step's ML refit was skipped at the boundary, leaving it on REML). Both are
shown by print().
Step_PCV is NA for any step whose preceding model has a
between-stratum variance at the singularity boundary: that variance is the step's
denominator, and at the boundary it carries only optimizer noise, so the ratio is
undefined rather than small. Those steps are listed in an
"undefined_step_pcv" attribute and noted by print(). Total_PCV
is unaffected, since it divides by the null model's variance.
Merlo, J., Wagner, P., Ghith, N., & Leckie, G. (2016). An original stepwise multilevel logistic regression analysis of discriminatory accuracy: the case of neighbourhoods and health. PLOS ONE, 11(4), e0153778.
strata_result <- make_strata(maihda_sim_data, c("gender", "race")) stepwise_pcv(strata_result$data, "health_outcome", c("gender", "race", "age")) # Contextual cross-classified stepwise PCV: strata crossed with a higher-level # context (country). Step_PCV / Total_PCV are then net of the country intercept, # and a Context_Variance column reports the between-country variance per step. cc <- make_strata(maihda_country_data, c("gender", "ses")) stepwise_pcv(cc$data, "math", c("gender", "ses"), context = "country")strata_result <- make_strata(maihda_sim_data, c("gender", "race")) stepwise_pcv(strata_result$data, "health_outcome", c("gender", "race", "age")) # Contextual cross-classified stepwise PCV: strata crossed with a higher-level # context (country). Step_PCV / Total_PCV are then net of the country intercept, # and a Context_Variance column reports the between-country variance per step. cc <- make_strata(maihda_country_data, c("gender", "ses")) stepwise_pcv(cc$data, "math", c("gender", "ses"), context = "country")
Returns the variance summary (VPC/ICC, variance components, stratum estimates)
of one of the analysis's models. The per-group comparison, when present, is
attached as the "groups" attribute.
## S3 method for class 'maihda_analysis' summary(object, which = c("null", "adjusted"), ...)## S3 method for class 'maihda_analysis' summary(object, which = c("null", "adjusted"), ...)
object |
A |
which |
Which model to summarize: |
... |
Additional arguments (not used). The summaries are computed by
|
The maihda_summary for the requested model.
A two-model maihda analysis holds a
null model (strata as the only predictor) and an adjusted
model (the dimensions' additive main effects added as fixed effects), and
this returns the null model's summary by default – the one the headline
VPC/ICC comes from. The strata dimensions are the random-effect grouping
there, not fixed effects, so the printed fixed-effect table shows only the
intercept and any covariates. Use which = "adjusted" for the model
whose fixed effects carry the dimensions' additive main effects (the same
object as object$summary_adjusted), matching
tidy's which argument.
Provides a summary of a MAIHDA model including variance partition coefficients (VPC/ICC) and stratum-specific estimates.
## S3 method for class 'maihda_model' summary( object, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, response_vpc = FALSE, seed = NULL, df_method = c("between-within", "normal", "bootstrap"), ... )## S3 method for class 'maihda_model' summary( object, bootstrap = FALSE, n_boot = 1000, conf_level = 0.95, response_vpc = FALSE, seed = NULL, df_method = c("between-within", "normal", "bootstrap"), ... )
object |
A maihda_model object from |
bootstrap |
Logical indicating whether to compute parametric bootstrap
confidence intervals for VPC/ICC. Default is FALSE. Supported for lme4
models only; |
n_boot |
Number of bootstrap samples if bootstrap = TRUE. Default is 1000. |
conf_level |
Confidence level for the VPC/ICC interval – the lme4 bootstrap CI or the brms posterior credible interval. Default is 0.95. |
response_vpc |
Logical; for a binomial (lme4) model, also compute the
response-scale VPC ( |
seed |
Optional integer seed for the response-scale VPC simulation when
|
df_method |
Reference distribution for the fixed-effect p-values and
intervals of an |
... |
Additional arguments (not currently used). |
A maihda_summary object containing:
vpc |
Variance Partition Coefficient (ICC); for lme4 with
|
variance_components |
Data frame of variance components. For a
contextual cross-classified fit ( |
longitudinal |
For a longitudinal (growth-curve) fit, the time-varying
summary: |
context |
For a contextual cross-classified fit, the stratum vs.
context partition: per-context variances and shares, the contexts' total
share ( |
discriminatory_accuracy |
For a binomial/Bernoulli outcome, the
|
count_vpc |
For a log-link count model, the |
vpc_response |
The response-scale VPC ( |
stratum_estimates |
Data frame of stratum-specific random effects with labels if available |
fixed_effects |
Fixed-effect estimates. For the lme4, WeMix and ordinal
engines a data frame with |
conf_level |
The interval level used for the fixed effects (and, when bootstrapped or Bayesian, the VPC) |
df_method |
The reference distribution the |
thresholds |
For a cumulative (ordinal) clmm fit, the threshold (cut point) estimates with standard errors – the cumulative model's "intercepts"; NULL otherwise |
model_summary |
Original model summary |
diagnostics |
Fit-quality diagnostics (singular fit / convergence) carried over from the fitted model and reported by the print method |
strata_autobin_info |
The auto-binning recipe carried over from the
fitted model: for each numeric stratum dimension |
The VPC is the between-stratum variance
divided by the total unexplained variance. For the canonical
single-stratum model that denominator is between-stratum + residual, but if the
model includes additional random effects (e.g. (1 | site)) their
variance is included in the denominator too (between-stratum + other random
effects + residual), so the VPC is the between-stratum share of all
unexplained variance. It is a conditional/residual ICC that excludes variance
captured by the fixed effects, so for models with covariates it is conditional
on them. It is most commonly read from the null model
outcome ~ 1 + (1 | stratum), where it is the total between-stratum
share. For non-Gaussian families the level-1 (residual) variance uses a
latent/distributional approximation ( for logistic;
for Poisson per Stryhn et al. 2006 and
for the negative binomial per Nakagawa,
Johnson & Schielzeth 2017 – their "delta" and "trigamma"
alternatives are available via fit_maihda(count_approximation = ), and
the choice is reported in the printed summary and in count_vpc because
the three diverge materially below a marginal count of 2 – each evaluated at a single marginal
expected count : the mean over the analytic sample of the
row-level – the fixed-part
prediction with the log-normal correction for the row's total random-effect
variance . The counts are averaged before the transform,
which is where the cited is defined and which reduces to
Nakagawa et al.'s in the null
model; not at the conditional fitted means, whose BLUPs would tie the
level-1 variance to the realized random effects), so the
VPC is on that latent scale; for a weighted Gaussian model the level-1
variance is the mean conditional residual variance,
, since the per-observation residual variance is
. The stratum random effects represent the total
between-stratum deviation; they equal the pure intersectional
(interaction) component only when the additive main effects of the strata
variables are included in the model.
For a Poisson or negative-binomial model the VPC can also be computed on the
count scale itself, with no approximation of the level-1 variance (Leckie et
al., 2020): see maihda_vpc_response, or set
response_vpc = TRUE.
A Gaussian lme4 fit refers each Wald statistic to a on
containment (between-within) degrees of freedom, reported in the
df column: a term absorbed by a random-effect grouping is tested
against that grouping's units minus the terms it absorbs, and a term absorbed
by none against minus the random-effect levels. A random slope counts
as absorbing. Set df_method = "normal" for a z instead.
A GLMM, a WeMix pseudo-ML fit and an ordinal::clmm fit have no
finite-sample and use the Wald z; a brms summary reports the
posterior. For Kenward-Roger or Satterthwaite, apply pbkrtest or
lmerTest to x$model.
df_method = "bootstrap" replaces that reference for an lme4 fit
with at least one fixed-effect term, and is the one to use for a GLMM, whose z
is anticonservative for a term constant within a stratum, most of all when the
strata are few. For each fixed-effect coefficient the model is refitted with
that coefficient constrained to zero, n_boot responses are
simulated from the restricted fit, the full model is refitted on each, and the
observed Wald statistic is referred to the resulting distribution of
. The estimate and standard error are unchanged. The p-value is
over the refits that succeeded, and the interval is the estimate plus
or minus a critical value read from the same draws, times the standard error,
so zero falls outside it exactly when the p-value is at most
1 - conf_level. That agreement is algebraic, not a coverage guarantee.
df is NA, and so are the intercept's p-value and interval: an
intercept has no null model to simulate from.
The restriction is on the coefficient, not on its term. For a term spanning several design columns (a factor with three or more levels, a polynomial, an interaction between factors) each column is tested against its own null: that column zeroed, the siblings kept and re-estimated. What the constraint means follows the fitted contrasts: treatment coding merges that level into the reference, sum coding sets its deviation from the unweighted mean of the level means to zero.
The bootstrap is an approximation, not an exact test. Its null is a fit
estimated from the same data, so it is least reliable with few strata, where
the stratum variance is often estimated at exactly zero; a p-value near the
threshold from such a fit deserves little weight. n_boot sets the Monte
Carlo resolution, not that approximation: the p-value lies on a grid of step
, and more draws only shrink its Monte Carlo error. No
n_boot makes the test exact.
It costs n_boot refits per tested coefficient – a -level
factor costs blocks – and is separate from the
bootstrap = TRUE VPC interval. A Gaussian refit takes milliseconds, a
binomial one about a second at and tens of seconds at
, so n_boot = 199 is the usual choice for a GLMM.
summary() warns when the draws are too few for the requested level; the
check is level-aware: 99, 199 and 999 are the smallest counts that put ten
draws beyond the cut-off at the 10%, 5% and 1% levels.
A longitudinal summary reports two different variance partitions, and
they are not interchangeable. They differ in one term of the denominator: the
level-1 (occasion) residual variance , which in a growth model is
within-individual volatility – how far a single measurement falls from
that person's own smooth trajectory. It mixes measurement error, genuine
short-term fluctuation, and any misfit of the assumed functional form. A
cross-sectional MAIHDA cannot separate it from between-individual variance at
all; repeated measures are what split the two.
The headline VPC (vpc, and longitudinal$vpc_t over time)
keeps it:
This is the discriminatory-accuracy question – how much of an observed
measurement at time a stratum accounts for – and it is the quantity
comparable to published cross-sectional MAIHDA VPCs. Report this one unless you
specifically mean the trajectory question.
The trajectory VPCs (longitudinal$vpc_intercept and
longitudinal$vpc_slope) drop it, following Bell et al. (2024), equation
(5):
These ask how intersectionally patterned people's trajectories are i.e., what
share of the between-individual variation in where a trajectory starts, and in how
fast it changes, lies between strata. Because is absent neither is
affected by how noisy the outcome measure is, which makes them comparable across
studies using different instruments.
Both are evaluated at the baseline (ref_time, the earliest
observed time), pairing with PCV_intercept and PCV_slope from
maihda(decomposition = "longitudinal"). The intercept VPC depends on where
time is zeroed and the slope VPC does not, so an intercept VPC computed at another
reference time, such as the mean age of Bell et al.'s examples, differs from the
one reported here. vpc_slope is NA when the model was fit with
stratum_slope = FALSE (no between-stratum slope variance exists to take a
share of).
Both come with an interval in vpc_intercept_ci / vpc_slope_ci,
and trajectory_vpc_method records its basis. For a brms fit the
two shares are computed per posterior draw and reported as the posterior
median with a credible interval, matching vpc_t and the headline VPC on
the same fit; for an lme4 fit the point estimates are the plug-in from
the fitted covariance blocks and summary(bootstrap = TRUE) adds a
parametric-bootstrap interval (NA without one). Report the interval:
these shares are poorly determined when the strata are few.
For lme4 models a VPC/ICC interval is obtained from a parametric
bootstrap (bootstrap = TRUE). For brms models the VPC/ICC is
summarised directly from the posterior draws: the reported estimate is the
posterior median of the per-draw VPC (-based, not the biased
) and the interval is a central credible interval at
conf_level (default 95%), so no bootstrap argument is needed.
The variance-components table of a cross-sectional brms fit reports the
posterior median of each variance component – the between-stratum row is the
variance the PCV and the Median Odds Ratio use, and its sd the posterior
median SD – with the total and the proportions computed from those rows. The
stratum proportion therefore equals the headline VPC when the level-1 variance
is fixed by the link and the stratum is the only random effect, and differs
from it slightly otherwise, because the median of a ratio is not the ratio of
medians; in a crossed-dimensions fit, whose between-strata variance is the sum
of several components, the share those rows add up to can differ markedly from
the headline VPC when dimensions have few levels. With few strata the posterior
of a variance is right-skewed, and its
median overstates the variance (and with it the VPC and the Median Odds
Ratio); the overstatement shrinks as strata are added. A longitudinal fit's
table holds the posterior means of its covariance blocks. For non-Gaussian
brms families the level-1 (residual) variance uses the usual
latent-scale approximation. For the count families (Poisson, negative
binomial) the marginal expected counts are propagated per draw – from
the fixed-part linear-predictor draws and each draw's total random-intercept
variance – for the intercept-only VPC structures (strata, crossed-dimensions,
contextual), so the credible interval reflects fixed-effect and random-effect
variance uncertainty; the negative-binomial shape draws are always
propagated. A random-slope (longitudinal) structure, whose per-row
random-effect design that fast path does not carry, instead holds the marginal
expected counts at a posterior-mean plug-in (constant across draws) to avoid an
expensive computation.
Bell, A., Evans, C., Holman, D., & Leckie, G. (2024). Extending intersectional multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) to study individual longitudinal trajectories, with application to mental health in the UK. Social Science & Medicine, 351, 116955. doi:10.1016/j.socscimed.2024.116955
Leckie, G., Browne, W. J., Goldstein, H., Merlo, J., & Austin, P. C. (2020). Partitioning variation in multilevel models for count data. Psychological Methods, 25(6), 787-801. doi:10.1037/met0000265
strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) summary_result <- summary(model) # With bootstrap CI # summary_boot <- summary(model, bootstrap = TRUE, n_boot = 50)strata_result <- make_strata(maihda_sim_data, vars = c("gender", "race")) model <- fit_maihda(health_outcome ~ age + (1 | stratum), data = strata_result$data) summary_result <- summary(model) # With bootstrap CI # summary_boot <- summary(model, bootstrap = TRUE, n_boot = 50)
A ggplot2 theme that applies the MAIHDA brand identity to plot chrome only – navy titles and axis labels and soft slate gridlines. It encodes no data: the colourblind-safe data palettes used by the package's plotting functions are left untouched.
theme_maihda(base_size = 11, base_family = NULL)theme_maihda(base_size = 11, base_family = NULL)
base_size |
Base font size in points. Default '11'. |
base_family |
Base font family. Defaults to 'getOption("maihda.font", "")', i.e. the graphics device default unless you have opted into a brand font globally. Pass a string to force a family for a single plot. |
Built on [ggplot2::theme_minimal()], so it composes with additional '+ theme()' calls in the usual way (later settings win).
A ggplot2 theme object that can be added to a plot with '+'.
By default the theme uses the graphics device's default font, which is safe on every device (including the PostScript/PDF devices used by 'R CMD check' and many rendering back-ends). To render figures in the brand font (Montserrat) – matching the hex logo – set 'options(maihda.font = "Montserrat")' or pass 'base_family = "Montserrat"', and use a graphics device that can resolve that family (e.g. ragg or showtext). Forcing a font that the active device cannot find produces "invalid font type" errors, which is why it is opt-in rather than automatic.
library(ggplot2) ggplot(mtcars, aes(mpg, wt)) + geom_point(colour = "#0072B2") + labs(title = "MAIHDA brand theme", x = "MPG", y = "Weight") + theme_maihda()library(ggplot2) ggplot(mtcars, aes(mpg, wt)) + geom_point(colour = "#0072B2") + labs(title = "MAIHDA brand theme", x = "MPG", y = "Weight") + theme_maihda()