mmbcv: Bias-corrected sandwich variance for clustered multistate Cox models

Overview

The mmbcv package computes cluster-robust and bias-corrected sandwich variance estimators for multistate Cox models fitted in counting-process form. Wang, Turner, and Li (Wang, Turner, and Li 2023) developed a class of finite-sample bias corrections for clustered marginal Cox models; mmbcv extends those corrections to the multistate setting.

The main user-facing function is MMBCV(). It takes

and returns a collection of robust and bias-corrected variance estimators for the fitted regression coefficients.

The package also provides three standalone procedures for testing patterns in a set of correlated coefficient estimates: heterogeneity_test() for any departure from equality, linear_trend_test() for a score-based linear trend, and order_restricted_test() for a monotone (increasing or decreasing) alternative. Each procedure accepts a coefficient vector together with its full variance-covariance matrix, including off-diagonal covariances.

For background on fitting multistate Cox models with survival::coxph() using list-formulas, see the survival vignette Multi-state models and competing risks:

Cluster-robust and bias-corrected variance estimators

Technical details

Notation

Suppose the data arise from a clustered multistate survival process. Let \(\beta\) denote the full regression coefficient vector, of length \(p\), and let \(\hat\beta\) be its partial-likelihood estimate. For clusters \(i = 1,\ldots,n\), let \(U_i(\hat\beta)\) denote the cluster-level score contribution (the sum of the score residuals of the cluster’s members), and let \(V_m\) denote the model-based variance estimator (the naive, non-robust covariance of \(\hat\beta\)). \(V_m\) plays the role of the “bread” and appears on both sides of every sandwich below.

Following Wang et al. (Wang, Turner, and Li 2023), the baseline cluster-robust sandwich variance estimator is

\[ \widehat{\mathrm{Var}}_{\mathrm{robust}}(\hat\beta) = V_m \left( \sum_{i=1}^n U_i(\hat\beta)\, U_i(\hat\beta)^\top \right) V_m . \]

In mmbcv this estimator is returned as robust. When the number of clusters is small, this sandwich estimator tends to underestimate the true variance, which motivates the finite-sample corrections that follow.

A common sandwich form

Many of the corrected estimators share a single template that differs only in the cluster score and/or in a cluster-specific correction matrix:

\[ \widehat{\mathrm{Var}}(\hat\beta) = V_m \left( \sum_{i=1}^n C_i \, U_i^\star(\hat\beta)\, U_i^\star(\hat\beta)^\top C_i^\top \right) V_m , \]

where \(U_i^\star(\hat\beta)\) is either the original cluster score \(U_i(\hat\beta)\) or the martingale-residual-corrected score \(U_i^{\mathrm{MR}}(\hat\beta)\) introduced below, and \(C_i\) is a cluster-specific correction matrix.

The correction matrices are built from the cluster leverage \(\Omega_i V_m\), where \(\Omega_i\) is a cluster-specific gradient matrix: the negative derivative of cluster \(i\)’s martingale score with respect to \(\beta\). It is the multistate analogue of the cluster gradient matrix in Wang et al. (Wang, Turner, and Li 2023), obtained by summing the negative score-derivative across the transitions of the multistate model. Because it derives from the martingale-based cluster score rather than the ordinary partial-likelihood score, it is a cluster-level gradient rather than a per-cluster information matrix, and its explicit form which also depends on the tie-handling method (Wang, Turner, and Li 2023). The product \(\Omega_i V_m\), which plays a role analogous to a cluster leverage (Meng et al. 2023), enters each correction matrix \(C_i\). Throughout, \(I_p\) denotes the \(p \times p\) identity matrix.

Martingale-residual (MR) correction

The martingale-residual correction replaces the raw cluster score \(U_i(\hat\beta)\) with a bias-adjusted score \(U_i^{\mathrm{MR}}(\hat\beta)\) constructed from the cluster’s martingale residuals; the adjustment is designed to reduce the finite-sample bias of the score cross-products. Its exact construction is given in Wang et al. (Wang, Turner, and Li 2023). The resulting estimator is

\[ \widehat{\mathrm{Var}}_{\mathrm{MR}}(\hat\beta) = V_m \left( \sum_{i=1}^n U_i^{\mathrm{MR}}(\hat\beta)\, U_i^{\mathrm{MR}}(\hat\beta)^\top \right) V_m , \]

returned by mmbcv as varMR.

Multiplicative corrections: KC, FG, and MD

Wang et al. (Wang, Turner, and Li 2023) summarize three multiplicative small-sample corrections that use the common sandwich form with different choices of \(C_i\).

The Kauermann-Carroll (KC) correction (Kauermann and Carroll 2001; Wang, Turner, and Li 2023) uses

\[ C^{KC}_i = \left(I_p - \Omega_i V_m \right)^{-1/2}, \]

giving

\[ \widehat{\mathrm{Var}}_{\mathrm{KC}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{KC}_i\, U_i(\hat\beta)\, U_i(\hat\beta)^\top C^{KC \top}_i \right) V_m , \]

returned as varKC.

The Fay-Graubard (FG) correction (Fay and Graubard 2001; Wang, Turner, and Li 2023) uses

\[ C^{FG}_i = \mathrm{diag} \left\{ \left(1 - \min\{\xi,\ [\Omega_i V_m]_{jj}\}\right)^{-1/2} \right\}_{j=1,\ldots,p}, \]

where \([\Omega_i V_m]_{jj}\) is the \(j\)th diagonal element of the cluster leverage and \(\xi = 0.75\) is a truncation constant that keeps the correction finite when a leverage value approaches one. The resulting estimator is

\[ \widehat{\mathrm{Var}}_{\mathrm{FG}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{FG}_i\, U_i(\hat\beta)\, U_i(\hat\beta)^\top C^{FG \top}_i \right) V_m , \]

returned as varFG.

The Mancl-DeRouen (MD) correction (Mancl and DeRouen 2001; Wang, Turner, and Li 2023) uses

\[ C^{MD}_i = \left(I_p - \Omega_i V_m \right)^{-1}, \]

giving

\[ \widehat{\mathrm{Var}}_{\mathrm{MD}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{MD}_i\, U_i(\hat\beta)\, U_i(\hat\beta)^\top C^{MD \top}_i \right) V_m , \]

returned as varMD. The KC and MD corrections apply the same leverage term \(\Omega_i V_m\) with exponents \(-1/2\) and \(-1\), respectively, so MD applies the stronger inflation of the two.

Additive correction: MBN

The Morel-Bokossa-Neerchal (MBN) correction (Morel, Bokossa, and Neerchal 2003; Wang, Turner, and Li 2023) takes a different form: it is a linear combination of the robust sandwich variance and the model-based variance, which guards against underestimation when the number of clusters is small,

\[ \widehat{\mathrm{Var}}_{\mathrm{MBN}}(\hat\beta) = c_1\, \widehat{\mathrm{Var}}_{\mathrm{robust}}(\hat\beta) + c_2\, \hat{\phi}\, V_m , \]

where the scalars \(c_1\), \(c_2\), and \(\hat{\phi}\) are defined as in Wang et al. (Wang, Turner, and Li 2023). This is returned as varMBN.

Hybrid MR estimators

Wang et al. (Wang, Turner, and Li 2023) further combine the MR correction with each of the four corrections above. The KC, FG, and MD hybrids replace \(U_i(\hat\beta)\) with \(U_i^{\mathrm{MR}}(\hat\beta)\) in the corresponding sandwich, and the MBN hybrid replaces the robust variance with the MR variance (and \(\hat\phi\) with its MR analogue \(\hat\phi_{\mathrm{MR}}\)):

\[ \widehat{\mathrm{Var}}_{\mathrm{KCMR}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{KC}_i\, U_i^{\mathrm{MR}}(\hat\beta)\, U_i^{\mathrm{MR}}(\hat\beta)^\top C_i^{KC \top} \right) V_m , \]

\[ \widehat{\mathrm{Var}}_{\mathrm{FGMR}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{FG}_i\, U_i^{\mathrm{MR}}(\hat\beta)\, U_i^{\mathrm{MR}}(\hat\beta)^\top C_i^{FG \top} \right) V_m , \]

\[ \widehat{\mathrm{Var}}_{\mathrm{MDMR}}(\hat\beta) = V_m \left( \sum_{i=1}^n C^{MD}_i\, U_i^{\mathrm{MR}}(\hat\beta)\, U_i^{\mathrm{MR}}(\hat\beta)^\top C_i^{MD \top} \right) V_m , \]

and

\[ \widehat{\mathrm{Var}}_{\mathrm{MBNMR}}(\hat\beta) = c_1\, \widehat{\mathrm{Var}}_{\mathrm{MR}}(\hat\beta) + c_2\, \hat{\phi}_{\mathrm{MR}}\, V_m . \]

These are returned as varKCMR, varFGMR, varMDMR, and varMBNMR, respectively.

Every quantity returned by MMBCV() is a variance-covariance matrix for \(\hat\beta\). Standard errors from any such estimator \(V\) are obtained from its diagonal,

\[ \mathrm{SE}(\hat\beta_j) = \sqrt{V_{jj}} . \]

Main function and arguments

Once a multistate Cox model has been fitted with survival::coxph(), all of the covariance estimators described above are obtained from a single function, MMBCV(). Its call is

MMBCV(fit, data, StartTime, StopTime, ClusterID, SubjectID,
      Event, tie = c("breslow", "efron"), details = FALSE,
      detail_names = NULL, kc_tol = 1e-10)

with arguments summarized below; see ?MMBCV for the full reference.

Argument Description Default
fit Fitted multistate Cox model object, with components cmap, rmap, states, and coefficients; typically produced by a survival workflow.
data Data frame in counting-process form, matching the data used to fit fit.
StartTime, StopTime Unquoted column names in data giving the interval start and stop times.
ClusterID Unquoted column name in data identifying the clustering unit.
SubjectID Unquoted column name in data identifying the subject.
Event Unquoted column name in data giving the event/state indicator used to define transition-specific events.
tie Tie-handling method used in the variance calculation, "breslow" or "efron". "breslow"
details Logical; whether to return additional intermediate quantities beyond the variance-covariance matrices. FALSE
detail_names Optional character vector selecting which intermediate components to append when details = TRUE. NULL
kc_tol Numeric tolerance for deciding whether the cluster-specific KC correction matrix is non-singular enough to admit a real inverse square root. 1e-10

fit is the fitted multistate Cox model object. MMBCV() uses its multistate mapping components (cmap, rmap, states) and the fitted coefficient vector to reconstruct the transition-specific design and to aggregate the cluster-level score contributions; for this reason data must be the same counting-process data set used in coxph(), containing the interval start/stop times, the subject and cluster identifiers, and the event/state variable. StartTime and StopTime give the interval endpoints; ClusterID and SubjectID identify the clustering unit and the subject; and Event gives the state occupied at StopTime, from which the transition-specific event indicators are formed. Internally, MMBCV() partitions the data by transition, builds the corresponding event indicators, and computes the requested sandwich estimators by aggregating the resulting cluster-level scores. tie selects the tie-handling approximation (Breslow or Efron) used in the variance calculation and should match the tie method used to fit the model. details controls whether intermediate quantities—such as the model-based covariance matrix and the cluster-specific correction objects—are returned alongside the variance-covariance matrices; when details = TRUE, detail_names selects specific components, and otherwise a default subset is returned. kc_tol sets the tolerance for the eigenvalue check that decides whether the KC correction matrix \(C^{KC}_i\) admits a stable real inverse square root.

MMBCV() returns a named list of variance-covariance matrices for the full coefficient vector: robust for the cluster-robust sandwich estimator, together with the bias-corrected estimators varMR, varMD, varMDMR, varFG, varFGMR, varKC, varKCMR, varMBN, and varMBNMR. Their individual meanings, and how to convert them into standard errors, are given in Interpreting the output below.

Worked example

Example data

The package ships with a small simulated clustered multistate dataset, msdat3.

library(mmbcv)

data("msdat3")
dim(msdat3)
#> [1] 3004    9
length(unique(msdat3$id))
#> [1] 1500
length(unique(msdat3$clus_id))
#> [1] 30
table(msdat3$event)
#> 
#> censor     S1     S2     S3      D 
#>   1050    837    450    217    450

msdat3 is in long (counting-process) format, with one row per subject-interval:

  • id: subject id
  • clus_id: cluster id
  • Z: cluster-level treatment assignment (0/1)
  • X: individual-level baseline covariate
  • from, to: start and end states for the interval
  • Tstart, Tstop: interval start and stop times
  • event: end state at Tstop (e.g., censor, S1, S2, S3, D)

The state labels are:

  • (s0): initial state
  • S1: first intermediate state
  • S2: second intermediate state
  • S3: third intermediate state
  • D: absorbing state
  • censor: right-censoring at the end of the interval

A quick look at the observed transitions:

with(msdat3, table(from, to))
#>       to
#> from     D  S1  S2  S3 censor
#>   (s0) 234 837   0   0    429
#>   S1   109   0 450   0    278
#>   S2    55   0   0 217    178
#>   S3    52   0   0   0    165

Fitting a multistate Cox model with survival

MMBCV() takes a fitted model object as input. In a typical workflow this model is fit with survival::coxph() using list-formulas.

library(survival)

fit <- coxph(
  list(
    Surv(Tstart, Tstop, event) ~ 1,
    state("(s0)"):state("S1") + state("S1"):state("S2") + state("S2"):state("S3") ~
      Z + X,
    state("(s0)"):state("D") + state("S1"):state("D") + state("S2"):state("D") +
      state("S3"):state("D") ~ (Z + X)/common
  ),
  data = msdat3,
  id = id,
  ties = "breslow",
  timefix = FALSE
)

fit
#> Call:
#> coxph(formula = list(Surv(Tstart, Tstop, event) ~ 1, state("(s0)"):state("S1") + 
#>     state("S1"):state("S2") + state("S2"):state("S3") ~ Z + X, 
#>     state("(s0)"):state("D") + state("S1"):state("D") + state("S2"):state("D") + 
#>         state("S3"):state("D") ~ (Z + X)/common), data = msdat3, 
#>     ties = "breslow", id = id, timefix = FALSE)
#> 
#>    
#> 1:2     coef exp(coef) se(coef) robust se      z     p
#>   Z -0.03640   0.96425  0.06935   0.06919 -0.526 0.599
#>   X  0.02849   1.02890  0.03384   0.03371  0.845 0.398
#> 
#>    
#> 2:3     coef exp(coef) se(coef) robust se      z      p
#>   Z -0.14916   0.86144  0.09516   0.09486 -1.572 0.1159
#>   X  0.09521   1.09990  0.04666   0.04616  2.063 0.0391
#> 
#>    
#> 3:4     coef exp(coef) se(coef) robust se     z     p
#>   Z 0.138588  1.148651 0.136808  0.137060 1.011 0.312
#>   X 0.002256  1.002258 0.068286  0.068826 0.033 0.974
#> 
#>                   
#> 1:5, 2:5, 3:5, 4:5      coef exp(coef)  se(coef) robust se      z     p
#>                  Z -0.009474  0.990571  0.094743  0.094405 -0.100 0.920
#>                  X -0.030723  0.969744  0.046400  0.045745 -0.672 0.502
#> 
#>  States:  1= (s0), 2= S1, 3= S2, 4= S3, 5= D 
#> 
#> Likelihood ratio test=9.24  on 8 df, p=0.3226
#> n= 3004, unique id= 1500, number of events= 1954

If the survival package is not installed, install it in an interactive R session with install.packages("survival").

Computing variance estimators

Once the multistate Cox model is fitted, pass it (with the original dataset) to MMBCV():

out <- MMBCV(
  fit, msdat3,
  StartTime = Tstart,
  StopTime  = Tstop,
  ClusterID = clus_id,
  SubjectID = id,
  Event     = event,
  tie       = "breslow",
  details   = FALSE
)

names(out)
#>  [1] "robust"   "varMR"    "varMD"    "varMDMR"  "varFG"    "varFGMR" 
#>  [7] "varKC"    "varKCMR"  "varMBN"   "varMBNMR"

Interpreting the output

MMBCV() returns a list of variance-covariance matrices for the fitted regression coefficients. Each matrix can be used to compute standard errors, Wald tests, and confidence intervals. The elements are:

  • robust: cluster-robust sandwich variance estimator
  • varMR: martingale-residual (MR) bias-corrected estimator
  • varMD: Mancl-DeRouen (MD) bias-corrected estimator
  • varMDMR: hybrid MD + MR estimator
  • varKC: Kauermann-Carroll (KC) bias-corrected estimator
  • varKCMR: hybrid KC + MR estimator
  • varFG: Fay-Graubard (FG) bias-corrected estimator
  • varFGMR: hybrid FG + MR estimator
  • varMBN: Morel-Bokossa-Neerchal (MBN) bias-corrected estimator
  • varMBNMR: hybrid MBN + MR estimator

Standard errors are obtained from any of these matrices with sqrt(diag(...)):

Vlist <- out[c("robust","varMR","varMD","varMDMR","varFG","varFGMR","varKC","varKCMR","varMBN","varMBNMR")]
SE <- sapply(Vlist, function(V) sqrt(diag(V)))
SE
#>          robust      varMR      varMD    varMDMR      varFG    varFGMR
#> [1,] 0.12681339 0.13612657 0.13173546 0.14142991 0.12917113 0.13865946
#> [2,] 0.03800617 0.03971887 0.03975596 0.04156009 0.03881715 0.04056647
#> [3,] 0.11249698 0.12105297 0.11763603 0.12667276 0.11483803 0.12360734
#> [4,] 0.04200442 0.04400631 0.04386978 0.04599197 0.04280556 0.04485222
#> [5,] 0.19063933 0.20739029 0.20607051 0.22431679 0.19772144 0.21516664
#> [6,] 0.07310988 0.07704443 0.07684647 0.08099901 0.07482618 0.07885202
#> [7,] 0.08010269 0.08547342 0.08446929 0.09016392 0.08219768 0.08772159
#> [8,] 0.04188072 0.04363451 0.04350871 0.04534072 0.04266635 0.04445542
#>           varKC    varKCMR     varMBN   varMBNMR
#> [1,] 0.12919935 0.13869646 0.13896496 0.14904754
#> [2,] 0.03886875 0.04062644 0.04603928 0.04840860
#> [3,] 0.11497344 0.12376072 0.13432627 0.14420807
#> [4,] 0.04292311 0.04498382 0.05485895 0.05788685
#> [5,] 0.19806014 0.21553152 0.21881488 0.23707776
#> [6,] 0.07493991 0.07898086 0.08985204 0.09505413
#> [7,] 0.08223319 0.08776186 0.10731307 0.11449882
#> [8,] 0.04268456 0.04447690 0.05464086 0.05746402

Efron ties

If the model was fitted in survival::coxph() with Efron’s tie handling, use Efron ties in the variance calculation as well, so that the two steps are consistent:

out_efron <- MMBCV(
  fit, msdat3,
  StartTime = Tstart,
  StopTime  = Tstop,
  ClusterID = clus_id,
  SubjectID = id,
  Event     = event,
  tie       = "efron",
  details   = FALSE
)

sqrt(diag(out_efron$robust))
#> [1] 0.12681339 0.03800617 0.11249698 0.04200442 0.19063933 0.07310988 0.08010269
#> [8] 0.04188072

Tests for correlated coefficient patterns

Technical details

The package provides three standalone tests for scientifically distinct questions about a set of correlated coefficient estimates:

These functions are especially useful for transition-specific treatment effects, but they apply to any coefficient vector accompanied by a full variance-covariance matrix. The call of the three test functions are shown below here:

heterogeneity_test(beta, vcov, index = NULL)
linear_trend_test(beta, vcov, index = NULL, scores = NULL, alternative = c("greater", "less", "two.sided"))
order_restricted_test(beta, vcov, index = NULL, alternative = c("increasing", "decreasing"),
  weight_method = c("auto", "simulation"), nsim = 100000L, seed = NULL, weights = NULL, tol = 1e-10)

Common inputs and output

Let

\[ \widehat{\boldsymbol\beta} = (\widehat\beta_1,\ldots,\widehat\beta_R)^\top \]

denote the selected coefficient estimates, and let \(\widehat V\) denote their variance-covariance matrix. In every test, the order of the rows and columns of \(\widehat V\) must match the order of the estimates, and the off-diagonal covariances must be retained, because all three statistics depend on the joint covariance structure.

The optional index argument selects coefficients from a larger beta vector; the same selection is applied automatically to vcov. Integer, logical, and character indices are all accepted. For the linear-trend and order-restricted tests, the resolved order defines the sequence being tested. The heterogeneity statistic itself does not require a natural ordering, although the order determines how its returned adjacent differences are displayed.

Each function returns an object of class "htest". Printing the object shows the primary statistic and p-value; additional quantities—such as the selected coefficients, the covariance matrix, the contrasts, the fitted trend, the cone projection, and the chi-bar-square weights—can be accessed with $. The functions do not take a significance level; a decision at a user-selected level \(\alpha\) is obtained by comparing result$p.value < alpha.

Omnibus heterogeneity test

The heterogeneity test evaluates

\[ H_0:\beta_1=\cdots=\beta_R \qquad\text{against}\qquad H_A:\text{not all }\beta_r\text{ are equal.} \]

This is a multivariate Wald test of a set of linear equality constraints (Wald 1943; Cox and Hinkley 1974; Lehmann and Romano 2022). Let \(D\) be the \((R-1)\times R\) adjacent-contrast matrix, so that

\[ D\widehat{\boldsymbol\beta} = (\widehat\beta_2-\widehat\beta_1,\ldots, \widehat\beta_R-\widehat\beta_{R-1})^\top . \]

The omnibus Wald statistic is

\[ W= (D\widehat{\boldsymbol\beta})^\top (D\widehat V D^\top)^{-1} (D\widehat{\boldsymbol\beta}) . \]

Under \(H_0\), \(W\) has an asymptotic chi-square distribution with \(R-1\) degrees of freedom. The test is non-directional: positive and negative departures from equality are treated symmetrically. Using the upper tail of the chi-square distribution for the p-value does not make it a one-sided test. With two coefficients it is equivalent to a two-sided Wald \(Z\) test, since \(W=Z^2\).

Generalized least-squares linear-trend test

The linear-trend test models the selected coefficients as

\[ \beta_r=\eta+\gamma s_r,\qquad r=1,\ldots,R, \]

where \(s_1<\cdots<s_R\) are numeric scores, \(\eta\) is an intercept, and \(\gamma\) is the trend slope. The linear model specifies the relationship being tested; generalized least squares (GLS) is the estimation method, which accounts for the unequal variances and correlations in \(\widehat V\). Score-based tests for linear trend have a long history, including the work of Cochran and Armitage (Cochran 1954; Armitage 1955).

With design matrix \(A=(\boldsymbol 1,\ \boldsymbol s)\), the GLS estimator treats \(\widehat{\boldsymbol\beta}\) as the response with known covariance \(\widehat V\):

\[ \widehat{\boldsymbol\theta} = \begin{pmatrix}\widehat\eta\\ \widehat\gamma\end{pmatrix} = (A^\top\widehat V^{-1}A)^{-1} A^\top\widehat V^{-1}\widehat{\boldsymbol\beta}, \qquad \widehat{\mathrm{Var}}(\widehat{\boldsymbol\theta}) = (A^\top\widehat V^{-1}A)^{-1} . \]

This covariance-weighted estimator follows the generalized least-squares principle associated with Aitken’s result and its later regression and GLS treatments (Aitken 1935; Seber and Lee 2003; Kariya and Kurata 2004). Because the covariance \(\widehat V\) is treated as known, the slope is tested with a standard-normal reference rather than a \(t\) reference:

\[ Z=\frac{\widehat\gamma}{\mathrm{SE}(\widehat\gamma)}, \qquad \mathrm{SE}(\widehat\gamma)=\sqrt{\big[(A^\top\widehat V^{-1}A)^{-1}\big]_{22}} , \]

which is asymptotically standard normal at \(\gamma=0\). The available options for alternative are:

  • "greater": \(H_0:\gamma\leq0\) versus \(H_A:\gamma>0\);
  • "less": \(H_0:\gamma\geq0\) versus \(H_A:\gamma<0\);
  • "two.sided": \(H_0:\gamma=0\) versus \(H_A:\gamma\neq0\).

If scores is omitted, the equally spaced values 0, 1, ..., R - 1 are used. User-supplied scores must be finite and strictly increasing. They may have length length(beta), in which case the selected entries are extracted with index, or length equal to the number of selected coefficients. Scores must be supplied when index selects nonconsecutive positions, so that the intended spacing is explicit.

A positive slope means the coefficients tend to increase as the scores increase, and a negative slope means they tend to decrease. The observed estimates need not be monotone. A significant slope is evidence of a linear trend; it does not by itself establish that a linear model describes the pattern adequately.

Order-restricted test

For alternative = "increasing", the order-restricted test evaluates

\[ H_0:\beta_1=\cdots=\beta_R \qquad\text{against}\qquad H_A:\beta_1\leq\cdots\leq\beta_R, \]

with at least one strict inequality. For alternative = "decreasing", the inequalities are reversed. Unlike the linear-trend test, this procedure does not assume constant or linearly changing adjacent effects. The general theory and methods of order-restricted inference are described by Robertson, Wright, and Dykstra and by Silvapulle and Sen (Robertson, Wright, and Dykstra 1988; Silvapulle and Sen 2005).

For an increasing alternative, define the adjacent differences and their covariance,

\[ \widehat{\boldsymbol\delta} =D\widehat{\boldsymbol\beta} =(\widehat\beta_2-\widehat\beta_1,\ldots, \widehat\beta_R-\widehat\beta_{R-1})^\top, \qquad \widehat\Omega=D\widehat V D^\top . \]

For a decreasing alternative, the sign of \(D\) is reversed, so that positive contrasts always point in the direction of the specified alternative. Let \(\widetilde{\boldsymbol\delta}\) be the covariance-weighted projection of \(\widehat{\boldsymbol\delta}\) onto the nonnegative orthant:

\[ \widetilde{\boldsymbol\delta} = \underset{\boldsymbol\theta\geq0}{\operatorname{argmin}}\; (\widehat{\boldsymbol\delta}-\boldsymbol\theta)^\top \widehat\Omega^{-1} (\widehat{\boldsymbol\delta}-\boldsymbol\theta) . \]

The order-restricted statistic is

\[ T= \widehat{\boldsymbol\delta}^\top \widehat\Omega^{-1}\widehat{\boldsymbol\delta} - (\widehat{\boldsymbol\delta}-\widetilde{\boldsymbol\delta})^\top \widehat\Omega^{-1} (\widehat{\boldsymbol\delta}-\widetilde{\boldsymbol\delta}) . \]

It measures the improvement in covariance-weighted fit obtained by moving from the equality-constrained null point to the closest point in the monotone cone. By the projection identity for a convex cone, \(T\) also equals \(\widetilde{\boldsymbol\delta}^\top\widehat\Omega^{-1}\widetilde{\boldsymbol\delta}\), so it is always non-negative. Under \(H_0\), \(T\) has an asymptotic chi-bar-square distribution,

\[ \overline\chi^2 = \sum_{k=0}^{R-1}w_k\,\chi_k^2, \qquad w_k\geq0, \quad \sum_{k=0}^{R-1}w_k=1, \]

a mixture of chi-square distributions with degrees of freedom \(0\) through \(R-1\). This distribution arises in multivariate one-sided and inequality-constrained testing (Kudo 1963; Shapiro 1985; Silvapulle and Sen 2005).

The mixture weights depend on the contrast covariance matrix and on the geometry of the cone. With one or two order constraints (two or three selected coefficients), weight_method = "auto" uses analytic weights; for larger problems it uses projection simulation. The nsim and seed arguments control this simulation, and the estimated weights, their Monte Carlo standard errors, and the p-value Monte Carlo standard error are returned as weights, weight_mcse, and p.value.mcse. Simulation currently supports at most 12 order constraints; for larger problems, precomputed weights can be supplied through weights.

Only the coefficient ordering matters for this test; the numeric score spacing is not used. If the observed differences already lie in the monotone cone, \(T\) equals the omnibus heterogeneity statistic \(W\), but the two reference distributions—and hence the p-values—still differ.

Worked examples

Applying the tests to an MMBCV() analysis

The following code selects the three transition-specific Z coefficients for the sequential intermediate-state transitions and uses the MD covariance estimator. Because these log hazard-ratio coefficients are negative for the earlier transitions, an “increasing” trend corresponds to effects moving toward zero.

recurrent_transitions <- c("1:2", "2:3", "3:4")
z_index <- unname(fit$cmap["Z", recurrent_transitions])

beta_Z <- fit$coefficients[z_index]
V_Z_MD <- out$varMD[z_index, z_index, drop = FALSE]
H_Z <- heterogeneity_test(beta_Z, V_Z_MD)

L_Z <- linear_trend_test(
  beta_Z,
  V_Z_MD,
  scores = 0:2,
  alternative = "greater"
)

O_Z <- order_restricted_test(
  beta_Z,
  V_Z_MD,
  alternative = "increasing"
)

H_Z
#> 
#>  Omnibus Wald test of equality of transition-specific treatment effects
#> 
#> data:  
#> W = 2.5408, df = 2, p-value = 0.2807
#> alternative hypothesis: not all selected transition-specific treatment effects are equal
L_Z
#> 
#>  Generalized least-squares linear trend test
#> 
#> data:  
#> Z = 0.28447, p-value = 0.388
#> alternative hypothesis: true trend slope is greater than 0
O_Z
#> 
#>  Order-restricted test with a chi-bar-square reference distribution
#> 
#> data:  
#> T = 1.6863, p-value = 0.1821
#> alternative hypothesis: selected coefficients are monotonically increasing, with at least one strict inequality

The p-values and decisions at a chosen level can be collected explicitly:

test_p_values <- c(
  heterogeneity    = H_Z$p.value,
  linear_trend     = L_Z$p.value,
  order_restricted = O_Z$p.value
)

test_p_values
#>    heterogeneity     linear_trend order_restricted 
#>        0.2807254        0.3880257        0.1821005
test_p_values < 0.05
#>    heterogeneity     linear_trend order_restricted 
#>            FALSE            FALSE            FALSE

The same coefficient vector can be paired with robust, varMR, varMDMR, varFG, or any other covariance estimator returned by MMBCV(). The selected rows and columns must correspond to beta_Z in the same order.

Standalone example with seven coefficients

The test functions do not require an MMBCV() model object. The following example constructs seven correlated coefficient estimates and a positive-definite covariance matrix with an autoregressive (AR(1)) correlation pattern:

beta7 <- c(
  beta1 = -0.31,
  beta2 = -0.21,
  beta3 = -0.12,
  beta4 = -0.02,
  beta5 =  0.09,
  beta6 =  0.21,
  beta7 =  0.34
)

se7 <- c(0.12, 0.11, 0.10, 0.10, 0.11, 0.12, 0.13)
position <- seq_along(beta7)
cor7 <- 0.35 ^ abs(outer(position, position, "-"))
V7 <- diag(se7) %*% cor7 %*% diag(se7)
dimnames(V7) <- list(names(beta7), names(beta7))

H7 <- heterogeneity_test(beta7, V7)

L7 <- linear_trend_test(
  beta7,
  V7,
  scores = 0:6,
  alternative = "greater"
)

O7 <- order_restricted_test(
  beta7,
  V7,
  alternative = "increasing",
  nsim = 5000,
  seed = 20260713
)

H7
#> 
#>  Omnibus Wald test of equality of transition-specific treatment effects
#> 
#> data:  
#> W = 15.998, df = 6, p-value = 0.01376
#> alternative hypothesis: not all selected transition-specific treatment effects are equal
L7
#> 
#>  Generalized least-squares linear trend test
#> 
#> data:  
#> Z = 3.9882, p-value = 3.329e-05
#> alternative hypothesis: true trend slope is greater than 0
O7
#> 
#>  Order-restricted test with a chi-bar-square reference distribution
#> 
#> data:  
#> T = 15.998, p-value = 0.0007513
#> alternative hypothesis: selected coefficients are monotonically increasing, with at least one strict inequality

Additional returned quantities are available beyond the standard printed "htest" output:

H7$contrast_matrix
#>               beta1 beta2 beta3 beta4 beta5 beta6 beta7
#> beta2 - beta1    -1     1     0     0     0     0     0
#> beta3 - beta2     0    -1     1     0     0     0     0
#> beta4 - beta3     0     0    -1     1     0     0     0
#> beta5 - beta4     0     0     0    -1     1     0     0
#> beta6 - beta5     0     0     0     0    -1     1     0
#> beta7 - beta6     0     0     0     0     0    -1     1
H7$differences
#> beta2 - beta1 beta3 - beta2 beta4 - beta3 beta5 - beta4 beta6 - beta5 
#>          0.10          0.09          0.10          0.11          0.12 
#> beta7 - beta6 
#>          0.13

L7$slope
#> [1] 0.1070206
L7$stderr
#> [1] 0.02683445
L7$scores
#> [1] 0 1 2 3 4 5 6

O7$weights
#>    df0    df1    df2    df3    df4    df5    df6 
#> 0.0894 0.2678 0.3330 0.2104 0.0798 0.0184 0.0012
O7$weight_mcse
#>          df0          df1          df2          df3          df4          df5 
#> 0.0040350375 0.0062623184 0.0066649981 0.0057642318 0.0038322829 0.0019006020 
#>          df6 
#> 0.0004896039
O7$p.value.mcse
#> [1] 1.769086e-05

Selecting a subset and specifying unequal positions

Suppose only coefficients 1, 3, 4, and 5 are of interest. The same index selects the coefficients and the covariance submatrix for all three functions. For the linear-trend test, the scores preserve the intended positions of the selected coefficients:

keep <- c(1, 3, 4, 5)
selected_scores <- c(0, 2, 3, 4)

H_subset <- heterogeneity_test(
  beta7,
  V7,
  index = keep
)

L_subset <- linear_trend_test(
  beta7,
  V7,
  index = keep,
  scores = selected_scores,
  alternative = "greater"
)

O_subset <- order_restricted_test(
  beta7,
  V7,
  index = keep,
  alternative = "increasing",
  nsim = 2000,
  seed = 20260714
)

c(
  heterogeneity    = H_subset$p.value,
  linear_trend     = L_subset$p.value,
  order_restricted = O_subset$p.value
)
#>    heterogeneity     linear_trend order_restricted 
#>      0.097634752      0.006052228      0.024381584

For linear_trend_test(), supplying the full score vector 0:6 would be equivalent, because the function extracts positions 1, 3, 4, and 5 using index. In this example the heterogeneity null is \(\beta_1=\beta_3=\beta_4=\beta_5\), and the increasing order-restricted alternative is \(\beta_1\leq\beta_3\leq\beta_4\leq\beta_5\), with at least one strict inequality. Neither procedure makes any statement about the omitted coefficients, and the numeric scores affect only the linear-trend test.

Practical remarks

Choosing a variance estimator

The bias-corrected estimators are most useful when the number of clusters is not large. Wang et al. (2023) report that, in their simulations for clustered time-to-event outcomes, the MD estimator performed well when cluster-size variation was modest, while KCMR performed best under larger cluster-size variation; they also note that MR alone could be unstable in some scenarios. It is therefore useful to compare robust, varMD, and varKCMR in practice.

Choosing among the coefficient-pattern tests

The three tests answer related but different questions:

The tests are not interchangeable. The choice should follow from the scientific hypothesis, not from which function produces the smallest p-value.

Reporting

For any of the three coefficient-pattern tests, the covariance estimator is part of the analysis and can materially affect the statistic and the p-value, so the chosen estimator should be stated. When the order-restricted weights are estimated by simulation, set a reproducible seed, use an nsim appropriate for the desired precision, and examine p.value.mcse when interpreting a p-value close to the chosen significance threshold.

References

Aitken, A. C. 1935. “On Least Squares and Linear Combinations of Observations.” Proceedings of the Royal Society of Edinburgh 55: 42–48.
Armitage, Peter. 1955. “Tests for Linear Trends in Proportions and Frequencies.” Biometrics 11: 375–86.
Cochran, William G. 1954. “Some Methods for Strengthening the Common Chi-Squared Tests.” Biometrics 10: 417–51.
Cox, D. R., and D. V. Hinkley. 1974. Theoretical Statistics. London: Chapman; Hall.
Fay, M. P., and B. I. Graubard. 2001. “Small-Sample Adjustments for Wald-Type Tests Using Sandwich Estimators.” Biometrics 57 (4): 1198–1206.
Kariya, Takeaki, and Hiroshi Kurata. 2004. Generalized Least Squares. John Wiley & Sons.
Kauermann, G., and R. J. Carroll. 2001. “A Note on the Efficiency of Sandwich Covariance Matrix Estimation.” Journal of the American Statistical Association 96 (456): 1387–96.
Kudo, Akio. 1963. “A Multivariate Analogue of the One-Sided Test.” Biometrika 50 (3/4): 403–18. https://doi.org/10.2307/2333902.
Lehmann, E. L., and Joseph P. Romano. 2022. Testing Statistical Hypotheses. 4th ed. Cham: Springer.
Mancl, L. A., and T. A. DeRouen. 2001. “A Covariance Estimator for GEE with Improved Small-Sample Properties.” Biometrics 57 (1): 126–34.
Meng, Can, Mary Ryan, Paul J. Rathouz, Elizabeth L. Turner, John S. Preisser, and Fan Li. 2023. ORTH.Ord: An R Package for Analyzing Correlated Ordinal Outcomes Using Alternating Logistic Regressions with Orthogonalized Residuals.” Computer Methods and Programs in Biomedicine 237: 107567. https://doi.org/10.1016/j.cmpb.2023.107567.
Morel, J. G., M. Bokossa, and N. K. Neerchal. 2003. “Small Sample Correction for the Variance of GEE Estimators.” Biometrical Journal 45 (4): 395–409.
Robertson, Tim, F. T. Wright, and Richard L. Dykstra. 1988. Order Restricted Statistical Inference. New York: John Wiley & Sons.
Seber, George A. F., and Alan J. Lee. 2003. Linear Regression Analysis. 2nd ed. Hoboken, NJ: John Wiley & Sons.
Shapiro, Alexander. 1985. “Asymptotic Distribution of Test Statistics in the Analysis of Moment Structures Under Inequality Constraints.” Biometrika 72: 133–44.
Silvapulle, Mervyn J., and Pranab K. Sen. 2005. Constrained Statistical Inference: Inequality, Order, and Shape Restrictions. Hoboken, NJ: Wiley. https://doi.org/10.1002/9781118165614.
Wald, Abraham. 1943. “Tests of Statistical Hypotheses Concerning Several Parameters When the Number of Observations Is Large.” Transactions of the American Mathematical Society 54: 426–82.
Wang, Xueqi, Elizabeth L. Turner, and Fan Li. 2023. “Improving Sandwich Variance Estimation for Marginal Cox Analysis of Cluster Randomized Trials.” Biometrical Journal 65: 2200113. https://doi.org/10.1002/bimj.202200113.