Power-Enhanced Mediation Test for a Binary Outcome
Source:R/pe_mediation_logistic.R
pe_mediation_logistic.RdTests the global null hypothesis of no active mediator for a binary
(0/1) outcome modeled with logistic regression, reporting both the
benchmark Wald test on the total indirect effect and the
power-enhanced (PE) test of Yu and Kelley (in press). This is the
binary-outcome worker behind pe_mediation().
Arguments
- X
Numeric matrix of exposures with \(n\) rows and \(q\) columns (\(q\) is usually 1). A numeric vector is treated as a single exposure.
- Y
Numeric outcome vector of length \(n\). Continuous for
outcome = "continuous", coded 0/1 for"binary", and nonnegative integer counts for"count".- M
Numeric matrix of candidate mediators with \(n\) rows and \(p\) columns; \(p\) may exceed \(n\). Column names, when present, label the mediators in the print footer and the mediator table; without them mediators are reported by column position.
- Z
Optional numeric matrix of confounders with \(n\) rows. Default
NULL(no confounders).- method
Multiplicity adjustment used to screen individual mediators in the PE component:
"Bonferroni"(familywise error rate control, the default),"BH", or"BY"(false discovery rate control by the procedures of Benjamini and Hochberg, 1995, and of Benjamini and Yekutieli, 2001;"BH"assumes independence or positive dependence among mediators,"BY"is valid under arbitrary dependence). See Details for the screening threshold each one uses.- scale
Logical; if
TRUE(default) the exposures, mediators, and confounders are each standardized to mean 0 and standard deviation 1 before fitting, as in the article, and a continuous outcome is centered but not rescaled. The total indirect effect is then the change in the outcome per standard deviation of each exposure: in the units ofYfor a continuous outcome, in log odds for a binary outcome, and in log mean count for a count outcome. WithFALSEthe inputs are used exactly as supplied, and the total indirect effect is per unit of each exposure. The continuous-outcome fit has no intercept, and the default tuning grid was chosen for standardized columns, soFALSEis meant for inputs that are already standardized (and, for a continuous outcome, aYthat is already centered); on raw inputs it fits a different model and can even change the sign of the estimate. Because a continuousYis not rescaled, the tuning grid is not expressed in the outcome's units, so the active mediators identified, both p-values, and the verdict depend on the units ofY: the same data withYmultiplied by 10 can identify a different set of mediators.- error_level
Target error rate for the mediator-screening step, in \((0, 1)\). Interpreted as the familywise error rate when
method = "Bonferroni"and as the false discovery rate whenmethod = "BH"or"BY". Default 0.05. This is distinct from the significance level used to test the global null (which is the user's choice when readingpval_pe). The PE test is asymptotically valid for any fixed value in \((0, 1)\), but in finite samples a larger value lets the screen pass more spurious mediators under the null and raises the PE test's size further above the benchmark's (see Details).- report_all_methods
Logical; if
TRUE, the identified active set is computed for all three multiplicity methods (Bonferroni, BH, BY) off the same fit and recorded for comparison, retrievable withpe_selection(). Themethodargument still drives the primary result. DefaultFALSE.- drop_constant
Logical; how to handle constant (zero-variance) mediator columns, which cannot be standardized or carry signal. If
FALSE(the default) they are an error; ifTRUEthey are dropped with a warning and the remaining mediators are renumbered back to their original column positions in the identified active set. Useful for small subgroups where some mediators happen to be constant.- lambda_grid
Numeric vector of candidate tuning parameters for the SCAD penalty (Fan and Li, 2001) in the penalized mediator fit, which for a binary outcome is adaptively rescaled (see
pe_mediation_logistic()). The fit is repeated at each value and the one minimizing the high-dimensional BIC (HBIC) of Wang, Kim, and Li (2013) is kept: whatever the grid, the value selected is the best of the values offered, since HBIC is minimized over the grid and not over every positive lambda. The default,seq(0.05, 10, length.out = 100)for every outcome family, is written out in the signature so that it can be edited in place. Every value is fit (the search is not adaptive), so the cost of a fit grows with the length of the grid. The grid can be tuned to the situation. Fewer values, or a range narrowed to where earlier fits put the HBIC minimum, make each fit faster, which matters when many fits are run (a simulation study, for example); a wider or finer grid is worth trying when the selected value is the smallest or largest value of the grid, in which case a non-empty fit warns (classpoemed_grid_boundary) and the print footer, which reports the full model's choice, says so. A continuous outcome also fits a reduced model, the outcome on the mediators and confounders without the exposure, tuned on the same grid by default (seelambda_grid_reducedinpe_mediation_linear()); its choice islambda_selected_reducedin the"tuning"attribute, and the warning covers it as well, naming whether the full model, the reduced model, or both sat at the end. For a continuous outcome the grid is fixed whileYis centered but not rescaled, so the value HBIC chooses, and with it the active mediators identified, depends on the units ofY(seescale). The grid searched and the value chosen are reported in the"tuning"attribute and the print footer.
Value
A tidy data.frame of class poemed_tbl with the same rows
and attributes as pe_mediation_linear(), except that the
"tuning" list has no reduced-model entries (lambda_grid_reduced and
lambda_selected_reduced): the binary fit has no reduced model.
Details
The outcome follows a logistic mediation model,
\(\mathrm{logit}\,P(Y = 1 \mid M, X, Z) = \alpha_m' M + \alpha_x' X
+ \alpha_z' Z\),
with a linear mediator model as in pe_mediation_linear(). Following Guo
et al. (2024), the mediator coefficients are estimated by partial
penalized likelihood, leaving the exposures and confounders unpenalized,
with the tuning parameter chosen by the high-dimensional BIC of Wang, Kim,
and Li (2013). The benchmark Wald test on the total indirect effect
\(\beta = \Gamma_x \alpha_m\) is also that of
Guo et al. (2024). The power-enhanced test of Yu and Kelley (in press),
built on the power enhancement principle of Fan, Liao, and Yao (2015),
adds the component \(J_m\), formed on the logit (link) scale
exactly as in the continuous case (see pe_mediation()). The total
indirect effect here is on the log-odds scale, not the probability scale:
with scale = TRUE it is the change in the log odds per standard
deviation of the exposure.
The penalty is SCAD (Fan and Li, 2001) with an adaptive rescaling, not the plain SCAD penalty. The fit is an iteratively reweighted coordinate descent. Each coordinate update applies the SCAD thresholds to the mediator's weighted working score and only then divides by its curvature \(v_j\) (the mean of the squared standardized mediator weighted by the working weights, at most 1/4 for a logistic fit). The fit is therefore a stationary point of the penalized likelihood with penalty \(\sum_j p_\lambda(v_j |\alpha_{m,j}|) / v_j\), not with the plain SCAD penalty \(\sum_j p_\lambda(|\alpha_{m,j}|)\). The condition for a coefficient to be zero is the same as under plain SCAD (its score is at most \(\lambda\) in absolute value), but a nonzero coefficient escapes shrinkage only beyond \(\gamma \lambda / v_j\) rather than \(\gamma \lambda\) (\(\gamma = 3.7\)), so coefficients of moderate size are shrunk more than plain SCAD would shrink them.
How to Cite
If you use POEMED in published work, please cite Yu and Kelley (in
press), the article that introduces its methods and the package.
citation("POEMED") gives the full reference and a BibTeX entry.
References
Yu, X., & Kelley, K. (in press). Power Enhancement in High-Dimensional Heterogeneous Mediation Analysis. Journal of the American Statistical Association.
Guo, X., Li, R., Liu, J., & Zeng, M. (2024). Estimations and tests for generalized mediation models with high-dimensional potential mediators. Journal of Business & Economic Statistics, 42(1), 243–256. doi:10.1080/07350015.2023.2174548
Fan, J., Liao, Y., & Yao, J. (2015). Power enhancement in high-dimensional cross-sectional tests. Econometrica, 83(4), 1497–1541. doi:10.3982/ECTA12749
Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96(456), 1348–1360. doi:10.1198/016214501753382273
Wang, L., Kim, Y., & Li, R. (2013). Calibrating nonconvex penalized regression in ultra-high dimension. The Annals of Statistics, 41(5), 2505–2536. doi:10.1214/13-AOS1159
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57(1), 289–300. doi:10.1111/j.2517-6161.1995.tb02031.x
Benjamini, Y., & Yekutieli, D. (2001). The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics, 29(4), 1165–1188. doi:10.1214/aos/1013699998
Examples
set.seed(113)
# Contrasting mediation with a binary outcome: the benchmark Wald test
# does not reject, the PE test does, and the screen identifies one of the
# two truly active mediators.
d <- simulate_mediation_data(n = 200, p = 60, pattern = "contrasting",
outcome = "binary", c1 = 1, c2 = 1)
pe_mediation_logistic(d$X, d$Y, d$M)
#> Warning: HBIC selected lambda = 0.05, the smallest value of `lambda_grid`. The criterion is minimized over the grid alone, so its minimum may lie beyond that end or between the end and its neighbor. Consider extending the grid past it and using a finer partition (more values), and compare the active mediators identified and the p-values across grids.
#> term value
#> stat_hdmm 1.706
#> pval_hdmm 0.1915
#> stat_pe 140.9
#> j_pe 139.2
#> pval_pe < 0.0001
#> total_indirect_effect -0.2687
#> n_active_mediators 1
#> df 1
#> n_candidate_mediators 60
#> n_observations 200
#>
#> Outcome model: binary (logistic)
#> Active mediators identified (1): 2
#> Tuning parameter (HBIC): lambda = 0.05 from 100 values in [0.05, 10] (the grid's lower end)
# HBIC chose 0.05, the smallest value of the default grid, so the fit
# warned (class poemed_grid_boundary); on a grid that extends below it
# and is spaced more finely, seq(0.01, 10, length.out = 200), the screen
# identifies the same mediator.