Skip to Main content Skip to Navigation
Conference papers

kernelPSI: a Post-Selection Inference Framework for Nonlinear Variable Selection

Abstract : Model selection is an essential task for many applications in scientific discovery. The most common approaches rely on univariate linear measures of association between each feature and the outcome. Such classical selection procedures fail to take into account nonlinear effects and interactions between features. Kernel-based selection procedures have been proposed as a solution. However, current strategies for kernel selection fail to measure the significance of a joint model constructed through the combination of the basis kernels. In the present work, we exploit recent advances in post-selection inference to propose a valid statistical test for the association of a joint model of the selected kernels with the outcome. The kernels are selected via a step-wise procedure which we model as a succession of quadratic constraints in the outcome variable.
Complete list of metadata

Cited literature [21 references]  Display  Hide  Download

https://hal-mines-paristech.archives-ouvertes.fr/hal-02441304
Contributor : Chloé-Agathe Azencott <>
Submitted on : Wednesday, January 15, 2020 - 4:58:40 PM
Last modification on : Thursday, September 24, 2020 - 5:06:02 PM
Long-term archiving on: : Thursday, April 16, 2020 - 6:06:25 PM

File

slim19a.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02441304, version 1

Citation

Lotfi Slim, Clement Chatelain, Chloé-Agathe Azencott, Jean-Philippe Vert. kernelPSI: a Post-Selection Inference Framework for Nonlinear Variable Selection. 36th International Conference on Machine Learning (ICML 2019), Jun 2019, Long Beach, CA, United States. ⟨hal-02441304⟩

Share

Metrics

Record views

96

Files downloads

59