Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control
-
Updated
Nov 17, 2024 - Jupyter Notebook
Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Control
The MultipleTesting package offers common algorithms for p-value adjustment and combination and more…
Solutions of applied exercises contained in "An Introduction to Statistical Learning with Applications in Python", by Tibshirani et al, edition 2023
Statistical inference for Sharpe ratios: probabilistic Sharpe ratio, minimum track record length, and FDR/FWER corrections for screening many strategies
Statistical inference of recent positive selection using IBD segments
Repository for R and Python packages and reproduction codes in Weighted Conformalized Selection paper
This repository contains a collection of functions to evaluate investment strategies regarding multiple testing concerns.
A Shiny app for graphical multiplicity control
Fast exact grid search and backtesting of moving-average crossover strategies, with vectorized evaluation and multiple-testing-aware Sharpe diagnostics.
Sequential Hypothesis Testing with e-Values and p-Values
A FDR controlling procedure based on hidden Markov random field (Biometrics-15 paper)
Causal Inference for Genomic Data with Multiple Heterogeneous Outcomes
Fixed Sequence Multiple Testing Procedures
NumPy-only Independent Hypothesis Weighting for covariate-weighted multiple testing, with transparent validation and performance benchmarks.
Backtest overfitting audit for factor research: probability of backtest overfitting (PBO), deflated Sharpe ratio, point-in-time data, purged walk-forward. Searches published factor libraries and reports what actually survived costs.
Confidence interval simulations and hypothesis testing in R, with a practical study of selection and survivorship bias.
A quantitative research platform built for falsification: a validation toolkit written from the papers (purged CPCV, PBO, deflated Sharpe, SPA, MCPT) and 23 pre-registered experiments, failures included.
Statistical toolkit for A/B experiments: inference, SRM diagnostics, power analysis, and multiple testing.
To associate your repository with the multiple-testing topic, visit your repo's landing page and select "manage topics."