ML4T Diagnostic
Feature validation, strategy diagnostics, and Deflated Sharpe Ratio
A composite toolkit for validating signals and strategies across signal research, feature selection, cross-validation, backtest statistics, and portfolio reporting. The distinctive contribution is a set of overfitting guards rare in quant libraries — Deflated Sharpe Ratio, Rademacher Anti-Serum (RAS), Probability of Backtest Overfitting (PBO), and False Discovery Rate (FDR) — joined by Information Coefficient (IC) analysis with heteroskedasticity- and autocorrelation-consistent (HAC) standard errors, combinatorial purged cross-validation (CPCV), four feature-importance methods (Mean Decrease Impurity, Permutation, Mean Decrease Accuracy, and SHAP), and 65+ Plotly tearsheet visualizations.
- Deflated Sharpe Ratio
- IC analysis
- Feature importance
- Model validation
- Strategy debugging