Model interpretation and feature selection

SHAP and ablation evidence

Fold-safe SHAP summaries, paired feature-removal effects, and consensus evidence.

Snapshot currentThe server-published scientific snapshot is ready.

Evidence scope

Scope, workflow status, and summary measures

Leakage Safe Outer Test ShapPaired Feature AblationShap Ablation Consensus Evidence
Fold-safe SHAPLeakage-safe SHAP analysisComplete
Feature ablationPaired feature ablationComplete
Feature consensusAnalyze feature-ablation resultsComplete
Outer-test SHAP values
61,776 values
Leakage Safe Outer Test Shap
SHAP additivity checks
30 checks
Leakage Safe Outer Test Shap
All SHAP additivity checks passed
Yes
Leakage Safe Outer Test Shap
Maximum SHAP additivity error
1.10e-6
Leakage Safe Outer Test Shap
Features tested by ablation
26 features
Shap Ablation Consensus Evidence
Primary ablation metric
mean_auc
Shap Ablation Consensus Evidence

Linked filters

Apply filters to tables and figures

Selections combine with AND across dimensions.

No shared filters active.

Aggregate estimate plot

SHAP–ablation agreement

Shap Ablation Consensus Evidence

Uncertainty: Point estimates are shown because this table does not supply matching lower and upper interval columns.

View plotted values in tabular form
SHAP–ablation agreement: tabulated plot data
EstimateMarkerFramework Mean Loss
0.7419578710260045 · consistent_contribution_not_multiplicity_confirmed0.022
0.165694788681275 · no_unique_contribution_detected0.003
0.0918045876773641 · no_unique_contribution_detected0.003
0.0132036587445729 · no_unique_contribution_detected0.003
0.0449574379492051 · no_unique_contribution_detected0.002
0.07514276124845 · framework_specific_signal0.002
0.0178559087313952 · no_unique_contribution_detected0.002
0.0468700255546899 · no_unique_contribution_detected0.002
0.1285114597420014 · no_unique_contribution_detected0.002
0.0138071773785997 · no_unique_contribution_detected0.002
0.1816615652355701 · no_unique_contribution_detected0.002
0.0344261664181708 · no_unique_contribution_detected0.001
0.0844688835262575 · no_unique_contribution_detected0.001
0.0203113466309368 · no_unique_contribution_detected0.001
0.0347213481543176 · no_unique_contribution_detected0.001
0.110516165072554 · no_unique_contribution_detected9.81e-4
0.0445786962082148 · no_unique_contribution_detected9.32e-4
0.0872683031662236 · no_unique_contribution_detected7.59e-4
0.0285944932882559 · no_unique_contribution_detected7.52e-4
0.0351600347628973 · no_unique_contribution_detected7.32e-4
0.1340984937675219 · no_unique_contribution_detected6.30e-4
0.030353351197817 · no_unique_contribution_detected-2.70e-4
0.0282172243579762 · no_unique_contribution_detected-7.03e-4
0.1304837582604155 · no_unique_contribution_detected-0.001
Framework Mean Loss from SHAP-ablation consensus evidence. Shared filters apply to both this plot and its source table.

Aggregate estimate plot

Feature-removal uncertainty

Shap Ablation Consensus Evidence

Uncertainty: Horizontal intervals use Ci Lower and Ci Upper from the published aggregate table.

View plotted values in tabular form
Feature-removal uncertainty: tabulated plot data
EstimateMarkerEstimateLower intervalUpper interval
hp_peak_loading_index · xgb0.003-0.0030.009
fp_peak_loading_index · xgb0.002-0.0050.008
fp_intensity_loading_fraction · xgb0.003-0.0030.009
hp_intensity_loading_fraction · xgb0.003-0.0030.010
fp_maxintensity_loading_fraction · xgb0.002-0.0030.008
hp_maxintensity_loading_fraction · xgb0.002-0.0030.008
hp_loading_speed · xgb0.004-0.0020.010
fp_loading_speed · xgb0.003-0.0040.009
hp_functional_output · xgb0.002-0.0030.006
fp_functional_output · xgb0.003-0.0020.009
fp_intensity_density · xgb0.0250.0030.048
hp_intensity_density · xgb0.004-0.0030.010
fp_integrated_loading · xgb0.003-0.0030.008
hp_integrated_loading · xgb0.002-0.0030.007
fp_loading_rate · xgb0.002-0.0030.008
hp_loading_rate · xgb0.0072.56e-40.013
fp_propulsion_time · xgb0.005-0.0010.010
hp_propulsion_time · xgb0.005-9.27e-40.011
stand_symmetry · xgb0.004-0.0020.011
swing_symmetry · xgb0.002-0.0040.009
duty_cycle_symmetry · xgb0.005-0.0010.011
fp_temporal_contact · xgb0.003-0.0040.010
hp_temporal_contact · xgb0.004-0.0020.011
hp_propulsion_loading · xgb0.006-2.92e-40.013
Estimate from Clustered ablation uncertainty. Shared filters apply to both this plot and its source table.
Leakage Safe Outer Test Shap

Outer-fold/model-specific fold-safe feature importance

Summary method: top_ranked_subset

Indexed rows
150
Eligible rows
150

Showing 125 of 150 matching rows

Filters combine with AND. Empty and unreported values sort last.

Outer-fold/model-specific fold-safe feature importance. leakage_safe_outer_test_shap.
nested_cvcatboost1fp_intensity_density0.8830.8530.0770.977
nested_cvcatboost1fp_intensity_loading_fraction0.2980.1100.0210.527
nested_cvcatboost1fp_functional_output0.2310.2140.0400.241
nested_cvcatboost1fp_peak_loading_index0.1990.114-0.0800.265
nested_cvcatboost1fp_loading_rate0.1680.103-0.0060.238
nested_cvcatboost1hp_temporal_contact0.1600.1270.0260.193
nested_cvcatboost1fp_loading_speed0.1570.093-0.0210.264
nested_cvcatboost1hp_maxintensity_loading_fraction0.1340.136-4.04e-50.148
nested_cvcatboost1fp_temporal_contact0.1300.091-0.0060.172
nested_cvcatboost1fp_propulsion_time0.1250.0810.0040.174
nested_cvcatboost2fp_intensity_density1.2101.1720.0441.325
nested_cvcatboost2fp_intensity_loading_fraction0.3110.127-0.0400.575
nested_cvcatboost2fp_temporal_contact0.2550.232-2.80e-40.300
nested_cvcatboost2fp_loading_speed0.2400.142-0.0620.354
nested_cvcatboost2fp_peak_loading_index0.2310.1890.0050.324
nested_cvcatboost2fp_propulsion_time0.2120.1990.0160.251
nested_cvcatboost2hp_temporal_contact0.2020.1780.0060.231
nested_cvcatboost2fp_functional_output0.1990.170-0.0290.241
nested_cvcatboost2fp_loading_rate0.1930.168-0.0380.231
nested_cvcatboost2fp_maxintensity_loading_fraction0.1270.0540.0250.217
nested_cvcatboost3fp_intensity_density0.8490.7240.0130.947
nested_cvcatboost3fp_intensity_loading_fraction0.2410.128-0.0390.425
nested_cvcatboost3hp_temporal_contact0.1620.150-0.0080.207
nested_cvcatboost3fp_peak_loading_index0.1480.135-0.0130.174
nested_cvcatboost3hp_integrated_loading0.1460.140-0.0090.191
Leakage Safe Outer Test Shap

Feature importance by experiment

Summary method: top_ranked_subset

Indexed rows
150
Eligible rows
150

Showing 125 of 150 matching rows

Filters combine with AND. Empty and unreported values sort last.

Feature importance by experiment. leakage_safe_outer_test_shap.
nested_cvcatboost1gt_earlyBMDMfp_intensity_loading_fraction1.4991.631
nested_cvcatboost1gt_earlyIL4fp_intensity_density0.8010.683
nested_cvcatboost1gt_earlyNK1fp_intensity_loading_fraction0.5340.439
nested_cvcatboost1gt_earlySHHfp_intensity_density0.8240.777
nested_cvcatboost1gt_earlyVEGFfp_intensity_density0.6050.671
nested_cvcatboost1gt_lateBMDMfp_intensity_density1.0781.141
nested_cvcatboost1gt_lateIL4fp_intensity_density1.0191.151
nested_cvcatboost1gt_lateNK1fp_intensity_density0.4240.239
nested_cvcatboost1gt_lateSHHfp_intensity_density1.2161.190
nested_cvcatboost1gt_lateVEGFfp_intensity_density0.8810.979
nested_cvcatboost2gt_earlyBMDMfp_intensity_loading_fraction1.8841.994
nested_cvcatboost2gt_earlyIL4fp_intensity_density1.5891.509
nested_cvcatboost2gt_earlyNK1fp_intensity_density1.1131.102
nested_cvcatboost2gt_earlySHHfp_intensity_density1.3621.347
nested_cvcatboost2gt_earlyVEGFfp_intensity_density0.7780.721
nested_cvcatboost2gt_lateBMDMfp_intensity_density1.4601.440
nested_cvcatboost2gt_lateIL4fp_intensity_density1.2731.198
nested_cvcatboost2gt_lateNK1fp_intensity_density1.2481.122
nested_cvcatboost2gt_lateSHHfp_intensity_density1.2721.179
nested_cvcatboost2gt_lateVEGFfp_intensity_density0.7740.898
nested_cvcatboost3gt_earlyBMDMfp_intensity_loading_fraction1.3651.372
nested_cvcatboost3gt_earlyIL4fp_intensity_density0.6440.671
nested_cvcatboost3gt_earlyNK1fp_intensity_density0.5700.583
nested_cvcatboost3gt_earlySHHfp_intensity_density0.6360.693
nested_cvcatboost3gt_earlyVEGFfp_intensity_density0.5720.661
Leakage Safe Outer Test Shap

SHAP additivity validation summary

Summary method: scheme_framework_threshold_aggregate

Indexed rows
6
Eligible rows
30

Showing 16 of 6 matching rows

Filters combine with AND. Empty and unreported values sort last.

SHAP additivity validation summary. leakage_safe_outer_test_shap.
nested_cvcatboostgt_early5396268.88e-151.18e-15
nested_cvcatboostgt_late5396266.22e-151.10e-15
nested_cvlgbmgt_early5396266.22e-155.69e-16
nested_cvlgbmgt_late5396266.22e-151.47e-15
nested_cvxgbgt_early5396261.05e-61.92e-7
nested_cvxgbgt_late5396261.10e-62.67e-7
Paired Feature Ablation

Feature-removal plan

Summary method: approved_rows

Indexed rows
26
Eligible rows
26

Showing 125 of 26 matching rows

Filters combine with AND. Empty and unreported values sort last.

Feature-removal plan. paired_feature_ablation.
1fp_intensity_density1.0001.0000.0000.74235
2fp_intensity_loading_fraction4.2004.0002.3050.18235
3fp_loading_speed5.8006.0001.6560.13435
4fp_temporal_contact6.3337.0002.2570.12935
5hp_loading_rate6.6003.0006.6950.16635
6fp_functional_output7.8678.0003.2040.12435
7fp_peak_loading_index7.8678.0004.0150.13035
8hp_loading_speed8.6006.0007.0690.11135
9hp_temporal_contact8.9339.0002.7890.09235
10hp_integrated_loading9.1339.0003.8890.08435
11fp_loading_rate11.40012.0003.7950.08735
12hp_intensity_density14.33313.0007.1980.04735
13hp_intensity_loading_fraction14.53313.0005.6040.04535
14fp_propulsion_time15.00015.0006.9080.07535
15hp_functional_output15.23314.0005.3880.03635
16hp_propulsion_loading15.76716.0004.5860.04535
17fp_stride_length_per_cycle17.06718.0004.4150.03435
18fp_maxintensity_loading_fraction17.13317.0004.6730.03535
19fp_integrated_loading17.66718.0003.5990.03535
20hp_maxintensity_loading_fraction18.46718.0003.9250.02835
21hp_peak_loading_index18.70019.0004.6740.03035
22swing_symmetry19.53319.0003.4610.02935
23stand_symmetry21.60022.0003.0480.02035
24duty_cycle_symmetry22.20023.0003.0580.01835
25hp_propulsion_time22.66724.0003.3360.01435
Paired Feature Ablation

Pooled feature-ablation summary

Summary method: top_ranked_subset

Indexed rows
30
Eligible rows
30

Showing 125 of 30 matching rows

Filters combine with AND. Empty and unreported values sort last.

Pooled feature-ablation summary. paired_feature_ablation.
catboostfp_intensity_density0.8610.8400.0210.0260.0121
catboosthp_temporal_contact0.8610.8590.0020.0040.0062
catboosthp_integrated_loading0.8610.862-5.36e-4-1.97e-40.0063
catboostfp_intensity_loading_fraction0.8610.862-5.76e-40.0020.0074
catboosthp_stride_length_per_cycle0.8610.862-9.34e-44.23e-40.0025
catboostfp_maxintensity_loading_fraction0.8610.862-9.38e-45.03e-40.0056
catboosthp_propulsion_loading0.8610.862-0.0011.62e-40.0067
catboostfp_temporal_contact0.8610.863-0.001-0.0020.0058
catboostfp_loading_rate0.8610.863-0.002-0.0010.0049
catboostfp_loading_speed0.8610.863-0.002-0.0020.01010
lgbmfp_intensity_density0.8450.8230.0220.0380.0391
lgbmhp_loading_rate0.8450.8390.0060.0060.0052
lgbmfp_propulsion_time0.8450.8400.0050.0040.0093
lgbmfp_temporal_contact0.8450.8410.0040.0030.0094
lgbmhp_loading_speed0.8450.8410.0040.0050.0045
lgbmhp_intensity_density0.8450.8410.0040.0040.0066
lgbmswing_symmetry0.8450.8420.0030.0030.0067
lgbmfp_stride_length_per_cycle0.8450.8420.0030.0030.0078
lgbmhp_propulsion_time0.8450.8420.0030.0020.0069
lgbmstand_symmetry0.8450.8420.0030.0030.00610
xgbfp_intensity_density0.8350.8100.0250.0450.0371
xgbhp_loading_rate0.8350.8280.0070.0030.0092
xgbhp_stride_length_per_cycle0.8350.8290.0060.0040.0053
xgbhp_propulsion_loading0.8350.8290.0060.0030.0044
xgbhp_propulsion_time0.8350.8300.0050.0020.0075
Shap Ablation Consensus Evidence

Clustered ablation uncertainty

Summary method: primary_metric_subset

Indexed rows
78
Eligible rows
78

Showing 125 of 78 matching rows

Filters combine with AND. Empty and unreported values sort last.

Clustered ablation uncertainty. shap_ablation_consensus_evidence.
catboosthp_peak_loading_indexmean_auchigherbaseline_minus_ablated-0.006-0.0146.42e-4
catboostfp_peak_loading_indexmean_auchigherbaseline_minus_ablated-0.008-0.0170.002
catboostfp_intensity_loading_fractionmean_auchigherbaseline_minus_ablated-5.76e-4-0.0070.006
catboosthp_intensity_loading_fractionmean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostfp_maxintensity_loading_fractionmean_auchigherbaseline_minus_ablated-9.38e-4-0.0090.007
catboosthp_maxintensity_loading_fractionmean_auchigherbaseline_minus_ablated-0.007-0.013-5.86e-4
catboosthp_loading_speedmean_auchigherbaseline_minus_ablated-0.005-0.0110.002
catboostfp_loading_speedmean_auchigherbaseline_minus_ablated-0.002-0.0100.006
catboosthp_functional_outputmean_auchigherbaseline_minus_ablated-0.009-0.016-0.002
catboostfp_functional_outputmean_auchigherbaseline_minus_ablated-0.009-0.016-0.002
catboostfp_intensity_densitymean_auchigherbaseline_minus_ablated0.0210.0040.039
catboosthp_intensity_densitymean_auchigherbaseline_minus_ablated-0.002-0.0090.005
catboostfp_integrated_loadingmean_auchigherbaseline_minus_ablated-0.004-0.0100.003
catboosthp_integrated_loadingmean_auchigherbaseline_minus_ablated-5.36e-4-0.0060.005
catboostfp_loading_ratemean_auchigherbaseline_minus_ablated-0.002-0.0090.006
catboosthp_loading_ratemean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostfp_propulsion_timemean_auchigherbaseline_minus_ablated-0.004-0.0120.004
catboosthp_propulsion_timemean_auchigherbaseline_minus_ablated-0.003-0.0100.003
catbooststand_symmetrymean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostswing_symmetrymean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostduty_cycle_symmetrymean_auchigherbaseline_minus_ablated-0.002-0.0090.004
catboostfp_temporal_contactmean_auchigherbaseline_minus_ablated-0.001-0.0080.005
catboosthp_temporal_contactmean_auchigherbaseline_minus_ablated0.002-0.0030.008
catboosthp_propulsion_loadingmean_auchigherbaseline_minus_ablated-0.001-0.0070.004
catboosthp_stride_length_per_cyclemean_auchigherbaseline_minus_ablated-9.41e-4-0.0070.005
Shap Ablation Consensus Evidence

Multiplicity-adjusted ablation evidence

Summary method: primary_metric_subset

Indexed rows
78
Eligible rows
78

Showing 125 of 78 matching rows

Filters combine with AND. Empty and unreported values sort last.

Multiplicity-adjusted ablation evidence. shap_ablation_consensus_evidence.
catboosthp_peak_loading_indexmean_auchigherbaseline_minus_ablated-0.006-0.0146.42e-4
catboostfp_peak_loading_indexmean_auchigherbaseline_minus_ablated-0.008-0.0170.002
catboostfp_intensity_loading_fractionmean_auchigherbaseline_minus_ablated-5.76e-4-0.0070.006
catboosthp_intensity_loading_fractionmean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostfp_maxintensity_loading_fractionmean_auchigherbaseline_minus_ablated-9.38e-4-0.0090.007
catboosthp_maxintensity_loading_fractionmean_auchigherbaseline_minus_ablated-0.007-0.013-5.86e-4
catboosthp_loading_speedmean_auchigherbaseline_minus_ablated-0.005-0.0110.002
catboostfp_loading_speedmean_auchigherbaseline_minus_ablated-0.002-0.0100.006
catboosthp_functional_outputmean_auchigherbaseline_minus_ablated-0.009-0.016-0.002
catboostfp_functional_outputmean_auchigherbaseline_minus_ablated-0.009-0.016-0.002
catboostfp_intensity_densitymean_auchigherbaseline_minus_ablated0.0210.0040.039
catboosthp_intensity_densitymean_auchigherbaseline_minus_ablated-0.002-0.0090.005
catboostfp_integrated_loadingmean_auchigherbaseline_minus_ablated-0.004-0.0100.003
catboosthp_integrated_loadingmean_auchigherbaseline_minus_ablated-5.36e-4-0.0060.005
catboostfp_loading_ratemean_auchigherbaseline_minus_ablated-0.002-0.0090.006
catboosthp_loading_ratemean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostfp_propulsion_timemean_auchigherbaseline_minus_ablated-0.004-0.0120.004
catboosthp_propulsion_timemean_auchigherbaseline_minus_ablated-0.003-0.0100.003
catbooststand_symmetrymean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostswing_symmetrymean_auchigherbaseline_minus_ablated-0.003-0.0090.003
catboostduty_cycle_symmetrymean_auchigherbaseline_minus_ablated-0.002-0.0090.004
catboostfp_temporal_contactmean_auchigherbaseline_minus_ablated-0.001-0.0080.005
catboosthp_temporal_contactmean_auchigherbaseline_minus_ablated0.002-0.0030.008
catboosthp_propulsion_loadingmean_auchigherbaseline_minus_ablated-0.001-0.0070.004
catboosthp_stride_length_per_cyclemean_auchigherbaseline_minus_ablated-9.41e-4-0.0070.005
Shap Ablation Consensus Evidence

SHAP-ablation consensus evidence

Summary method: approved_rows

Indexed rows
26
Eligible rows
26

Showing 125 of 26 matching rows

Filters combine with AND. Empty and unreported values sort last.

SHAP-ablation consensus evidence. shap_ablation_consensus_evidence.
duty_cycle_symmetry0.002-0.0020.00520.22869
fp_functional_output-0.001-0.0090.00320.01187
fp_integrated_loading7.32e-4-0.0040.00320.13478
fp_intensity_density0.0220.0210.02530.985150
fp_intensity_loading_fraction0.002-5.76e-40.00320.42186
fp_loading_rate7.59e-4-0.0020.00220.32996
fp_loading_speed6.30e-4-0.0020.00320.30096
fp_maxintensity_loading_fraction0.001-9.38e-40.00220.40887
fp_peak_loading_index-0.001-0.0080.00320.05096
fp_propulsion_time0.002-0.0040.00520.16987
fp_stride_length_per_cycle0.001-0.0040.00520.13169
fp_temporal_contact0.002-0.0010.00420.32678
hp_functional_output-0.001-0.0090.00320.00778
hp_integrated_loading0.001-5.36e-40.00320.42369
hp_intensity_density0.002-0.0020.00420.26996
hp_intensity_loading_fraction9.32e-4-0.0030.00320.17787
hp_loading_rate0.003-0.0030.00720.195105
hp_loading_speed9.81e-4-0.0050.00420.074114
hp_maxintensity_loading_fraction-7.03e-4-0.0070.00320.01768
hp_peak_loading_index-2.70e-4-0.0060.00320.03887
hp_propulsion_loading0.002-0.0010.00620.336105
hp_propulsion_time0.002-0.0030.00520.15478
hp_stride_length_per_cycle0.003-9.41e-40.00620.399105
hp_temporal_contact0.0030.0020.00430.78696
stand_symmetry0.001-0.0030.00420.16787
Shap Ablation Consensus Evidence

Combined feature ranking

Summary method: approved_rows

Indexed rows
26
Eligible rows
26

Showing 125 of 26 matching rows

Filters combine with AND. Empty and unreported values sort last.

Combined feature ranking. shap_ablation_consensus_evidence.
1fp_intensity_density1.0000.7420.02230.98515
2fp_intensity_loading_fraction4.2000.1820.00220.4218
3hp_loading_rate6.6000.1660.00320.19510
4fp_loading_speed5.8000.1346.30e-420.3009
5hp_loading_speed8.6000.1119.81e-420.07411
6hp_temporal_contact8.9330.0920.00330.7869
7hp_integrated_loading9.1330.0840.00120.4236
8fp_temporal_contact6.3330.1290.00220.3267
9fp_peak_loading_index7.8670.130-0.00120.0509
10fp_loading_rate11.4000.0877.59e-420.3299
11fp_functional_output7.8670.124-0.00120.0118
12hp_intensity_density14.3330.0470.00220.2699
13fp_propulsion_time15.0000.0750.00220.1698
14hp_propulsion_loading15.7670.0450.00220.33610
15hp_intensity_loading_fraction14.5330.0459.32e-420.1778
16fp_stride_length_per_cycle17.0670.0340.00120.1316
17fp_integrated_loading17.6670.0357.32e-420.1347
18hp_functional_output15.2330.036-0.00120.0077
19fp_maxintensity_loading_fraction17.1330.0350.00120.4088
20stand_symmetry21.6000.0200.00120.1678
21duty_cycle_symmetry22.2000.0180.00220.2286
22swing_symmetry19.5330.0297.52e-420.1457
23hp_stride_length_per_cycle23.3670.0130.00320.39910
24hp_maxintensity_loading_fraction18.4670.028-7.03e-420.0176
25hp_peak_loading_index18.7000.030-2.70e-420.0388
Shap Ablation Consensus Evidence

Authoritative fixed three-feature panel input

Summary method: approved_rows

Indexed rows
3
Eligible rows
3

Showing 13 of 3 matching rows

Filters combine with AND. Empty and unreported values sort last.

Authoritative fixed three-feature panel input. shap_ablation_consensus_evidence.
1fp_intensity_density1.0000.7420.02230.98515
2fp_intensity_loading_fraction4.2000.1820.00220.4218
3hp_loading_rate6.6000.1660.00320.19510