SCI Analysis Observatory

Evidence scope

Scope, workflow status, and summary measures

Associative Information Source Diagnostic

Information sourcesAnalyze predictive information sourcesComplete

Linked filters

Selections combine with AND across dimensions.

ModelMetric

No shared filters active.

Aggregate estimate plot

Information-block mean AUC

Associative Information Source Diagnostic

catboost_native_reference

0.861

experiment

0.862

experiment_gait

0.903

experiment_missingness

0.899

experiment_missingness_gait

0.908

experiment_prior_reference

0.862

gait

0.811

intercept

0.484

lgbm_native_reference

0.845

missingness

0.728

missingness_gait

0.846

xgb_native_reference

0.835

Uncertainty: Point estimates are shown because this table does not supply matching lower and upper interval columns.

View plotted values in tabular form

Information-block mean AUC: tabulated plot data
Estimate	Marker	Mean Auc
catboost_native_reference	◆	0.861
experiment	◆	0.862
experiment_gait	◆	0.903
experiment_missingness	⬟	0.899
experiment_missingness_gait	⬟	0.908
experiment_prior_reference	●	0.862
gait	■	0.811
intercept	▲	0.484
lgbm_native_reference	▲	0.845
missingness	◆	0.728
missingness_gait	◆	0.846
xgb_native_reference	■	0.835

Mean Auc from Information-block performance. Shared filters apply to both this plot and its source table.

Aggregate estimate plot

Incremental information contrasts

Associative Information Source Diagnostic

experiment_vs_intercept · early_auc

0.390

experiment_vs_intercept · late_auc

0.367

experiment_vs_intercept · mean_auc

0.379

experiment_vs_intercept · accuracy

0.215

experiment_vs_intercept · balanced_accuracy

0.277

experiment_vs_intercept · log_loss

0.382

experiment_vs_intercept · ordinal_mae

0.437

experiment_vs_intercept · mean_cumulative_brier

0.096

missingness_vs_intercept · early_auc

0.274

missingness_vs_intercept · late_auc

0.213

missingness_vs_intercept · mean_auc

0.244

missingness_vs_intercept · accuracy

0.139

missingness_vs_intercept · balanced_accuracy

0.204

missingness_vs_intercept · log_loss

0.181

missingness_vs_intercept · ordinal_mae

0.270

missingness_vs_intercept · mean_cumulative_brier

0.047

gait_vs_intercept · early_auc

0.312

gait_vs_intercept · late_auc

0.344

gait_vs_intercept · mean_auc

0.328

gait_vs_intercept · accuracy

0.124

gait_vs_intercept · balanced_accuracy

0.165

gait_vs_intercept · log_loss

-0.047

gait_vs_intercept · ordinal_mae

0.235

gait_vs_intercept · mean_cumulative_brier

0.047

Uncertainty: Horizontal intervals use Ci Lower and Ci Upper from the published aggregate table.

View plotted values in tabular form

Incremental information contrasts: tabulated plot data
Estimate	Marker	Estimate	Lower interval	Upper interval
experiment_vs_intercept · early_auc	✦	0.390	0.277	0.503
experiment_vs_intercept · late_auc	⬟	0.367	0.261	0.470
experiment_vs_intercept · mean_auc	●	0.379	0.273	0.479
experiment_vs_intercept · accuracy	●	0.215	0.175	0.251
experiment_vs_intercept · balanced_accuracy	⬟	0.277	0.247	0.308
experiment_vs_intercept · log_loss	⬟	0.382	0.338	0.425
experiment_vs_intercept · ordinal_mae	✦	0.437	0.371	0.492
experiment_vs_intercept · mean_cumulative_brier	◆	0.096	0.084	0.109
missingness_vs_intercept · early_auc	✦	0.274	0.150	0.396
missingness_vs_intercept · late_auc	⬟	0.213	0.106	0.321
missingness_vs_intercept · mean_auc	●	0.244	0.137	0.347
missingness_vs_intercept · accuracy	●	0.139	0.078	0.194
missingness_vs_intercept · balanced_accuracy	⬟	0.204	0.149	0.256
missingness_vs_intercept · log_loss	⬟	0.181	0.111	0.247
missingness_vs_intercept · ordinal_mae	✦	0.270	0.172	0.362
missingness_vs_intercept · mean_cumulative_brier	◆	0.047	0.028	0.064
gait_vs_intercept · early_auc	▲	0.312	0.198	0.423
gait_vs_intercept · late_auc	◆	0.344	0.221	0.459
gait_vs_intercept · mean_auc	✦	0.328	0.215	0.432
gait_vs_intercept · accuracy	✦	0.124	0.072	0.176
gait_vs_intercept · balanced_accuracy	◆	0.165	0.109	0.221
gait_vs_intercept · log_loss	◆	-0.047	-0.384	0.187
gait_vs_intercept · ordinal_mae	▲	0.235	0.147	0.323
gait_vs_intercept · mean_cumulative_brier	■	0.047	0.037	0.057

Estimate from Incremental predictive-information contrasts. Shared filters apply to both this plot and its source table.

Associative Information Source Diagnostic

Information-block performance

Summary method: approved_rows

Indexed rows: 12
Eligible rows: 12

Showing 1–12 of 12 matching rows

Filters combine with AND. Empty and unreported values sort last.

Information-block performance. associative_information_source_diagnostic.

catboost_native_reference	396	115	0.871	0.852	0.861	0.644	0.606
experiment	396	115	0.874	0.851	0.862	0.657	0.610
experiment_gait	396	115	0.931	0.874	0.903	0.720	0.677
experiment_missingness	396	115	0.936	0.862	0.899	0.735	0.703
experiment_missingness_gait	396	115	0.937	0.879	0.908	0.730	0.691
experiment_prior_reference	396	115	0.874	0.851	0.862	0.657	0.610
gait	396	115	0.796	0.827	0.811	0.566	0.498
intercept	396	115	0.484	0.484	0.484	0.442	0.333
lgbm_native_reference	396	115	0.859	0.830	0.845	0.636	0.596
missingness	396	115	0.758	0.697	0.728	0.581	0.537
missingness_gait	396	115	0.855	0.838	0.846	0.624	0.573
xgb_native_reference	396	115	0.852	0.817	0.835	0.621	0.580

Rows per pagePage 1 of 1

Associative Information Source Diagnostic

Incremental predictive-information contrasts

Summary method: approved_rows

Indexed rows: 72
Eligible rows: 72

Showing 1–25 of 72 matching rows

Filters combine with AND. Empty and unreported values sort last.

Incremental predictive-information contrasts. associative_information_source_diagnostic.

experiment_beyond_missingness	missingness	experiment_missingness	early_auc	after_minus_before	0.178	0.950	0.124
experiment_beyond_missingness	missingness	experiment_missingness	late_auc	after_minus_before	0.165	0.950	0.111
experiment_beyond_missingness	missingness	experiment_missingness	mean_auc	after_minus_before	0.172	0.950	0.123
experiment_beyond_missingness	missingness	experiment_missingness	accuracy	after_minus_before	0.154	0.950	0.111
experiment_beyond_missingness	missingness	experiment_missingness	balanced_accuracy	after_minus_before	0.166	0.950	0.117
experiment_beyond_missingness	missingness	experiment_missingness	log_loss	before_minus_after	0.279	0.950	0.223
experiment_beyond_missingness	missingness	experiment_missingness	ordinal_mae	before_minus_after	0.260	0.950	0.192
experiment_beyond_missingness	missingness	experiment_missingness	mean_cumulative_brier	before_minus_after	0.067	0.950	0.050
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	early_auc	after_minus_before	0.082	0.950	0.059
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	late_auc	after_minus_before	0.041	0.950	0.022
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	mean_auc	after_minus_before	0.062	0.950	0.044
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	accuracy	after_minus_before	0.106	0.950	0.062
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	balanced_accuracy	after_minus_before	0.118	0.950	0.067
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	log_loss	before_minus_after	0.183	0.950	0.151
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	ordinal_mae	before_minus_after	0.174	0.950	0.106
experiment_beyond_missingness_and_gait	missingness_gait	experiment_missingness_gait	mean_cumulative_brier	before_minus_after	0.039	0.950	0.029
experiment_vs_intercept	intercept	experiment	early_auc	after_minus_before	0.390	0.950	0.277
experiment_vs_intercept	intercept	experiment	late_auc	after_minus_before	0.367	0.950	0.261
experiment_vs_intercept	intercept	experiment	mean_auc	after_minus_before	0.379	0.950	0.273
experiment_vs_intercept	intercept	experiment	accuracy	after_minus_before	0.215	0.950	0.175
experiment_vs_intercept	intercept	experiment	balanced_accuracy	after_minus_before	0.277	0.950	0.247
experiment_vs_intercept	intercept	experiment	log_loss	before_minus_after	0.382	0.950	0.338
experiment_vs_intercept	intercept	experiment	ordinal_mae	before_minus_after	0.437	0.950	0.371
experiment_vs_intercept	intercept	experiment	mean_cumulative_brier	before_minus_after	0.096	0.950	0.084
gait_beyond_experiment_and_missingness	experiment_missingness	experiment_missingness_gait	early_auc	after_minus_before	9.31e-4	0.950	-0.013

Rows per pagePage 1 of 3

Associative Information Source Diagnostic

Associative Shapley allocation

Summary method: approved_rows

Indexed rows: 6
Eligible rows: 6

Showing 1–6 of 6 matching rows

Filters combine with AND. Empty and unreported values sort last.

Associative Shapley allocation. associative_information_source_diagnostic.

log_loss	E	0.287	0.323	0.889	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.
log_loss	M	0.124	0.323	0.384	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.
log_loss	G	-0.088	0.323	-0.272	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.
mean_cumulative_brier	E	0.066	0.110	0.595	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.
mean_cumulative_brier	M	0.025	0.110	0.223	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.
mean_cumulative_brier	G	0.020	0.110	0.182	Associational allocation of shared predictive information; not a causal fraction and not an estimate of feature use by any one boosted-tree classifier.

Rows per pagePage 1 of 1

Associative Information Source Diagnostic

Same-day source-fingerprint discrimination

Summary method: approved_rows

Indexed rows: 36
Eligible rows: 36

Showing 1–25 of 36 matching rows

Filters combine with AND. Empty and unreported values sort last.

Same-day source-fingerprint discrimination. associative_information_source_diagnostic.

BMDM__vs__IL4	day_forepaw_run_values	77	38	0.999	0.986	0.034	0.999
BMDM__vs__IL4	day_missingness	77	38	0.793	0.741	0.473	0.835
BMDM__vs__IL4	day_missingness_forepaw_run_values	77	38	1.000	0.986	0.034	1.000
BMDM__vs__IL4	day_only	77	38	0.500	0.500	0.693	0.500
BMDM__vs__NK1	day_forepaw_run_values	51	18	1.000	1.000	0.009	1.000
BMDM__vs__NK1	day_missingness	51	18	0.396	0.407	0.771	0.396
BMDM__vs__NK1	day_missingness_forepaw_run_values	51	18	1.000	1.000	0.014	1.000
BMDM__vs__NK1	day_only	51	18	0.500	0.500	0.693	0.500
BMDM__vs__SHH	day_forepaw_run_values	25	11	1.000	0.972	0.117	1.000
BMDM__vs__SHH	day_missingness	25	11	0.964	0.901	0.217	0.964
BMDM__vs__SHH	day_missingness_forepaw_run_values	25	11	1.000	0.972	0.098	1.000
BMDM__vs__SHH	day_only	25	11	0.500	0.500	0.693	0.500
BMDM__vs__VEGF	day_forepaw_run_values	85	42	0.994	0.948	0.108	0.993
BMDM__vs__VEGF	day_missingness	85	42	0.816	0.747	0.459	0.845
BMDM__vs__VEGF	day_missingness_forepaw_run_values	85	42	0.995	0.948	0.114	0.993
BMDM__vs__VEGF	day_only	85	42	0.500	0.500	0.693	0.500
IL4__vs__NK1	day_forepaw_run_values	59	38	0.921	0.923	0.483	0.921
IL4__vs__NK1	day_missingness	59	38	0.519	0.559	0.695	0.519
IL4__vs__NK1	day_missingness_forepaw_run_values	59	38	0.922	0.908	0.563	0.922
IL4__vs__NK1	day_only	59	38	0.500	0.500	0.693	0.500
IL4__vs__SHH	day_forepaw_run_values	124	32	0.952	0.887	0.222	0.952
IL4__vs__SHH	day_missingness	124	32	0.459	0.455	0.703	0.332
IL4__vs__SHH	day_missingness_forepaw_run_values	124	32	0.916	0.892	0.267	0.905
IL4__vs__SHH	day_only	124	32	0.500	0.500	0.693	0.500
IL4__vs__VEGF	day_forepaw_run_values	189	75	0.922	0.885	0.404	0.939

Rows per pagePage 1 of 2

Associative Information Source Diagnostic

Source-fingerprint increments

Summary method: approved_rows

Indexed rows: 27
Eligible rows: 27

Showing 1–25 of 27 matching rows

Filters combine with AND. Empty and unreported values sort last.

Source-fingerprint increments. associative_information_source_diagnostic.

BMDM__vs__IL4	day_only	day_forepaw_run_values	0.499	0.658	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__IL4	day_only	day_missingness	0.335	0.258	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__IL4	day_only	day_missingness_forepaw_run_values	0.500	0.659	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__NK1	day_only	day_forepaw_run_values	0.500	0.682	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__NK1	day_only	day_missingness	-0.104	-0.098	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__NK1	day_only	day_missingness_forepaw_run_values	0.500	0.677	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__SHH	day_only	day_forepaw_run_values	0.500	0.600	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__SHH	day_only	day_missingness	0.464	0.432	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__SHH	day_only	day_missingness_forepaw_run_values	0.500	0.613	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__VEGF	day_only	day_forepaw_run_values	0.493	0.571	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__VEGF	day_only	day_missingness	0.345	0.264	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
BMDM__vs__VEGF	day_only	day_missingness_forepaw_run_values	0.493	0.564	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__NK1	day_only	day_forepaw_run_values	0.421	0.164	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__NK1	day_only	day_missingness	0.019	-0.001	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__NK1	day_only	day_missingness_forepaw_run_values	0.422	0.071	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__SHH	day_only	day_forepaw_run_values	0.452	0.341	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__SHH	day_only	day_missingness	-0.168	-0.035	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__SHH	day_only	day_missingness_forepaw_run_values	0.405	0.259	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__VEGF	day_only	day_forepaw_run_values	0.439	0.354	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__VEGF	day_only	day_missingness	0.057	-0.004	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
IL4__vs__VEGF	day_only	day_missingness_forepaw_run_values	0.429	0.331	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
NK1__vs__VEGF	day_only	day_forepaw_run_values	0.495	0.587	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
NK1__vs__VEGF	day_only	day_missingness	-0.110	-4.10e-5	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
NK1__vs__VEGF	day_only	day_missingness_forepaw_run_values	0.493	0.570	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.
SHH__vs__VEGF	day_only	day_forepaw_run_values	0.413	0.332	Conditional same-day source separability; consistent with source-specific cohort/acquisition/processing differences, but not diagnostic of their cause.

Rows per pagePage 1 of 2

Information-source diagnostics

Scope, workflow status, and summary measures

Apply filters to tables and figures

Information-block mean AUC

Incremental information contrasts

Information-block performance

Incremental predictive-information contrasts

Associative Shapley allocation

Same-day source-fingerprint discrimination

Source-fingerprint increments