ADEEB NOOR
RIDI · PREREGISTERED RAG · SCIFACT 275

Identical audits can yield different AI decisions.

17.27% of benchmark-defined RAG decisions flip at the preregistered primary condition, even when the registered retrieval audit is held exactly fixed.

Run the decisive case

Same positive passage. Same rank. Same retrieval metrics.

Claim 275
Combining phosphatidylinositide 3-kinase and MEK 1/2 inhibitors is effective at treating KRAS mutant tumors.
AUDIT SIGNATURE: IDENTICAL

Context A · reference

1
4961038
2
85665741
3
4920376
4
3078550
5
1285713
6
28651643
7
2272614
8
11200685
9
22980205
10
24190159

Context B · identity substitution

1
4961038
2
9767444
3
9505402
4
21931005
5
33387953
6
29321530
7
15322518
8
27428509
9
41650417
10
9021186
precision@100.1000
recall@100.3333
nDCG@100.4693
MRR@101.0000
MAP@100.3333
Context A verdictSUPPORTS
Context B verdictREFUTES
Press Run demo to reveal the decisions.