Held-out synthetic test set

Synthetic history-only vignettes for ICHD-3 chapters 1–4 (primary headaches), written by Claude models from reasoner-verified ICHD-3 graph skeletons and never published. Split by skeleton family: no public case shares a skeleton with a held-out case. Automatically verified, not clinically validated.

Version
1.0 (exported 2026-10-22)
Cases
364 texts from 178 case skeletons, 70 ICHD-3 diagnoses
Written by
Claude (Anthropic): German and English texts plus an independent Claude Opus re-verbalisation of some English texts
SHA-256 commitment
1c8515a89d3e9d60a9f7afeaae3615ed7e0302627cfd3f821e7241908a6b061d
Diagnosis group EnglishGerman Total
1 Migraine 6665 131
2 Tension-type headache (TTH) 3634 70
3 Trigeminal autonomic cephalalgias (TACs) 4846 94
4 Other primary headache disorders 3633 69
Total 186178 364

The hash is taken over the canonical file of the held-out cases, so the set can be verified when it is eventually released without being revealed before. Results on this set are produced by the platform team off-platform.

Request a benchmark

Study dataset (BB 211/25)

Study cases are held on the platform only as encrypted, never-decryptable blobs — the platform cannot read or count them, so these figures are maintained by the study team. The data itself is not publicly downloadable.

No study-dataset figures have been published yet.