NotebookLM (Gemini 3.0 Pro)
All 1 published result of this model on the leaderboard — every version, method and dataset — with the publications they come from. Results on different datasets are not directly comparable.
- Version
- accessed 2026-02
- Approach
- Retrieval-augmented
- Dataset
- Size
- accessed 2026-02: ~3T · Estimate of a related model (see “About model sizes” on the leaderboard)
Publications
- https://doi.org/10.5455/medscience.2026.03.055 — 1 result on Babaoglu-35
Results
| Version · badges | Approach | Dataset | Top-1 (diagnosis) | Top-3 (diagnosis) | Top-1 (group) | Top-3 (group) | Cohen's Kappa | Links |
|---|---|---|---|---|---|---|---|---|
| accessed 2026-02 Peer-reviewed publication ↗ |
NotebookLM over ICHD-3 + guidelines
Approach · Retrieval-augmented NotebookLM over ICHD-3 + guidelinesNotebookLM indexed with the full ICHD-3 and major headache treatment guidelines (PDF); each vignette in a fresh session, answers grounded in the uploaded sources. Retrieval-augmented approachesFor each case, relevant ICHD-3 knowledge is retrieved from a text collection and added to the prompt; the language model decides.
|
External dataset · Babaoglu-35 Babaoğlu headache case vignettes35 fictional case vignettes written for the study: 17 primary headaches, 15 secondary headaches, 3 neuropathic/facial pain syndromes; gold-standard diagnoses by two pain specialists. Very small set — read the 100 % as an upper bound, not a stable estimate. Results on this dataset are not directly comparable with results on a platform release or on another dataset. About this resultSubtype-level top-1 35/35 (95 % CI 90.0–100.0); secondary vs non-secondary 35/35.
|
100.00 % | — | — | — | 1.000 | Paper |