AIarXiv
Ranked by formulaVerdict: NotableEpiLens: Lightweight RAG for Epidemiological Knowledge Acquisition
To prepare for future outbreaks, researchers need to know what studies have been done and what data they use.
Key numbers
- 54% versus 22%
- 62% versus 24% in the
- 55% for SARS-CoV-2 versus 6%
Caveats
- Preprint; not yet peer reviewed.
VerdictWorth a reader's time today.
Abstract
To prepare for future outbreaks, researchers need to know what studies have been done and what data they use. Mapping a large literature by hand is slow, while large language models alone can misstate or conflate sources. We present EpiLens, a lightweight, open-source retrieval-augmented generation package that applies a fixed retrieval template and output schema to every paper in a corpus and links outputs to source passages. We build a corpus of 2,297 papers from the sources of a multi-pathogen parameter study and evaluate EpiLens's paper-classification workflow against 214 manually labelled papers. Without task-specific training data, the classifier matches or exceeds the tested supervised and zero-shot baselines across four tasks. The study's early extraction sheets cite published sources for 327 estimates. We link each estimate to a cited document or to corpus studies included by a review. Then, we use the classifier's labels to compare the papers associated with different parameters and pathogens. EpiLens labels more papers linked to reproduction numbers than fatality risks as model-based (54% versus 22%, compared with 62% versus 24% in the manual labels). The gap is consistent with the frequent use of transmission models to estimate reproduction numbers and persists within each of five pathogens compared. Beyond the contrast between parameters, the model-based share of papers linked to incubation-period estimates differs by pathogen: 55% for SARS-CoV-2 versus 6% for mpox.
The editor's rubric
- Leverage4 / 5
- A general-purpose tool used across several fields (Adam, ResNet, LoRA, next-generation sequencing).
- Magnitude3 / 5
- Large gain: roughly 2x, or a clear new state of the art on a hard, unsaturated problem.
- Evidence3 / 5
- Solid: multiple benchmarks or cohorts, ablations, fair baselines, released code or data.
- Novelty1 / 5
- A minor twist on a known approach.
- Trajectory2 / 5
- Some room to improve with obvious engineering.
- Stakes3 / 5
- Meaningful benefit to many people within a few years.
Editor’s rationale
Heuristic triage from title and abstract text only, not a reading of the paper. Cues found: method (we propose); breadth (many tasks, zero/few-shot); gains (versus baseline, outperforms); novelty (alternative to status quo); verification (multiple benchmarks, code released); stakes (general AI, mortality, major disease). Red flags: derivative (comparative study, we apply).
How the score was computed
Desks place stronger verdicts first, then use this score to order work within the same verdict.
- Merit
- 5.5 / 10
- Adjusted merit
- 4.7 / 10
- Attention
- 0%
- Freshness
- 66%