Quote and page verification, measured on a fixed PDF set.
EvidenceGrid was tested on 11 research PDFs and 88 extracted fields in the production workflow. The result below covers upload, extraction, source matching, repair, and conservative Synthesis output.
Every threshold passed on this test set.
Rates describe one fixed production acceptance run. They should be read with the scope and limitations below.
| Metric | Result | Rate | Target |
|---|---|---|---|
| Supported PDF uploads | 11 / 11 | 100% | 95% or higher |
| Extraction jobs completed | 11 / 11 | 100% | 95% or higher |
| Quote location after repair | 87 / 88 | 98.86% | 95% or higher |
| Claimed page accuracy after repair | 87 / 88 | 98.86% | 95% or higher |
| Repair success | 4 / 4 | 100% | 90% or higher |
| Strictly supported synthesis statements | 3 / 3 | 100% | 90% or higher |
A source-first acceptance sequence.
- 01
Upload representative PDFs
The set included files up to 15.54 MiB and one scanned document within the declared 50 MiB limit.
- 02
Extract and independently locate evidence
Each generated quote and claimed page was checked against independently extracted PDF text.
- 03
Repair uncertain fields
Four failed initial matches were reprocessed at field level and then checked again against the source.
- 04
Audit retained synthesis statements
Three retained items were manually checked against every supplied quote and page. All three were strictly supported.
The extracted value and its source stay together.
The acceptance test evaluated continuous quote location and claimed page accuracy. The product exposes the same quote, page, match state, and Open page action to the researcher.
What this benchmark does not establish.
- It does not guarantee identical performance for every PDF layout, scan quality, discipline, or extraction schema.
- It does not remove the need for a researcher to review evidence before using it in a paper or decision.
- It covers a fixed 11-paper production run and reports the measured result without extrapolating to all users.
- Files above the current 50 MiB single-file limit were outside the accepted upload set.