PDF to Markdown Benchmarks

Inspect the output. Follow the evidence.

Mistral OCR 4.1

Explore the paired invoice example: one page, a complete response, a Markdown purchase-order table and an HTML table with merged totals cells.

Source PDF · Full Markdown · September 10, 2026 capture metadata

Current CJK evaluation status

Inspect the September 10, 2026 original CJK and table corpus. Collection stopped after the public demo denied the first request. No OCR result or observed model was returned; quality and aggregate timing metrics remain unmeasured. The inputs, reviewed ground truth and complete sanitized failure are available to download.

Methodology

Evaluate identical source bytes and page selections. Retain source hashes, model versions and full outputs; check reading order, text and table cells against reviewed ground truth. Report failures alongside successful conversions.

Compute character error rate as Levenshtein distance divided by ground-truth characters after the same text normalization. Measure latency across repeated runs with matched transport and settings; report median and nearest-rank p95.

Current comparison status: CER, median latency and p95 latency are unmeasured. A numerical comparison is pending matched, repeated runs with retained raw captures.

Historical results

July 2026 CJK benchmark: PaddleOCR vs Tesseract 5.5.1 on three simulated scans, with character error rates and table output.