Conformance¶
The same tests, run for every engine: the share of tests each engine passes, overall and in the two areas.
Results of 2026-11-14, web-platform-tests commit 4c84956f8341.
| Engine | Version | Overall | Web | |
|---|---|---|---|---|
| Chromium | Chromium 156.0.8078.79 built on Debian GNU/Linux 12 (bookworm) | 55.7 % | 69.6 % | 41.9 % |
| kolinsky | kolinsky 0.0.0 (2026-11-19) | 52.9 % | 41.2 % | 64.6 % |
| WeasyPrint | WeasyPrint version 70.0 | 52.2 % | 40.5 % | 63.9 % |
| fulgur | fulgur 0.41.0 | 31.7 % | 27.4 % | 36.0 % |
| PlutoPrint | PlutoPrint v0.23.0 | 31.6 % | 35.7 % | 27.4 % |
| fullbleed | fullbleed 2.5.52 | 29.2 % | 29.3 % | 29.1 % |
| ironpress | ironpress 1.7.0 | 27.6 % | 28.9 % | 26.3 % |
| wkhtmltopdf | wkhtmltopdf 0.12.6 | 27.5 % | 37.9 % | 17.0 % |
Method¶
The benchmark has two areas:
- Web: the reftests of the web-platform-tests
css/andsvg/directories at a pinned commit. Each test and its reference are rendered to PDF, every page is rasterized at 96 dpi withpdftoppm, and the rasters are compared with the rules of the web-platform-tests: equal page counts, then every page equal within the test's fuzzy allowance. Tests that need scripts, wait for scripts or are manual are left out for every engine, since PDF engines do not run scripts. Screen tests get an 800 x 600 px page, print tests a 5 x 3 in page with 0.5 in margins; a test's own@pagerules win. - PDF: checks of PDF features and paged media that reftests cannot express: navigation (links, bookmarks), metadata, page geometry, text extraction, graphics, accessibility (tags), forms, attachments, output standards and viewer settings. Each check renders a small document and reads the PDF back.
The overall score is the mean of the two area scores. Each engine runs in one container image, with a 30 second limit per document. How to run the benchmark is in the contributor guide of the source distribution.
Scores per group¶
| Group | Chromium | kolinsky | WeasyPrint | fulgur | PlutoPrint | fullbleed | ironpress | wkhtmltopdf |
|---|---|---|---|---|---|---|---|---|
| cascade-values | 85.6 % | 49.3 % | 48.5 % | 57.0 % | 39.5 % | 35.7 % | 43.1 % | 63.4 % |
| fragmentation | 82.0 % | 9.1 % | 10.4 % | 10.2 % | 11.2 % | 9.5 % | 7.1 % | 13.9 % |
| generated-content | 82.7 % | 55.6 % | 55.2 % | 12.7 % | 59.9 % | 24.5 % | 26.6 % | 48.4 % |
| graphics | 57.4 % | 34.7 % | 32.9 % | 34.4 % | 34.8 % | 29.3 % | 28.0 % | 45.7 % |
| layout | 78.1 % | 27.4 % | 26.6 % | 26.7 % | 30.4 % | 18.2 % | 16.7 % | 53.2 % |
| paged-media | 45.7 % | 80.2 % | 79.2 % | 24.3 % | 36.0 % | 62.9 % | 54.6 % | 10.5 % |
| text | 55.6 % | 32.2 % | 30.9 % | 26.7 % | 38.2 % | 24.8 % | 26.1 % | 30.4 % |
| pdf-navigation | 71.1 % | 100.0 % | 96.6 % | 71.9 % | 36.1 % | 1.6 % | 25.2 % | 18.3 % |
| pdf-metadata | 43.7 % | 64.5 % | 64.5 % | 52.0 % | 27.0 % | 8.3 % | 8.3 % | 18.7 % |
| pdf-page-geometry | 52.7 % | 79.1 % | 79.1 % | 40.2 % | 35.1 % | 79.4 % | 47.6 % | 5.1 % |
| pdf-text | 98.8 % | 100.0 % | 100.0 % | 72.6 % | 82.1 % | 66.6 % | 95.2 % | 65.7 % |
| pdf-graphics | 75.8 % | 77.3 % | 85.7 % | 46.0 % | 61.6 % | 73.2 % | 68.0 % | 45.6 % |
| pdf-accessibility | 57.0 % | 68.7 % | 68.7 % | 52.5 % | 2.0 % | 36.6 % | 2.0 % | 2.0 % |
| pdf-interactive | 0.0 % | 93.8 % | 72.8 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % |
| pdf-attachments | 0.0 % | 42.8 % | 42.8 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % |
| pdf-output | 19.9 % | 19.9 % | 28.5 % | 24.7 % | 30.7 % | 25.7 % | 17.1 % | 15.2 % |
| pdf-viewer | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % | 0.0 % |