Skip to content

Conformance

The same tests, run for every engine: the share of tests each engine passes, overall and in the two areas.

Results of 2026-11-14, web-platform-tests commit 4c84956f8341.

Conformance score per engine: overall, web area and PDF area overall web (CSS and SVG reftests) PDF checks 0 % 25 % 50 % 75 % 100 % Chromium Chromium, overall: 55.7 % 55.7 % Chromium, web (CSS and SVG reftests): 69.6 % 69.6 % Chromium, PDF checks: 41.9 % 41.9 % kolinsky kolinsky, overall: 52.9 % 52.9 % kolinsky, web (CSS and SVG reftests): 41.2 % 41.2 % kolinsky, PDF checks: 64.6 % 64.6 % WeasyPrint WeasyPrint, overall: 52.2 % 52.2 % WeasyPrint, web (CSS and SVG reftests): 40.5 % 40.5 % WeasyPrint, PDF checks: 63.9 % 63.9 % fulgur fulgur, overall: 31.7 % 31.7 % fulgur, web (CSS and SVG reftests): 27.4 % 27.4 % fulgur, PDF checks: 36.0 % 36.0 % PlutoPrint PlutoPrint, overall: 31.6 % 31.6 % PlutoPrint, web (CSS and SVG reftests): 35.7 % 35.7 % PlutoPrint, PDF checks: 27.4 % 27.4 % fullbleed fullbleed, overall: 29.2 % 29.2 % fullbleed, web (CSS and SVG reftests): 29.3 % 29.3 % fullbleed, PDF checks: 29.1 % 29.1 % ironpress ironpress, overall: 27.6 % 27.6 % ironpress, web (CSS and SVG reftests): 28.9 % 28.9 % ironpress, PDF checks: 26.3 % 26.3 % wkhtmltopdf wkhtmltopdf, overall: 27.5 % 27.5 % wkhtmltopdf, web (CSS and SVG reftests): 37.9 % 37.9 % wkhtmltopdf, PDF checks: 17.0 % 17.0 %
Engine Version Overall Web PDF
Chromium Chromium 156.0.8078.79 built on Debian GNU/Linux 12 (bookworm) 55.7 % 69.6 % 41.9 %
kolinsky kolinsky 0.0.0 (2026-11-19) 52.9 % 41.2 % 64.6 %
WeasyPrint WeasyPrint version 70.0 52.2 % 40.5 % 63.9 %
fulgur fulgur 0.41.0 31.7 % 27.4 % 36.0 %
PlutoPrint PlutoPrint v0.23.0 31.6 % 35.7 % 27.4 %
fullbleed fullbleed 2.5.52 29.2 % 29.3 % 29.1 %
ironpress ironpress 1.7.0 27.6 % 28.9 % 26.3 %
wkhtmltopdf wkhtmltopdf 0.12.6 27.5 % 37.9 % 17.0 %

Method

The benchmark has two areas:

  • Web: the reftests of the web-platform-tests css/ and svg/ directories at a pinned commit. Each test and its reference are rendered to PDF, every page is rasterized at 96 dpi with pdftoppm, and the rasters are compared with the rules of the web-platform-tests: equal page counts, then every page equal within the test's fuzzy allowance. Tests that need scripts, wait for scripts or are manual are left out for every engine, since PDF engines do not run scripts. Screen tests get an 800 x 600 px page, print tests a 5 x 3 in page with 0.5 in margins; a test's own @page rules win.
  • PDF: checks of PDF features and paged media that reftests cannot express: navigation (links, bookmarks), metadata, page geometry, text extraction, graphics, accessibility (tags), forms, attachments, output standards and viewer settings. Each check renders a small document and reads the PDF back.

The overall score is the mean of the two area scores. Each engine runs in one container image, with a 30 second limit per document. How to run the benchmark is in the contributor guide of the source distribution.

Scores per group

Group Chromium kolinsky WeasyPrint fulgur PlutoPrint fullbleed ironpress wkhtmltopdf
cascade-values 85.6 % 49.3 % 48.5 % 57.0 % 39.5 % 35.7 % 43.1 % 63.4 %
fragmentation 82.0 % 9.1 % 10.4 % 10.2 % 11.2 % 9.5 % 7.1 % 13.9 %
generated-content 82.7 % 55.6 % 55.2 % 12.7 % 59.9 % 24.5 % 26.6 % 48.4 %
graphics 57.4 % 34.7 % 32.9 % 34.4 % 34.8 % 29.3 % 28.0 % 45.7 %
layout 78.1 % 27.4 % 26.6 % 26.7 % 30.4 % 18.2 % 16.7 % 53.2 %
paged-media 45.7 % 80.2 % 79.2 % 24.3 % 36.0 % 62.9 % 54.6 % 10.5 %
text 55.6 % 32.2 % 30.9 % 26.7 % 38.2 % 24.8 % 26.1 % 30.4 %
pdf-navigation 71.1 % 100.0 % 96.6 % 71.9 % 36.1 % 1.6 % 25.2 % 18.3 %
pdf-metadata 43.7 % 64.5 % 64.5 % 52.0 % 27.0 % 8.3 % 8.3 % 18.7 %
pdf-page-geometry 52.7 % 79.1 % 79.1 % 40.2 % 35.1 % 79.4 % 47.6 % 5.1 %
pdf-text 98.8 % 100.0 % 100.0 % 72.6 % 82.1 % 66.6 % 95.2 % 65.7 %
pdf-graphics 75.8 % 77.3 % 85.7 % 46.0 % 61.6 % 73.2 % 68.0 % 45.6 %
pdf-accessibility 57.0 % 68.7 % 68.7 % 52.5 % 2.0 % 36.6 % 2.0 % 2.0 %
pdf-interactive 0.0 % 93.8 % 72.8 % 0.0 % 0.0 % 0.0 % 0.0 % 0.0 %
pdf-attachments 0.0 % 42.8 % 42.8 % 0.0 % 0.0 % 0.0 % 0.0 % 0.0 %
pdf-output 19.9 % 19.9 % 28.5 % 24.7 % 30.7 % 25.7 % 17.1 % 15.2 %
pdf-viewer 0.0 % 0.0 % 0.0 % 0.0 % 0.0 % 0.0 % 0.0 % 0.0 %