MarketAIVerse the universe of AI

Benchmark sheet

Technical manuals, translated and typeset. This is the tool's sheet, published exactly as it looks right now. The product page is here.

⛔ One of the seven rows failed, and it is the one that matters most

A page that holds only a table is dropped. The tool keeps the pages it detects as Romanian, and a specification table — part numbers, volts, amps, kilograms — contains no Romanian words to detect. Its language score is 0.0000 against a threshold of 0.012. Not near the line. Nowhere near it.

We then put the table between pages of prose, the way it sits in a real manual: pages 3, 4 and 5 of 8 were dropped, and neither „Tensiune" nor the part code „A-101" reached the output. In a product manual, that table is often the page the customer actually needs.

It does not crash and it does not warn: the caller can see which pages were kept, but the text simply comes back without them. That is the worst shape a fault can take, and it is why the row above is red on our own product.

What is measured

Processing time, one whole manual
from the foreign PDF to the delivered one · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 12 Sep 2026
47 min
MEASURED
Size of the measured job
60 pages, 35 diagrams, translated end to end. Timed on a paid job, not on a demo
60 pages
MEASURED

Standard benchmark — the documente-v1 set, seven files

Each row is filled in when we push the file through the tool, on our own machine, and write the date. Nothing is marked „passed" from memory or from habit.

1 · Plain document
5 of 5 pages kept, 100.7% of the text · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
100.7%
MEASURED
2 · Tables across pages
0 of 3 pages kept — the table pages were dropped · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
0%
MEASURED — FAILED
3 · Text drawn inside figures
no text layer at all; 2 pages captured as plates instead · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
2 plates
MEASURED
4 · Accents and special characters
all 10 Romanian characters kept, and 0 of the cedilla traps survived · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
10/10
MEASURED
5 · Large document
60 of 60 pages, all 12 sections including the warranty, 0.15 seconds · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
60/60
MEASURED
6 · Hollowed out
saw 5 pages, reported it had nothing to take, returned nothing · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
noticed
MEASURED
7 · No header
0 pages recoverable, reported it had nothing to take · 12 vCPU, 48 GB RAM, no graphics card, Ubuntu 24.04 · 2026-09-13
refused
MEASURED

The row that decides whether the sheet gets published

Did the case that was supposed to fail actually fail?
Yes. Both of them returned nothing and said so. The benchmark can say no, so the other five rows mean something. · 2026-09-13
yes
MEASURED

What we are doing about it

See the procedure and download the set Back to the product