feat: Make Page.parsed_page the only source of truth for text cells, add OCR cells to it (#1745)

Browse Source

* Keep page.parsed_page.textline_cells and page.cells in sync, including OCR

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Make page.parsed_page the only source of truth for text cells

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Small fix

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Correctly compute PDF boxes from pymupdf

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Use different OCR engine order

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Add type hints and fix mypy

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* One more test fix

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Remove with pypdfium2_lock from caller sites

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Fix typing

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

...

This commit is contained in:

Christoph Auer

2025-06-13 19:01:55 +02:00

committed by GitHub

parent 0432a31b2f

commit 7d3302cb48

50 changed files with 339091 additions and 330047 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

101474

tests/data/groundtruth/docling_v2/2203.01017v2.pages.json vendored

File diff suppressed because it is too large Load Diff

89985

tests/data/groundtruth/docling_v2/2206.01062.pages.json vendored

File diff suppressed because it is too large Load Diff

5315

tests/data/groundtruth/docling_v2/2305.03393v1-pg9.pages.json vendored

File diff suppressed because it is too large Load Diff

56232

tests/data/groundtruth/docling_v2/2305.03393v1.pages.json vendored

File diff suppressed because it is too large Load Diff

4965

tests/data/groundtruth/docling_v2/amt_handbook_sample.pages.json vendored

File diff suppressed because it is too large Load Diff

4518

tests/data/groundtruth/docling_v2/code_and_formula.pages.json vendored

File diff suppressed because it is too large Load Diff

9633

tests/data/groundtruth/docling_v2/multi_page.pages.json vendored

File diff suppressed because it is too large Load Diff

2570

tests/data/groundtruth/docling_v2/picture_classification.pages.json vendored

File diff suppressed because it is too large Load Diff

46512

tests/data/groundtruth/docling_v2/redp5110_sampled.pages.json vendored

File diff suppressed because it is too large Load Diff

1309

tests/data/groundtruth/docling_v2/right_to_left_01.pages.json vendored

File diff suppressed because it is too large Load Diff

8015

tests/data/groundtruth/docling_v2/right_to_left_02.pages.json vendored

File diff suppressed because it is too large Load Diff

2809

tests/data/groundtruth/docling_v2/right_to_left_03.pages.json vendored

File diff suppressed because it is too large Load Diff