Commit Graph
2 Commits
Author SHA1 Message Date
8a6d2fce9d feat: Add ReadingOrderEvaluator for new reading-order model (#29)
* correct mpy

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* reformatting

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* adding the script to make an initial dataset from pdf's

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* before switching to specific docling-core branch

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* rebased on kv-items and updated the create script in CVAT

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* fixed the cvat

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added the annotation description on CVAT

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added the annotation description on CVAT (2)

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* added the annotation description on CVAT (3)

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* feat: Add new reading-order model evaluator, re-factor to BaseReadingOrderEvaluator

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Rename New

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* fix: Fix calling DoclingDocument methods. Pin latest versions of docling and docling-core.
Remove commented out code, remove unused imports, code formatting.

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* docs: Re-run the evaluations for DPBench and update the docs

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* docs: Re-run the evaluations for OmniDocBench and update the docs

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* docs: Re-run the evaluations for DPBench and update the docs

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* docs: Re-run the evaluations for OmniDocBench and update the docs

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

* docs: Minor improvements in DPBench OmniDocBench documentation

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
Co-authored-by: Peter Staar <taa@zurich.ibm.com>
Co-authored-by: Nikos Livathinos <nli@zurich.ibm.com>
2025-02-21 17:18:33 +01:00
Nikos Livathinos d04d016843 feat: Refactor the reading order evaluation to skip document items that have multiple provenances (#10)
- fix: Refactor/improve the code to save log files with evaluation tables and png files with the plots
and ensure to produce all the evaluations/visualizations in the docs/examples/benchmark_xxx.py files
- Introduce optional parameter in create methods for DP-Bench and OmniDocBench to generate
visualizations.
- Update the evaluation files (json/txt/png) in docs/evaluations per dataset. Update Readme.
- Update Readme with the OmniDocBench evaluation/visualization files
- Poetry: Move to docling 2.15.1

---------

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
2025-01-21 14:58:17 +01:00