mirror of
https://github.com/docling-project/docling-eval.git
synced 2026-05-17 13:10:47 +00:00
Nikos Livathinos
3e134ae1b0
* feat: Pinpoint docling to cau/layout-model-spec. Introduce the docling_layout_model_spec, docling_layout_create_orphan_clusters CLI arguments Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Update docling to the latest status of cau/layout-model-spec Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Update docling to the latest status of cau/layout-model-spec Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * feat: Refactor the CLI arguments of 'evaluate' to accept optional input and ouput dirs Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * feat: Refactor the MultiEvaluator:load_multi_evaluation() to search for sub-experiments and if present concatenate the experiment with the sub-experiment as a key in the returned Dict. Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Clean up code in MultiEvaluator Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Pin docling from its main branch. Add code comments. Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * fix: In the Consolidator, add the single value mAP score for the layout evaluations Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * feat: Extend the CLI to introduce the --docling-layout-keep-empty-clusters parameter and propagate it to docling LayoutOptions Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Remove pinpoint to docling branch as the docling PR has been merged Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * fix: Have the Consolidator sorting the produced excel by Benchmark and Experiment Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * fix: Set the --docling-layout-keep-empty-clusters CLI parameter by default to False Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * feat: Extend the CLI to accept optional input_dir and output_dir in the visualize command Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * chore: Remove docling pinning. Use the latest docling release. Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> * fix: Fix in CLI for create-eval `--docling-layout-keep-empty-clusters` Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com> --------- Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>