Commit Graph
596 Commits
Author SHA1 Message Date
339bbd4249 perf: cache grid property in HTMLTableSerializer (#373)
* refactor: avoid nested grid access in HTMLTableSerializer

Refactor row/col iteration to bypass Pydantic __getitem__ calls,
reducing overhead from nested loops and improving table serialization speed.

Signed-off-by: doyikim <doyikim34@naver.com>

* fix autoflake findings

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: doyikim <doyikim34@naver.com>
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
Co-authored-by: dykim <dykim34@crowdworks.kr>
Co-authored-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-28 17:35:25 +02:00
Panos Vagenas b2095b31de fix: use in-OTSL DocTags for rich table cells (#375)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-28 09:46:46 +02:00
Panos Vagenas 1d04154378 feat: add rich table cells (#368)
* feat: add rich table cells

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* propagate cell text resolution, cover row deletions

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* add doctags, fix referential integrity, expand tests, reenable mypy

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* bump DoclingDocument version

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* simplify / remove serialize_cell

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* update rich table cell refs in doc indexing

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* update notebook

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* expose new classes in `docling_core.types.doc`

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-27 10:07:47 +02:00
github-actions[bot] e9d4bd944c chore: bump version to 2.45.0 [skip ci] v2.45.0 2025-08-20 12:36:18 +00:00
Christoph Auer 8405d1d26f refactor: Expose OTSL methods as utilities (#370)
Refactoring OTSL methods

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
2025-08-19 17:15:17 +02:00
Panos Vagenas bbe6243833 chore: add DoclingDocument validation rules (#349)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-19 14:14:13 +02:00
Panos Vagenas 99eabb3b01 feat: add document concatenation (#365)
* chore: add document concatenation

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* finalize exposed API, add tests

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-19 12:30:33 +02:00
Cesar Berrospi Ramisand15mbp 23badf2a1d fix: add forward slashes to singleton tags (#369)
* Add forward slash to singleton tags

See issue #354 on docling-project/docling-core

Signed-off-by: 15mbp <100952997+15mbp@users.noreply.github.com>

* test(HTML): fix ground truth data files

Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>

---------

Signed-off-by: 15mbp <100952997+15mbp@users.noreply.github.com>
Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>
Co-authored-by: 15mbp <100952997+15mbp@users.noreply.github.com>
2025-08-19 10:05:34 +02:00
github-actions[bot] 889088f5e1 chore: bump version to 2.44.2 [skip ci] v2.44.2 2025-08-14 09:43:15 +00:00
Panos Vagenas 807d972f05 fix(HTML): fix nested list serialization edge cases (#367)
* fix(HTML): (initial state without fix) fix nested list serialization edge cases

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* actual fix

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-08-13 15:06:54 +02:00
github-actions[bot] 8433d285f6 chore: bump version to 2.44.1 [skip ci] v2.44.1 2025-07-30 11:05:24 +00:00
Michele DolfiandCesar Berrospi Ramis 5afa99e028 fix: referenced artifacts relative to the document location (#361)
* fix relative references

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* Apply suggestions from code review

Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>
Signed-off-by: Michele Dolfi <97102151+dolfim-ibm@users.noreply.github.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
Signed-off-by: Michele Dolfi <97102151+dolfim-ibm@users.noreply.github.com>
Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>
2025-07-30 13:00:03 +02:00
github-actions[bot] 6be0c8b183 chore: bump version to 2.44.0 [skip ci] v2.44.0 2025-07-28 08:31:05 +00:00
Christoph AuerandCopilot 0f7ca77ccf feat: Key-value visualizer (#360)
* Add key-value visualizer, and chooser arg on DoclingDocument.get_visualization

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Update docling_core/transforms/visualizer/key_value_visualizer.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

* Update docling_core/transforms/visualizer/key_value_visualizer.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

* Address review comments

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-07-25 10:56:39 +02:00
github-actions[bot] 93dd0a9623 chore: bump version to 2.43.1 [skip ci] v2.43.1 2025-07-23 14:18:01 +00:00
Christoph Auer f9b3b499de fix: LayoutVisualizer should traverse pictures (#358)
LayoutVisualizer should traverse pictures

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
2025-07-23 09:56:00 +02:00
Cesar Berrospi Ramis 5a7883cee5 fix: HTML serialization of nested lists (#359)
* fix(serializer): the HTML serializer should append nested lists to list items

For a valid HTML document, the serializer should ensure that sub-list items are indented
under their respective main list items.

Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>

* test: address several warning messages

Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>

---------

Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com>
2025-07-23 09:31:02 +02:00
github-actions[bot] 0c89bd0999 chore: bump version to 2.43.0 [skip ci] v2.43.0 2025-07-16 07:27:59 +00:00
Panos Vagenas 3a0b7471ba feat: add page chunking (#337)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-07-15 11:03:11 +02:00
Clément Doumouro ebd9147ced fix: only save applicable page images (#226)
fix(document): save document images page by page

Signed-off-by: Clément Doumouro <clement.doumouro@gmail.com>
2025-07-15 09:52:09 +02:00
github-actions[bot] 7b2569845a chore: bump version to 2.42.0 [skip ci] v2.42.0 2025-07-09 12:27:06 +00:00
Panos Vagenas c339171517 feat: extend and expose float serialization control (#353)
* feat: add confidence precision control to page text cells

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* make controls public

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-07-09 14:20:43 +02:00
Ryan Fernandes cb59fd39bc feat: Additional DoclingDocument methods for use in MCP document manipulation (#344)
* insert_* methods and range manipulation methods

* DCO Remediation Commit for Ryan Fernandes <ryan@fernandes.us>

I, Ryan Fernandes <ryan@fernandes.us>, hereby add my Signed-off-by to this commit: cc0c4b283f

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* insert_node_items method with recursive _append_item_copies helper for cross-document manipulation

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* add_node_items complement to inser_node_items, refactored extract_items_range to be more robust, added insert/add_document

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* Extended table data editing functionality

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* Added new document manipulation tests

* Extra gt files

* Refactor for reusable code - table methods

* Private methods for more concise insert_* methods

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* Docstring changes

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* ValueError for failed insertions

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

* DCO Remediation Commit for Ryan Fernandes <ryan@fernandes.us>

I, Ryan Fernandes <ryan@fernandes.us>, hereby add my Signed-off-by to this commit: 01e8b9cb03
I, Ryan Fernandes <ryan@fernandes.us>, hereby add my Signed-off-by to this commit: 8c016d9d32
I, Ryan Fernandes <ryan@fernandes.us>, hereby add my Signed-off-by to this commit: 308900270a

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>

---------

Signed-off-by: Ryan Fernandes <ryan@fernandes.us>
2025-07-09 10:53:04 +02:00
github-actions[bot] 5d276bd64e chore: bump version to 2.41.0 [skip ci] v2.41.0 2025-07-09 07:43:20 +00:00
Panos Vagenas baa2cc3714 feat: enable precision control in float serialization (#352)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-07-08 17:00:29 +02:00
github-actions[bot] bf88e9d55d chore: bump version to 2.40.0 [skip ci] v2.40.0 2025-07-02 16:22:52 +00:00
Clément Doumouro 9fa0c9f8be fix: BoundingRectangle angle computation when in CoordOrigin.TOPLEFT (#347)
* fix(page): angle computation when in `CoordOrigin.TOPLEFT`

* DCO Remediation Commit for Clément Doumouro <clement.doumouro@gmail.com>

I, Clément Doumouro <clement.doumouro@gmail.com>, hereby add my Signed-off-by to this commit: 742ccf3d9c

Signed-off-by: Clément Doumouro <clement.doumouro@gmail.com>

---------

Signed-off-by: Clément Doumouro <clement.doumouro@gmail.com>
2025-07-02 17:53:03 +02:00
eb2538eb3a feat: added different content-layers (#345)
* feat: added different content-layers

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* reformatted code

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* renamed concealed to invisible

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* fixed docs

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* Update docling_core/types/doc/document.py

Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

* Update docs/DoclingDocument.json

Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>
Co-authored-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>
Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
2025-07-02 17:28:53 +02:00
github-actions[bot] cacf4ef67b chore: bump version to 2.39.0 [skip ci] v2.39.0 2025-06-27 12:59:25 +00:00
Panos Vagenas 14a4fdee87 feat: remodel lists, add MD & HTML ser. params, enable unset marker (#339)
* feat: remodel lists

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* prepare test document separate markers

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* add MD/HTML serializer options, expand test data

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* create list groups where not in place

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* add auto-increment logic

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* restore UnorderedList as deprecated alias (for backwards compatibility)

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* enable unset marker case

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* make ordered markers able to be "unset" (empty) too

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* rename default marker mode to auto

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-06-27 14:52:25 +02:00
Michele Dolfiandvtempest 3eeb2596c6 feat: Download Google docs and drive files via export url (#335)
* # Google Docs, Files, PDF URLs, Spreadsheets, Presentations: convert to export URL

Signed-off-by: vtempest <1274452+vtempest@users.noreply.github.com>

* standard way of exporting ?format=

Signed-off-by: vtempest <1274452+vtempest@users.noreply.github.com>

---------

Signed-off-by: vtempest <1274452+vtempest@users.noreply.github.com>
Co-authored-by: vtempest <1274452+vtempest@users.noreply.github.com>
2025-06-27 14:48:17 +02:00
github-actions[bot] 062124ea6f chore: bump version to 2.38.2 [skip ci] v2.38.2 2025-06-25 08:37:22 +00:00
Michele Dolfi c2fd20fad7 fix: add missing mimetypes for asr inputs (#341)
Signed-off-by: Michele Dolfi <97102151+dolfim-ibm@users.noreply.github.com>
2025-06-25 09:57:15 +02:00
Peter W. J. Staar 425b191a90 fix: Add text direction to export_to_textlines (#338)
added option to export_to_textlines

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
2025-06-23 13:09:41 +02:00
github-actions[bot] 77a3f51277 chore: bump version to 2.38.1 [skip ci] v2.38.1 2025-06-20 12:28:18 +00:00
Panos Vagenas c9374e8fe4 fix(markdown): add heading formatting, fix code & formula formatting (#336)
* feat(markdown): add formatted headings (show behavior before change)

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* add change and updated test data

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* fix when formatting & escaping are applied (depending on type)

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-06-20 14:10:48 +02:00
github-actions[bot] b3fb504646 chore: bump version to 2.38.0 [skip ci] v2.38.0 2025-06-18 12:34:52 +00:00
Panos Vagenas 78b796221d feat(viz): add reading order branch numbering, fix cross-page lists (#334)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-06-18 14:18:48 +02:00
Peter W. J. Staar 2e14a74936 fix: expose base types consistently (#332)
chore: updated the __init__

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
2025-06-17 12:32:25 +02:00
Panos Vagenas 574779f4c7 chore: add ref number normalization (#322)
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-06-17 12:31:39 +02:00
Panos Vagenas 5c99722b38 fix(HybridChunker): improve long heading handling (#333)
* fix(HybridChunker): improve long heading handling

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* fix warning wording

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
2025-06-17 12:21:51 +02:00
Michele Dolfi 73113f6a43 ci: add dco-advisor (#331)
* add dco-advisor

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix yaml syntax

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* avoid js template syntax

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* search comment more robust

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* this commit is not signed-off on purpose

* update the logic for sha filtering

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* this commit is without sign-off

* add debug output

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* skip itself as it contains dco in name

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* restore pull_request on

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use pr checks

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix trigger

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* new status check

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* chore: DCO remediation for failing commits

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* DCO Remediation Commit for Michele Dolfi <dol@zurich.ibm.com>

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* more logs

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add output text to logs

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use logic scanning commits

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* print html_url

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix map function

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add username

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix body arg

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add link to dco details

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* DCO Remediation Commit for Michele Dolfi <dol@zurich.ibm.com>

I, Michele Dolfi <dol@zurich.ibm.com>, hereby add my Signed-off-by to this commit: 5c1ef004ff
I, Michele Dolfi <dol@zurich.ibm.com>, hereby add my Signed-off-by to this commit: 761f62fc3f

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use correct event

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
2025-06-17 08:37:41 +02:00
Riccardo Maggioni 0fd3c1cbe6 feat: add parameter to choose of which pages export the doctags (#290)
* feat: add parameter to choose of which pages export the doctags

Signed-off-by: rickymaggio02 <riccardo.maggioni@googlemail.com>

* feat: added test and better description of the method

Signed-off-by: rickymaggio02 <riccardo.maggioni@googlemail.com>

---------

Signed-off-by: rickymaggio02 <riccardo.maggioni@googlemail.com>
2025-06-16 15:30:09 +02:00
Michele Dolfi d13e103237 chore: add dco settings (#329)
add dco settings

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
2025-06-16 11:32:11 +02:00
github-actions[bot] 20d74065e1 chore: bump version to 2.37.0 [skip ci] v2.37.0 2025-06-13 10:56:18 +00:00
Peter W. J. Staar 3b998795b8 feat: add improved table serializer and visualizer (#328)
* feat: add improved table serializer and visualizer

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* visualizer for rows and columns

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
2025-06-13 11:50:27 +02:00
github-actions[bot] 375fdfbaef chore: bump version to 2.36.0 [skip ci] v2.36.0 2025-06-11 17:28:45 +00:00
Christoph AuerandPanos Vagenas aa430d3776 feat: New labels for CVAT annotation (#314)
* New labels and utility for CVAT annotation

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Add EMPTY_VALUE to TextItem

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* Small fixes

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>

* align usage of content layer param (#326)

* align usage of content layer param

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

* parametrize content layers in visualizers

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

---------

Signed-off-by: Christoph Auer <cau@zurich.ibm.com>
Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>
Signed-off-by: Christoph Auer <60343111+cau-git@users.noreply.github.com>
Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>
2025-06-11 19:25:13 +02:00
github-actions[bot] 0070e2eb63 chore: bump version to 2.35.0 [skip ci] v2.35.0 2025-06-11 16:35:15 +00:00
Peter W. J. Staar 45667c751b feat: Visualizer for table cells (#325)
* feat: visualizing the tables

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* Added test for table visualizer

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* cleaned up code

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

* updated with content-layer

Signed-off-by: Peter Staar <taa@zurich.ibm.com>

---------

Signed-off-by: Peter Staar <taa@zurich.ibm.com>
2025-06-11 16:53:09 +02:00