12 Commits

Include renames

Author	SHA1	Message	Date
Panos VagenasandGitHub	d8a5256b2c	feat: add table annotations (#304) ... * feat: add table annotations Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * refactor annotation types Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * expand to HTML Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * introduce annotation serializer Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * Update dummy_doc.yaml Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> --------- Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2025-06-05 15:38:46 +02:00
Panos VagenasandGitHub	98c60bb65b	perf: fix serialization performance (#249) ... * perf: fix serialization performance Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * add missing leading HTML tag Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> --------- Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>	2025-04-11 15:37:52 +02:00
3 people	5d406008f2	feat: add HTML serializer (#232) ... * iunitial attempt at HTML serializer Signed-off-by: Peter Staar <taa@zurich.ibm.com> * first version, to be tested thoroughly Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added the new test Signed-off-by: Peter Staar <taa@zurich.ibm.com> * rewrote carefully the export-to-html into new framework Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the inline list-items Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added the inline code Signed-off-by: Peter Staar <taa@zurich.ibm.com> * migrated the table html code Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the picture HTML serializer Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the html for Form and KeyValue Signed-off-by: Peter Staar <taa@zurich.ibm.com> * first version of KeyValue serialisation Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the key-value and form-region and added the GraphData serializer Signed-off-by: Peter Staar <taa@zurich.ibm.com> * need to do some mypy work now Signed-off-by: Peter Staar <taa@zurich.ibm.com> * passed the mypy Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added the get_excluded_refs function to obtain proper serialization Signed-off-by: Peter Staar <taa@zurich.ibm.com> * enabled the captions Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed empty lists Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added initial split view and customised styles Signed-off-by: Peter Staar <taa@zurich.ibm.com> * cleaned up, now waiting for page-indices propagationg Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the styles and parameters with split_page Signed-off-by: Peter Staar <taa@zurich.ibm.com> * propagated the parameter split_page_view Signed-off-by: Peter Staar <taa@zurich.ibm.com> * first fully working version Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed the prints Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the tests Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the tests Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the tests for html export Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed dead code Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the test output Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the tests Signed-off-by: Peter Staar <taa@zurich.ibm.com> * reformatted the code Signed-off-by: Peter Staar <taa@zurich.ibm.com> * rename parameter tag to class_name Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added serializers to table and picture Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed dead code Signed-off-by: Peter Staar <taa@zurich.ibm.com> * various HTML serialization improvements (#242) Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> * added enum for different output styles Signed-off-by: Peter Staar <taa@zurich.ibm.com> --------- Signed-off-by: Peter Staar <taa@zurich.ibm.com> Signed-off-by: Panos Vagenas <pva@zurich.ibm.com> Co-authored-by: Panos Vagenas <pva@zurich.ibm.com>	2025-04-10 10:59:07 +02:00
Panos VagenasandGitHub	a7cdc87411	feat: add serializers, text formatting, update Markdown export (#182) ... Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>	2025-03-13 17:54:32 +01:00
4 people	d622800750	feat: Introduce Key-Value and Forms items (#158) ... * Draft KeyValueItem content Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * added add_key_value_item method Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add KeyValueLink Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * update an add_key_value_item argument Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * remove KeyOrValueCellType and KeyValueLinkType Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * update tests for KeyValueItem Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add union method to create bbox that covers all the given bboxes Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * added the , and rewrote it to make it more general with a GraphItem, as well as having cell- and link-labels Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the code due to MyPy and reformatted Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the reference docs with form-key Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed the circle Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the figure, testing now ... Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added square in image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed square in image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * tests should go through Signed-off-by: Peter Staar <taa@zurich.ibm.com> * update poetry.lock versions Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * fix import issue Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add validator for links in GraphData Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added field_validator Signed-off-by: Peter Staar <taa@zurich.ibm.com> * rename add_key_values and add_form Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * rename union to enclosingbbox Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> Signed-off-by: Peter Staar <taa@zurich.ibm.com> Co-authored-by: Christoph Auer <cau@zurich.ibm.com> Co-authored-by: Peter Staar <taa@zurich.ibm.com>	2025-02-19 09:50:45 +01:00
3 people	916323fb55	feat: Redefine CodeItem as floating object with captions (#160) ... * updated the CodeItem with captions Signed-off-by: Peter Staar <taa@zurich.ibm.com> * use FloatItem and add captions to add_code interface Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> --------- Signed-off-by: Peter Staar <taa@zurich.ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>	2025-02-14 11:34:40 +01:00
3 people	786f0c6833	feat: Add ContentLayer attribute to designate items to body or furniture (#148) ... * feat: Add ContentLayer attribute to designate items to body or furniture Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * introduce safer data gen mechanism, update chunking test data Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * Do not make test rely on order in yaml Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * chore: format fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * fix: legacy_to_docling_doc must use content_layer Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add content_layer in iterate_items Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Bump format version, add model_validator for old page_header,page_footer in body Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * fix: Change to before model_validator Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Update tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Address review comments Signed-off-by: Christoph Auer <cau@zurich.ibm.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2025-02-10 10:58:41 +01:00
Michele DolfiandGitHub	ed36437346	feat(HTML): Export formulas with mathml (#144) ... * remove un-needed logic the labels allowlist is checked before Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * textitem cannot have label code Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * display formulas with mathml in exported html Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * expose argument in save_as_html Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * rename sanitize in prepare and add \n Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * fix mypy parsing Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * remove unused/impossible elif Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * remove strip() Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add display none for latex annotation Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * make mathml the default Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * revert wrong commit Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> --------- Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>	2025-01-31 15:43:43 +01:00
5 people	c940aa5ca9	feat: Add CodeItem as pydantic type, update export methods and APIs (#129) ... * added code item * added code item * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * add constraints to allow numpy > 2.1.0 on python3.13 and others Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Add CodeItem to ContentItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * added CodeItem in ContentItem tagged union. * added enum for programming languages * removed double CodeItem in ContentItem Union * fixed type of code_language in CodeItem class * fixed sorting of programming languages, not sorted anymore by value of string but variable name --------- Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Co-authored-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Christoph Auer <cau@zurich.ibm.com>	2025-01-17 16:59:33 +01:00
Panos VagenasandGitHub	047a1960af	fix: improve doc item typing (#105) ... Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-12-13 12:51:53 +01:00
5 people	03df97fa73	feat!: Expose DoclingDocument as main type, move old typing to legacy (#41) ... * Fix area method of BoundingBox Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add image placeholder Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * enable picture label Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * refactor captions and markdown Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add logic to skip repeated caption Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * use DocItemLabel Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Extend default export labels, add convenience mehtods Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce ListItem API, with marker and enumerated properties Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add classification and description in PictureData Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add molecule picture data Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Fixes for DoclingDocument and aligned methods on legacy doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add advanced picture data content Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Many markdown export fixes, renaming BaseTableData Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Rename module paths doc->legacy_doc, experimental->doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * feat: imageref with pil_image Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Small fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * docs: remove documentation in markdown to support python 3.13 (#43) Since json-schema-for-humans dependency does not support python 3.13, remove the generation of documentation in markdown of main docling types. Remove 'ds' prefix from documentation scripts. Update README. Add python 3.13 in CI/CD workflow checks. Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * Fix TableCell model validator Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * store list of classes in classification Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Fixes for DocumentOrigin mimetype validation Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * introduce picturedata as list of annotations Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * feat: adapt hierarchical chunker to v2 DoclingDocument [skip-ci] Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * feat: add table support in chunker, incl. captions Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * use Field constraints instead of conlist, refactor chunking types Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * revert unnecessary doc module change Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * align test data with upstream changes Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * Update __init__.py on docling_core.types.doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Remove DescriptionItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-10-16 15:53:44 +02:00
5 people	688789ea75	feat: (experimental) introduce new document format (#21) ... * Draft new docling document format, pydantic model and tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix tests to have unique document_hashes per test Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Manual update from main Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Move new-format to experimental path Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Updates for document construction API and format Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add comments Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add BaseTableData and table cell typing Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Tree element iterator, several API fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Turn captions into list field Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add export methods to DoclingDocument and types Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Change DoclingDocument.iterate_elements and add print tree function Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce label enum types, apply everywhere Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce provenance info, use enum labels Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Update formatting Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Docstrings and linter fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Lockfile rollback, since updating breaks tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Several improvements and cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Format fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Big redesign for usage of hashes, several other fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix flake8 config Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Remove hash, renamings Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * updating the tests Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added some unit tests for DocItem Signed-off-by: Peter Staar <taa@zurich.ibm.com> * Add tree validation API and test case Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add extra=Forbid to NodeItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * feat: set DoclingDocument version as SemanticVersion with default Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * Cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Simpler literal enforcement Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix static document version Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Rollback changes to allow for semver<3 Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * build: rollback changes to include python-semantic-release as dev dependency Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * feat: set version field as string with pattern and check compatibility Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * add JSON Pointer validation to refs, fix test data Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Peter Staar <taa@zurich.ibm.com> Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Peter Staar <taa@zurich.ibm.com> Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-10-01 09:41:16 +02:00