9 Commits

Include renames

Author	SHA1	Message	Date
Panos VagenasandGitHub	a7cdc87411	feat: add serializers, text formatting, update Markdown export (#182) ... Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>	2025-03-13 17:54:32 +01:00
4 people	d622800750	feat: Introduce Key-Value and Forms items (#158) ... * Draft KeyValueItem content Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * added add_key_value_item method Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add KeyValueLink Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * update an add_key_value_item argument Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * remove KeyOrValueCellType and KeyValueLinkType Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * update tests for KeyValueItem Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add union method to create bbox that covers all the given bboxes Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * added the , and rewrote it to make it more general with a GraphItem, as well as having cell- and link-labels Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the code due to MyPy and reformatted Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated the reference docs with form-key Signed-off-by: Peter Staar <taa@zurich.ibm.com> * updated image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed the circle Signed-off-by: Peter Staar <taa@zurich.ibm.com> * fixed the figure, testing now ... Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added square in image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * removed square in image Signed-off-by: Peter Staar <taa@zurich.ibm.com> * tests should go through Signed-off-by: Peter Staar <taa@zurich.ibm.com> * update poetry.lock versions Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * fix import issue Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * add validator for links in GraphData Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added field_validator Signed-off-by: Peter Staar <taa@zurich.ibm.com> * rename add_key_values and add_form Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> * rename union to enclosingbbox Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Saidgurbuz <said.gurbuz@epfl.ch> Signed-off-by: Peter Staar <taa@zurich.ibm.com> Co-authored-by: Christoph Auer <cau@zurich.ibm.com> Co-authored-by: Peter Staar <taa@zurich.ibm.com>	2025-02-19 09:50:45 +01:00
3 people	916323fb55	feat: Redefine CodeItem as floating object with captions (#160) ... * updated the CodeItem with captions Signed-off-by: Peter Staar <taa@zurich.ibm.com> * use FloatItem and add captions to add_code interface Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> --------- Signed-off-by: Peter Staar <taa@zurich.ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com>	2025-02-14 11:34:40 +01:00
3 people	786f0c6833	feat: Add ContentLayer attribute to designate items to body or furniture (#148) ... * feat: Add ContentLayer attribute to designate items to body or furniture Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * introduce safer data gen mechanism, update chunking test data Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * Do not make test rely on order in yaml Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * chore: format fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * fix: legacy_to_docling_doc must use content_layer Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add content_layer in iterate_items Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Bump format version, add model_validator for old page_header,page_footer in body Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * fix: Change to before model_validator Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Update tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Address review comments Signed-off-by: Christoph Auer <cau@zurich.ibm.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2025-02-10 10:58:41 +01:00
Michele DolfiandGitHub	ed36437346	feat(HTML): Export formulas with mathml (#144) ... * remove un-needed logic the labels allowlist is checked before Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * textitem cannot have label code Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * display formulas with mathml in exported html Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * expose argument in save_as_html Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * rename sanitize in prepare and add \n Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * fix mypy parsing Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * remove unused/impossible elif Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * remove strip() Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add display none for latex annotation Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * make mathml the default Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * revert wrong commit Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> --------- Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>	2025-01-31 15:43:43 +01:00
5 people	c940aa5ca9	feat: Add CodeItem as pydantic type, update export methods and APIs (#129) ... * added code item * added code item * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * added code item Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> * add constraints to allow numpy > 2.1.0 on python3.13 and others Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Add CodeItem to ContentItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * added CodeItem in ContentItem tagged union. * added enum for programming languages * removed double CodeItem in ContentItem Union * fixed type of code_language in CodeItem class * fixed sorting of programming languages, not sorted anymore by value of string but variable name --------- Signed-off-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Co-authored-by: Matteo-Omenetti <Matteo.Omenetti1@ibm.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Christoph Auer <cau@zurich.ibm.com>	2025-01-17 16:59:33 +01:00
Panos VagenasandGitHub	047a1960af	fix: improve doc item typing (#105) ... Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-12-13 12:51:53 +01:00
5 people	03df97fa73	feat!: Expose DoclingDocument as main type, move old typing to legacy (#41) ... * Fix area method of BoundingBox Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add image placeholder Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * enable picture label Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * refactor captions and markdown Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add logic to skip repeated caption Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * use DocItemLabel Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Extend default export labels, add convenience mehtods Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce ListItem API, with marker and enumerated properties Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add classification and description in PictureData Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * add molecule picture data Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Fixes for DoclingDocument and aligned methods on legacy doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * add advanced picture data content Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Many markdown export fixes, renaming BaseTableData Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Rename module paths doc->legacy_doc, experimental->doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * feat: imageref with pil_image Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Small fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * docs: remove documentation in markdown to support python 3.13 (#43) Since json-schema-for-humans dependency does not support python 3.13, remove the generation of documentation in markdown of main docling types. Remove 'ds' prefix from documentation scripts. Update README. Add python 3.13 in CI/CD workflow checks. Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * Fix TableCell model validator Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * store list of classes in classification Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * Fixes for DocumentOrigin mimetype validation Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * introduce picturedata as list of annotations Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> * feat: adapt hierarchical chunker to v2 DoclingDocument [skip-ci] Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * feat: add table support in chunker, incl. captions Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * use Field constraints instead of conlist, refactor chunking types Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * revert unnecessary doc module change Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * align test data with upstream changes Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> * Update __init__.py on docling_core.types.doc Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Remove DescriptionItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Michele Dolfi <dol@zurich.ibm.com> Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Michele Dolfi <dol@zurich.ibm.com> Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-10-16 15:53:44 +02:00
5 people	688789ea75	feat: (experimental) introduce new document format (#21) ... * Draft new docling document format, pydantic model and tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix tests to have unique document_hashes per test Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Manual update from main Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Move new-format to experimental path Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Updates for document construction API and format Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add comments Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add BaseTableData and table cell typing Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Tree element iterator, several API fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Turn captions into list field Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add export methods to DoclingDocument and types Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Change DoclingDocument.iterate_elements and add print tree function Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce label enum types, apply everywhere Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Introduce provenance info, use enum labels Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Update formatting Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Docstrings and linter fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Lockfile rollback, since updating breaks tests Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Several improvements and cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Format fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Big redesign for usage of hashes, several other fixes Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix flake8 config Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Remove hash, renamings Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * updating the tests Signed-off-by: Peter Staar <taa@zurich.ibm.com> * added some unit tests for DocItem Signed-off-by: Peter Staar <taa@zurich.ibm.com> * Add tree validation API and test case Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Add extra=Forbid to NodeItem Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * feat: set DoclingDocument version as SemanticVersion with default Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * Cleanup Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Simpler literal enforcement Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Fix static document version Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * Rollback changes to allow for semver<3 Signed-off-by: Christoph Auer <cau@zurich.ibm.com> * build: rollback changes to include python-semantic-release as dev dependency Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * feat: set version field as string with pattern and check compatibility Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> * add JSON Pointer validation to refs, fix test data Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> --------- Signed-off-by: Christoph Auer <cau@zurich.ibm.com> Signed-off-by: Peter Staar <taa@zurich.ibm.com> Signed-off-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Signed-off-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com> Co-authored-by: Peter Staar <taa@zurich.ibm.com> Co-authored-by: Cesar Berrospi Ramis <75900930+ceberam@users.noreply.github.com> Co-authored-by: Panos Vagenas <35837085+vagenas@users.noreply.github.com>	2024-10-01 09:41:16 +02:00