Michele Dolfi b418ec61b1 feat!: Use remote Docling within tool - with local fallback as optional (#97)
* make MCP use remote docling via service client

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* add missing file and tests

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix mcpb manifest

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* format test files

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use stdio for the tests

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* apply linter and formatter

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* fix launch of tests

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* make api key secret

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

* use sensitive

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>

---------

Signed-off-by: Michele Dolfi <dol@zurich.ibm.com>
2026-05-15 15:14:39 +02:00
2025-09-23 10:55:19 +02:00
2025-03-14 09:58:54 +01:00

Docling

Docling MCP: making docling agentic

PyPI version PyPI - Python Version uv Ruff Pydantic v2 pre-commit License MIT PyPI Downloads LF AI & Data

A document processing service using the Docling-MCP library and MCP (Model Context Protocol) for tool integration.

Overview

Docling MCP is a service that provides tools for document conversion, processing and generation. It uses the Docling library to convert PDF documents into structured formats and provides a caching mechanism to improve performance. The service exposes functionality through a set of tools that can be called by client applications.

🆕 What's New in v2.0

Major Architecture Update: Docling MCP v2.0 introduces a hybrid architecture with support for both remote API and local conversion modes:

  • 🚀 90% Size Reduction: Base package is now ~50MB (down from ~500MB)
  • Faster Installation: No model downloads required for default remote mode
  • 🌐 Remote API Support: Use Docling Serve for scalable cloud-based conversion
  • 💻 Local Mode Available: Install [local] extra for offline/local conversion
  • 🔄 Automatic Fallback: Optional fallback from remote to local mode
  • 🎯 Flexible Configuration: Choose the mode that fits your needs

Migration: Upgrading from v1.x? See MIGRATION_v2.md for detailed instructions.

Installation Options

For users with access to Docling Serve API:

Getting Docling Serve: Visit docling-serve for installation guides. You can deploy it from published container images or look for managed Docling SaaS offerings.

pip install docling-mcp

Then configure your environment:

export DOCLING_SERVICE_URL=https://your-docling-service.example.com
export DOCLING_SERVICE_API_KEY=your-api-key-here
export DOCLING_CONVERSION_MODE=remote

Local Mode (Full Features)

For users who need local conversion or don't have Docling Serve access:

pip install docling-mcp[local]

Then configure your environment:

export DOCLING_CONVERSION_MODE=local

Hybrid Mode (Best of Both)

Install with local support and enable automatic fallback:

pip install docling-mcp[local]

Configure for remote with fallback:

export DOCLING_SERVICE_URL=https://your-docling-service.example.com
export DOCLING_CONVERSION_MODE=remote
export DOCLING_FALLBACK_TO_LOCAL=true

Features

  • Conversion tools:
    • PDF document conversion to structured JSON format (DoclingDocument)
  • Generation tools:
    • Document generation in DoclingDocument, which can be exported to multiple formats
  • Local document caching for improved performance
  • Support for local files and URLs as document sources
  • Memory management for handling large documents
  • Logging system for debugging and monitoring
  • RAG applications with Milvus upload and retrieval

Getting started

The easiest way to install Docling MCP is connect it to your client is launching it via uvx.

Depending on the transfer protocol required, specify the argument --transport, for example

  • stdio used e.g. in Claude for Desktop and LM Studio

    uvx --from docling-mcp docling-mcp-server --transport stdio
    
  • sse used e.g. in Llama Stack

    uvx --from docling-mcp docling-mcp-server --transport sse
    
  • streamable-http used e.g. in containers setup

    uvx --from docling-mcp docling-mcp-server --transport streamable-http
    

More options are available, e.g. the selection of which toolgroup to launch. Use the --help argument to inspect all the CLI options.

For developing the MCP tools further, please refer to the docs/development.md page for instructions.

Integration with MCP clients

One of the easiest ways to experiment with the tools provided by Docling MCP is to leverage an AI desktop client with MCP support. Most of these clients use a common config interface. Adding Docling MCP in your favorite client is usually as simple as adding the following entry in the configuration file.

{
  "mcpServers": {
    "docling": {
      "command": "uvx",
      "args": [
        "--from=docling-mcp",
        "docling-mcp-server"
      ]
    }
  }
} 

When using Claude for Desktop, simply edit the config file claude_desktop_config.json with the snippet above or the example provided here.

In LM Studio, edit the mcp.json file with the appropriate section or simply clik on the button below for a direct install.

Add MCP Server docling to LM Studio

Other integrations are described in ./docs/integrations/.

Examples

Converting documents

Example of prompt for converting PDF documents:

Convert the PDF document at <provide file-path> into DoclingDocument and return its document-key.

Generating documents

Example of prompt for generating new documents:

I want you to write a Docling document. To do this, you will create a document first by invoking `create_new_docling_document`. Next you can add a title (by invoking `add_title_to_docling_document`) and then iteratively add new section-headings and paragraphs. If you want to insert lists (or nested lists), you will first open a list (by invoking `open_list_in_docling_document`), next add the list_items (by invoking `add_listitem_to_list_in_docling_document`). After adding list-items, you must close the list (by invoking `close_list_in_docling_document`). Nested lists can be created in the same way, by opening and closing additional lists.

During the writing process, you can check what has been written already by calling the `export_docling_document_to_markdown` tool, which will return the currently written document. At the end of the writing, you must save the document and return me the filepath of the saved document.

The document should investigate the impact of tokenizers on the quality of LLMs.

License

The Docling MCP codebase is under MIT license. For individual model usage, please refer to the model licenses found in the original packages.

LF AI & Data

Docling and Docling MCP is hosted as a project in the LF AI & Data Foundation.

IBM ❤️ Open Source AI: The project was started by the AI for knowledge team at IBM Research Zurich.

S
Description
Making docling agentic through MCP
Readme MIT Cite this repository 12 MiB
Languages
Python 98%
Shell 2%