Panos VagenasandGitHub 87b72d6537 fix(HybridChunker): refine max_tokens auto-detection (#306) ...

Signed-off-by: Panos Vagenas <pva@zurich.ibm.com>

2025-05-27 15:38:49 +02:00

..

0_inp_dl_doc.json

feat: integrate serialization API into chunkers (#221)

2025-04-08 14:04:40 +02:00

0_out_chunks.json

feat: add annotations in MD & HTML serialization (#295)

2025-05-27 10:49:13 +02:00

0b_out_chunks.json

feat: add annotations in MD & HTML serialization (#295)

2025-05-27 10:49:13 +02:00

2_inp_dl_doc.json

feat: add hybrid chunker (#68)

2024-12-06 14:56:10 +01:00

2a_out_chunks.json

feat: Add ContentLayer attribute to designate items to body or furniture (#148)

2025-02-10 10:58:41 +01:00

2a_out_ser_chunks.json

feat: add hybrid chunker (#68)

2024-12-06 14:56:10 +01:00

2b_out_chunks.json

feat: Add ContentLayer attribute to designate items to body or furniture (#148)

2025-02-10 10:58:41 +01:00

2c_out_chunks.json

fix(HybridChunker): refine max_tokens auto-detection (#306)

2025-05-27 15:38:49 +02:00

2d_out_ser_chunks.json

fix: fix hybrid chunker token constraint (#131)

2025-01-17 17:22:26 +01:00

2e_out_chunks.json

feat: integrate serialization API into chunkers (#221)

2025-04-08 14:04:40 +02:00

2f_out_chunks.json

feat: Add tiktoken tokenizers support to HybridChunker (#240)

2025-04-18 07:43:20 +02:00

2g_out_chunks.json

fix(HybridChunker): refine max_tokens auto-detection (#306)

2025-05-27 15:38:49 +02:00