[PR #1061] [MERGED] docs: troubleshooting chunk_overlap on MarkdownHeaderTextSplitter #1261

Closed
opened 2026-02-17 17:22:02 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/1061
Author: @sachinML
Created: 10/21/2025
Status: Merged
Merged: 10/21/2025
Merged by: @mdrxy

Base: mainHead: docs/chunk-overlap-troubleshooting


📝 Commits (3)

  • 4e838d8 docs: add troubleshooting note for chunk_overlap to MarkdownHeaderTextSplitter page
  • 1a925fe tweaks
  • 74c4a06 Merge branch 'main' into docs/chunk-overlap-troubleshooting

📊 Changes

1 file changed (+28 additions, -42 deletions)

View changed files

📝 src/oss/python/integrations/splitters/markdown_header_metadata_splitter.mdx (+28 -42)

📄 Description

Refs #30200

  • Use split_documents(docs) after header-based splitting (preserves per-section metadata; overlap applied per document).
  • Overlap appears only when a single section exceeds chunk_size.
  • Overlap does not cross section/document boundaries.
  • Consider strip_headers=True to avoid a tiny header-only chunk; keep "" as a fallback separator if text lacks newlines/spaces.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/1061 **Author:** [@sachinML](https://github.com/sachinML) **Created:** 10/21/2025 **Status:** ✅ Merged **Merged:** 10/21/2025 **Merged by:** [@mdrxy](https://github.com/mdrxy) **Base:** `main` ← **Head:** `docs/chunk-overlap-troubleshooting` --- ### 📝 Commits (3) - [`4e838d8`](https://github.com/langchain-ai/docs/commit/4e838d8b20b9c57d147bcf4462195c004c9e4ad5) docs: add troubleshooting note for chunk_overlap to MarkdownHeaderTextSplitter page - [`1a925fe`](https://github.com/langchain-ai/docs/commit/1a925fe77b055406f84ddc4f2b5ad5e9564cc16b) tweaks - [`74c4a06`](https://github.com/langchain-ai/docs/commit/74c4a061004a938c7d17e5261d657118c4ceeabd) Merge branch 'main' into docs/chunk-overlap-troubleshooting ### 📊 Changes **1 file changed** (+28 additions, -42 deletions) <details> <summary>View changed files</summary> 📝 `src/oss/python/integrations/splitters/markdown_header_metadata_splitter.mdx` (+28 -42) </details> ### 📄 Description Refs #30200 - Use `split_documents(docs)` after header-based splitting (preserves per-section metadata; overlap applied per document). - Overlap appears only when a single section exceeds `chunk_size`. - Overlap does not cross section/document boundaries. - Consider `strip_headers=True` to avoid a tiny header-only chunk; keep `""` as a fallback separator if text lacks newlines/spaces. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-17 17:22:02 -05:00
yindo closed this issue 2026-02-17 17:22:02 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#1261