[PR #35] [MERGED] update lexer, update parser #347

Closed
opened 2026-02-17 17:20:10 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/35
Author: @eyurtsev
Created: 6/11/2025
Status: Merged
Merged: 6/12/2025
Merged by: @eyurtsev

Base: mainHead: eugene/parser_rewrite


📝 Commits (7)

📊 Changes

4 files changed (+490 additions, -578 deletions)

View changed files

📝 pipeline/tools/lexer.py (+3 -4)
📝 pipeline/tools/parser.py (+243 -526)
📝 tests/unit_tests/test_lexer.py (+34 -0)
📝 tests/unit_tests/test_parser.py (+210 -48)

📄 Description

  • Update lexer
  • Update parser to use lexer
  • Add unit tests for lots of basic cases
  • Best effort at preserving HTML blocks
  • Preserve indentation in code blocks

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/35 **Author:** [@eyurtsev](https://github.com/eyurtsev) **Created:** 6/11/2025 **Status:** ✅ Merged **Merged:** 6/12/2025 **Merged by:** [@eyurtsev](https://github.com/eyurtsev) **Base:** `main` ← **Head:** `eugene/parser_rewrite` --- ### 📝 Commits (7) - [`e918a7f`](https://github.com/langchain-ai/docs/commit/e918a7f017746331b10651df2797aa6a8b379fe3) x - [`678d14d`](https://github.com/langchain-ai/docs/commit/678d14d8f71f86691144813e6d90b2833cf4034c) x - [`d562e48`](https://github.com/langchain-ai/docs/commit/d562e48905f5c854836535cecf4eaefabcc5f522) x - [`f043401`](https://github.com/langchain-ai/docs/commit/f04340183bc359b15e001a61bd741a8da6349992) x - [`f4d706d`](https://github.com/langchain-ai/docs/commit/f4d706d42c53014ab3fee7727dcfca9932a0e122) x - [`d0d6d33`](https://github.com/langchain-ai/docs/commit/d0d6d33be1154b9e2aae3800f06b1e36cf8a29ae) preserve html tags - [`f5a2e60`](https://github.com/langchain-ai/docs/commit/f5a2e603c74687d493f4f7b08d40deb534902e27) x ### 📊 Changes **4 files changed** (+490 additions, -578 deletions) <details> <summary>View changed files</summary> 📝 `pipeline/tools/lexer.py` (+3 -4) 📝 `pipeline/tools/parser.py` (+243 -526) 📝 `tests/unit_tests/test_lexer.py` (+34 -0) 📝 `tests/unit_tests/test_parser.py` (+210 -48) </details> ### 📄 Description * Update lexer * Update parser to use lexer * Add unit tests for lots of basic cases * Best effort at preserving HTML blocks * Preserve indentation in code blocks --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-17 17:20:10 -05:00
yindo closed this issue 2026-02-17 17:20:10 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#347