[PR #33] [MERGED] update parser #348

Closed
opened 2026-02-17 17:20:10 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/langchain-ai/docs/pull/33
Author: @eyurtsev
Created: 6/11/2025
Status: Merged
Merged: 6/11/2025
Merged by: @eyurtsev

Base: mainHead: eugene/test_sample_files


📝 Commits (10+)

📊 Changes

5 files changed (+619 additions, -68 deletions)

View changed files

pipeline/tools/lexer.py (+123 -0)
📝 pipeline/tools/parser.py (+341 -65)
📝 pyproject.toml (+7 -0)
tests/unit_tests/test_lexer.py (+82 -0)
📝 tests/unit_tests/test_parser.py (+66 -3)

📄 Description

  • Fix some issues in existing parser
  • Add placeholder lexer

The implementations may be replaced with the python markdown and https://facelessuser.github.io/pymdown-extensions/ -- investigating whether all extensions are supported.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/langchain-ai/docs/pull/33 **Author:** [@eyurtsev](https://github.com/eyurtsev) **Created:** 6/11/2025 **Status:** ✅ Merged **Merged:** 6/11/2025 **Merged by:** [@eyurtsev](https://github.com/eyurtsev) **Base:** `main` ← **Head:** `eugene/test_sample_files` --- ### 📝 Commits (10+) - [`3643642`](https://github.com/langchain-ai/docs/commit/3643642dde24d5d953a67c673ff0cd36069d6ebc) x - [`36bb207`](https://github.com/langchain-ai/docs/commit/36bb20755f6635a07ef4ec473c0aa155d0cc026b) x - [`0abf7bc`](https://github.com/langchain-ai/docs/commit/0abf7bc79e9873ce00e4b43f5350bc437dc94d06) x - [`50309d5`](https://github.com/langchain-ai/docs/commit/50309d517ce64e844a5adf708ef602ea9f98a015) x - [`b99a39c`](https://github.com/langchain-ai/docs/commit/b99a39c8ee2daaae4e1fab6801804863631dec7c) handle front matter - [`4010385`](https://github.com/langchain-ai/docs/commit/401038575a0491e2798f912c9e48685e79c52345) handle html, handle nested lists - [`67f8437`](https://github.com/langchain-ai/docs/commit/67f8437abc98f2c09bc395b890a8c4e3fdaaafdd) x - [`4dcf86c`](https://github.com/langchain-ai/docs/commit/4dcf86c2943904b9639321896007ababfa966724) x - [`9491e56`](https://github.com/langchain-ai/docs/commit/9491e5641b6b777d9e74c05ddfbff84b5a6e4020) x - [`ebb68d1`](https://github.com/langchain-ai/docs/commit/ebb68d1711fb9d2fc4f2f529ee26360e72cb4b50) x ### 📊 Changes **5 files changed** (+619 additions, -68 deletions) <details> <summary>View changed files</summary> ➕ `pipeline/tools/lexer.py` (+123 -0) 📝 `pipeline/tools/parser.py` (+341 -65) 📝 `pyproject.toml` (+7 -0) ➕ `tests/unit_tests/test_lexer.py` (+82 -0) 📝 `tests/unit_tests/test_parser.py` (+66 -3) </details> ### 📄 Description * Fix some issues in existing parser * Add placeholder lexer The implementations may be replaced with the python `markdown` and `https://facelessuser.github.io/pymdown-extensions/` -- investigating whether all extensions are supported. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-17 17:20:10 -05:00
yindo closed this issue 2026-02-17 17:20:10 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: langchain-ai/docs#348