6 Commits

Author SHA1 Message Date
AlexMultiAgent d992fd9645 Update text_fitter.difypkg: remove comparison table, refine wording 2026-05-26 22:36:17 +08:00
AlexMultiAgent d7333e598d Update text_fitter.difypkg with latest README and code cleanup 2026-05-26 20:54:28 +08:00
AlexMultiAgent db10cd7924 Update Text Fitter plugin package with latest fixes
- Fix length score piecewise continuity at len=20 boundary
- Add multi-dot abbreviation protection (i.e., e.g.)
- Pre-compile sentence-split regex at module level
- Extract shared CJK Unicode ranges into _is_cjk_char helper
- Fix incomplete CJK detection in boundary truncation fallback
- Guard MMR prefilter empty-selection index mapping
2026-05-26 06:43:00 +08:00
AlexMultiAgent 3d3d03de9c update text-fitter: add source repo link and requirements to README 2026-05-25 16:55:19 +08:00
AlexMultiAgent 49f0304ee3 update text-fitter plugin to v0.0.1
- Fix length score discontinuities across all boundaries
- Expand tokenizer CJK character ranges
- Improve exception handling with error visibility
- Increase compression_ratio precision
- Use CJK ellipsis for CJK text truncation
- Add .difyignore for clean packaging
2026-05-25 16:38:16 +08:00
AlexMultiAgent 30f8e833eb add text-fitter plugin v0.0.1 2026-05-25 04:37:29 +08:00