Commit Graph

23 Commits

Author SHA1 Message Date
Dmitry Ng 59b196e98a feat: enhance reasoning and caching support across various LLMs
- Updated reasoning handling in the Anthropic and OpenAI clients to support real-time streaming of reasoning tokens.
- Refactored reasoning structures to improve integration with existing models, ensuring consistent behavior across different LLM implementations.
- Added comprehensive tests for reasoning and caching functionalities, validating the expected behavior in various scenarios.
- Removed deprecated files related to previous caching implementations to streamline the codebase.

This update improves the overall performance and reliability of reasoning capabilities in LLM interactions.
2026-01-27 22:56:49 +03:00
Dmitry Ng aa2dd71269 Merge branch 'main' into release/v0.1.14-update.1 2026-01-24 02:07:00 +03:00
zhu733756 1bbaab130f documentloaders: add RecursiveDirectoryLoader that loads documents with allowed extensions from a directory (#1386)
* documentloaders: add RecursiveDirectoryLoader

Signed-off-by: zhu733756 <qq107933812@gmail.com>

* fix golangci-lint

---------

Signed-off-by: zhu733756 <qq107933812@gmail.com>
2025-09-15 04:18:12 +02:00
Dmitry Ng b2e8ae1009 feat: enhance streaming functionality with done chunk handling
- Added support for a new chunk type, ChunkTypeDone, to signal the completion of streaming sessions.
- Updated various examples and tests to handle the new done chunk, ensuring proper signaling of stream completion.
- Refactored streaming functions to include calls to CallWithDone, improving the clarity and reliability of streaming responses.
- Enhanced documentation to reflect the changes in chunk types and their usage in streaming contexts.
2025-06-23 21:09:44 +03:00
Dmitry Ng 74fa9c6460 chrore: update audio file path in transcription test and add sample audio file in documentloaders 2025-06-23 15:21:36 +03:00
Dmitry Ng eee90d9059 fix: multiple linter issues and logic in tests 2025-06-23 13:43:06 +03:00
Dmitry Ng 019056baba feat: setup repository for fork 2025-06-22 02:27:21 +03:00
Dmitry Ng cf28e63935 Merge branch 'pr/696’ into main-pull-requests
llms: Add support for using the whisper model to transcribe audio

Squashed commit of the following:

Author: Alexandre E Souza <alexandre@dev2learn.com>
Date:   Fri Mar 29 23:27:33 2024 -0300

    chore: remove language
    chore: move whiper to documentloaders
    feat: update comments
    feat:add link for audio formats
    llms: Wisper model
2025-06-22 02:03:40 +03:00
Dmitry Ng ab24b67297 Merge branch 'pr/1068’ into main-pull-requests
documentloaders: ms office docs

Squashed commit of the following:

Author: Simun Strukan <simun.strukan@gmail.com>
Date:   Tue May 6 16:46:40 2025 +0200

    Reduced the size of docx and pptx files

Author: Simun Strukan <simun.strukan@gmail.com>
Date:   Tue Apr 22 01:03:19 2025 +0200

    Added custom regex based parsers for XML based documents,
    added constant for asci text extraction, separated EOF check
    from errors while reading doc and ppt document buffers

Author: Simun Strukan <simun.strukan@gmail.com>
Date:   Mon Nov 18 14:57:36 2024 +0100

    Added loader for all the common office doc types, doc, docx, ppt, pptx,
    xls, xlsx

Author: Simun Strukan <simun.strukan@gmail.com>
Date:   Tue Nov 5 00:01:54 2024 +0100

    Added core office docs documentloader
2025-06-22 02:03:39 +03:00
Travis Cline c544fb77bd all: add broad httprr coverage, update dependencies, organize go.mod file, bump to 1.23 (#1299)
* all: add broad httprr coverage, update dependencies, organize go.mod file, bump to 1.23

update go version to 1.23
add lots of test coverage via httprr recordings
update dependencies and organize go.mod
add testutil/testctr which helps work around a testcontainers-go+colima bug
expand the huggingface implementation and tests
expand capabilities of the ollama package
2025-06-04 11:41:45 -07:00
Manuel de la Peña 8d4c17fc73 ci: migrate linting golangci-lint to v2.0.2 (#1217)
* chore: use slices and maps packages

* chore: skip embedded type

* chore: use fmt.Fprint instead

* chore: use switch

* chore: reorder imports

* chore: add white lines

* chore: use t.Setenv

* chore: excplicitly omit non used param

* chore: use t.TempDir

* chore: use maps package

* chore: migrate golangci-lint config file

Run: "golangci-lint migrate -c .golangci.yaml --skip-validation"

* chore: bump golangci-lint action to v7
2025-04-12 01:54:50 -07:00
Travis Cline bf1667feaf lint: fixup lint settings (#1018) 2024-09-13 04:39:28 +00:00
Marcus Olsson 0218733d9b documentloaders: add AssemblyAI document loader (#668)
* documentloaders: added assemblyai document loader
2024-03-18 16:30:23 -07:00
chyroc 55f772c21a Docs: fix comment typo (#442)
* Docs: fix comment typo

* docs: a llm -> an LLM

---------

Co-authored-by: Travis Cline <travis.cline@gmail.com>
2023-12-20 19:57:37 +00:00
Semih Berkay Öztürk c997babc7b documentloaders: add notion directory loader (#401)
* add notion directory loader

* minor lint changes

---------

Co-authored-by: Semih Berkay Öztürk <90466553+semihberkayozturk@users.noreply.github.com>
2023-12-09 13:47:01 -08:00
Ismail 80f9027554 fix: golangci-lint v1.55 errors 2023-12-04 22:38:28 -08:00
zivkovicn 6c805ff73a documentloader-csv-fix | lint 2023-08-04 17:31:43 +02:00
zivkovicn 7682079605 documentloader-csv-fix | fixing loader 2023-08-04 17:30:49 +02:00
Matthew Plachter 9547d68c00 add pdf documentloader
Update pdf_test.go

fix assert order on test
2023-07-12 10:18:28 -04:00
Murilo Santana 0c2d958237 lint: fix method receiver name (ST1016) 2023-06-28 17:27:20 -03:00
Murilo Santana 9911f24bb9 document loaders: add html loader 2023-06-28 17:05:28 -03:00
Murilo Santana d3e1424911 document loaders: add csv loader 2023-06-14 15:41:16 -03:00
FluffyKebab b7d34a2865 documentloaders: add context to interface 2023-04-29 22:00:14 +02:00