68 Commits

Author SHA1 Message Date
Abirdcfly e98eb1703a vectorstores: fix chroma not return score from SimilaritySearch (#449)
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
2023-12-24 18:17:23 -08:00
chyroc 55f772c21a Docs: fix comment typo (#442)
* Docs: fix comment typo

* docs: a llm -> an LLM

---------

Co-authored-by: Travis Cline <travis.cline@gmail.com>
2023-12-20 19:57:37 +00:00
Mehul Shah dcae4f66a6 pgvector: Fix DropTable Function (#441)
drop embedding table before collection table

Co-authored-by: Mehul <mehul@gndctl.com>
2023-12-20 11:50:24 -08:00
Rey David Dominguez Soto 6ad961ac14 pgvector: support postgres schema (#439) 2023-12-20 11:34:16 -08:00
Abirdcfly ed0536f392 vectorstores: add pgvector (#377)
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
2023-12-12 16:31:09 -08:00
Jeremy 00f364f27f embeddings: remove TEI embeddings client. (#396)
* remove tei embeddings
2023-12-09 13:48:32 -08:00
Eli Bendersky fc033c3471 embeddings: use NewEmbedder for OpenAI embeddings (#385)
This is the first use of the refactoring made in #374 -- removing the
embeddings/openai directory entirely, since it can be now implemented
with NewEmbedder without duplicating code. The test was moved one
dir down and works with the new setup.

This is a model that can be used to similarly refactor the other
embeddings/* subdirs.

This is a large PR because it also updates example go.mods

For #379
2023-12-04 22:38:29 -08:00
Jeremy 721e152d74 vectorstores: add Milvus (#352)
* adding milvus vector store

* adding hugging face text embedings

* adding milvus vector store example
2023-12-04 22:38:29 -08:00
Ismail 80f9027554 fix: golangci-lint v1.55 errors 2023-12-04 22:38:28 -08:00
bjwswang b5f5c3f8ec vectorstores: disable debug in chromadb client (#324)
Signed-off-by: bjwswang <bjwswang@gmail.com>
2023-12-04 22:38:28 -08:00
bjwswang 7c8a1bed5f vectorstore: openai apikey is must required only when embedder is nil (#318)
Signed-off-by: bjwswang <bjwswang@gmail.com>
2023-12-04 22:38:28 -08:00
Marty Ross c5fe58eadb vectorstores: Add remote chroma "vectorstore" adapter (#282)
* FR278 Add remote chromadb support

* FR278 Fix lint complaints

* Add 'nameSpace' via metadata

* Add embedder Option

* Add includes, example app, README

* feat(vectorstore): add chroma

* fix: update type to match upstream

* style: fix golangci-lint complaints
2023-12-04 22:38:27 -08:00
Colin Duggan 6cfe92cfda schema: add score attribute to document type to allow similarity score to be returned from vector search (#298)
Include score field in document type to provide more context about the accuracy of results returned by similaritysearch
2023-09-27 12:04:53 -07:00
Travis Cline 1c87838fe7 embeddings: use float32 throughout (#297)
* embeddings: use float32 throughout

* floats: more conversions

* exapmles: Add vertexai embeddings example
2023-09-24 22:32:18 +00:00
Nikola Zivkovic 2c309cf279 callback-handler: Callback handler for HandleRetrieverEnd (#295)
* callback-handler-query | adding query to the output

* callback-handler-query | cp

---------

Co-authored-by: zivkovicn <x-nikola.zivkovic@transcarent.ai>
2023-09-23 10:29:51 -07:00
Travis Cline c5b84faa54 callbacks: Include context 2023-08-25 19:14:02 -07:00
FluffyKebab 03ad4b7799 add callbacks to tools, vectorsores and agents 2023-08-25 19:00:21 -07:00
zivkovicn 39904df2c7 vectorstore-embedder-options | extendting vectrstore options 2023-08-11 14:54:56 +02:00
Carlos Queiroz 17bad1aff2 Update weaviate.go
Bug Fix for weaviate client when using API Key.

Fixed header string for Authorization
2023-08-02 00:31:58 +05:30
zivkovicn 5f72c3c01f feat-embeddings-split-with-options | lint 2023-07-18 15:04:57 +02:00
zivkovicn 6899975676 feat-embeddings-split-with-options | lint 2023-07-18 15:02:35 +02:00
zivkovicn 238739e2d7 feat-embeddings-split-with-options | feat: updating embeddings 2023-07-18 14:57:45 +02:00
ryomak 6d4706be97 vectorstores: add error handling of weaviate fetching data 2023-07-01 19:24:35 +09:00
ryomak 716544fc62 vectorstores: modify the type of filters 2023-06-25 00:08:08 +09:00
ryomak 1820071e96 vectorstores: weaviate golangci-lint run 2023-06-24 21:13:24 +09:00
ryomak 8340e6b040 vectorstores: modify some comments 2023-06-24 20:57:03 +09:00
ryomak 70448e140b vectorstores: const weaviate filter key 2023-06-24 20:41:11 +09:00
ryomak 2882699928 vectorstores: add weaviate filter 2023-06-24 20:39:15 +09:00
Colin Duggan d6051f727f Merge branch 'main' into pinrcone-add-filterby-logic-in-restquery 2023-06-24 08:34:48 +01:00
Travis Cline 2a07aa42d1 Merge pull request #132 from ryomak/weaviate
vectorstores: add weaviate
2023-06-23 23:48:07 -07:00
Taiwo Hassan Yusuf 02745a9320 Fixed lint issues 2023-06-19 09:57:09 +01:00
Taiwo Hassan Yusuf 4d7a8e246e Added package level comments to codebase 2023-06-19 09:35:48 +01:00
ryomak 6eec4d43fc vectorstores: modify getNameSpace and getScoreThreshold 2023-06-19 07:19:37 +09:00
ryomak b71e94bbe6 vectorstores: add weaviate 2023-06-18 15:13:26 +09:00
cduggn 11f4ad6281 Remove unnecessary white space 2023-06-16 17:41:42 +01:00
Colin Duggan aaba1b7ee8 Apply gofumpt and goalngci-lint changes 2023-06-16 17:02:14 +01:00
Colin Duggan ffab3614c4 Run gofumpt on updated files 2023-06-16 16:38:39 +01:00
Colin Duggan f5facc4a40 Tidy gofmt 2023-06-16 12:57:27 +01:00
Colin Duggan 7f713012fc Add negative test, as well as test using multiple filters 2023-06-16 12:00:22 +01:00
Colin Duggan 349c78b670 Add unit tests for metadata filtering using '$'eq and '$'in clauses 2023-06-15 19:43:24 +01:00
Colin Duggan c73cd88e4a Include comment and link to Pinecone metadata filtering guide in options.go. Refactor AddDocuments and SimilaritySearch to reduce calls to getOptions. Update restapi.go to include filter option in payload 2023-06-15 19:00:57 +01:00
Colin Duggan 881ba1efa7 Adding capability to filter query request to reduce latency 2023-06-14 17:27:55 +01:00
Travis Cline e224c9d518 pinecone: fix lint issues 2023-05-29 20:39:07 -07:00
Colin Duggan 1c269bd612 Merge branch 'main' into pinecone-similarity-search-with-relevance 2023-05-29 19:12:05 +01:00
Colin Duggan 90f2048f1d Unit test for Pinecone as retriever with score threshold 2023-05-29 16:32:57 +01:00
Colin Duggan 16f956d973 Use camel case for function name 2023-05-29 16:11:17 +01:00
Colin Duggan c8ddc5dafe Pinecone SimilaritySearch: Adding score threshold filtering for restQuery 2023-05-29 16:07:34 +01:00
Alexander Knipping 7e70684bcc Fix(pinecone): correct docstrings 2023-05-23 13:37:15 +02:00
FluffyKebab 5ddc157cf5 vectorstores: fix lint 2023-05-16 10:24:30 +02:00
FluffyKebab c985261e22 vectorstores: fix lint 2023-05-16 10:23:20 +02:00