Commit Graph
333 Commits
Author SHA1 Message Date
davidmezzetti 3422e0fbb1 Add additional vector backends. Closes #725. Closes #726. Closes #727 2024-05-28 08:26:29 -04:00
davidmezzetti 468ed7ab1f Update test 2024-05-25 07:07:45 -04:00
davidmezzetti f3b7cb9569 Update #704 to not require a path parameter in Embeddings as not all vector models need a path. Update test. 2024-05-25 06:25:30 -04:00
davidmezzetti c4080a348a Fix incompatibility with ONNX models and transformers>=4.41.0, closes #720 2024-05-20 17:10:50 -04:00
davidmezzetti 8bd4d78cf9 Add support for chat messages in LLM pipeline, closes #718 2024-05-18 14:21:30 -04:00
davidmezzetti 498eb7c977 Add Postgres Full Text Scoring, closes #713 2024-05-09 16:42:54 -04:00
davidmezzetti 7b1b297390 Update test 2024-05-01 15:24:04 -04:00
davidmezzetti 9aa2edd4fb Add RDBMS Graph, closes #699 2024-04-24 11:20:19 -04:00
davidmezzetti e24f4bc21d Add pgvector ANN backend, closes #698 2024-04-24 11:19:26 -04:00
davidmezzetti 69b4a9e86b Update test 2024-04-19 06:37:43 -04:00
davidmezzetti 8277ce9e1b Add batch node and edge creation for graphs, closes #693 2024-04-17 08:44:15 -04:00
davidmezzetti 9a670cd5ec Update default vector model logic for embeddings.batchtransform 2024-02-28 13:28:50 -05:00
davidmezzetti 88430d7824 Add support for dynamic vector dimensions, pass options to underlying vector models and move vector model caching. Closes #674. Closes #675. Closes #678 2024-02-27 21:20:51 -05:00
davidmezzetti dc5d913ac6 Add graph search, closes #534, closes #540, closes #670 2024-02-20 11:55:28 -05:00
davidmezzetti fb3440a141 Add support for binary content and MessagePack, closes #630, closes #658 2024-02-06 11:39:30 -05:00
davidmezzetti fd6bf1263d Fix various issues with subindex reloading #618 2024-02-02 12:15:40 -05:00
davidmezzetti f2adc383eb Update HFTrainer to add PEFT support, closes #654 2024-01-31 13:52:47 -05:00
davidmezzetti 168f7e4efd Change default embeddings config to json, closes #652, Store index ids outside of config when content is disabled, closes #653. 2024-01-30 17:12:33 -05:00
davidmezzetti b35290ddab Add feature to return embeddings search results as graph, closes #644 2024-01-23 13:55:41 -05:00
davidmezzetti ea64551f34 Add indexing of embeddings graph relationships, closes #525 2024-01-22 10:16:00 -05:00
davidmezzetti b907a5f99c Update test 2023-12-26 11:19:56 -05:00
davidmezzetti 8bc6940092 Add API dependencies and default token authorization. Migrate to FastAPI lifespan events. Closes #623. Closes #624. Closes #625. 2023-12-26 10:33:30 -05:00
davidmezzetti f9229bc27c Update test 2023-12-13 09:53:59 -05:00
davidmezzetti 6ce37d4cfc Refactor LLM pipeline to support multiple framework methods. Closes #614. Closes #611. Closes #554 2023-12-09 11:39:39 -05:00
davidmezzetti 57812b7f2c Fix issue with subdirectories and zip compression, closes #609 2023-12-04 13:35:42 -05:00
davidmezzetti 6e14cfef41 Handle None input in Tokenizer, closes #607 2023-12-03 10:35:47 -05:00
davidmezzetti 5de34a667b Only add page breaks if requested via configuration 2023-11-28 16:35:12 -05:00
davidmezzetti 591e7307e3 Enhance textractor to better support RAG use cases, closes #603 2023-11-28 15:52:11 -05:00
davidmezzetti 7b2546883e Add support for SQL bind parameters, closes #564 2023-11-07 11:00:11 -05:00
davidmezzetti 7176802968 Update Faiss ANN to support IVF strings without number of cells, closes #594 2023-11-04 09:50:18 -04:00
davidmezzetti 0f35409219 Add scalar quantization support to vectors, closes #583 2023-10-27 15:01:40 -04:00
davidmezzetti fee257fbc6 Pass additional parameters to extractor task question template #575 2023-10-14 11:14:35 -04:00
davidmezzetti 5800445cc8 Reorganize tests to work with GitHub action memory constraints 2023-10-10 11:32:34 -04:00
davidmezzetti 1b368ede71 Reorganize tests to work with GitHub action memory constraints 2023-10-10 10:51:29 -04:00
davidmezzetti eb41320b7d Reorganize tests to work with GitHub action memory constraints 2023-10-10 10:35:32 -04:00
davidmezzetti 7abf4fa809 Update test 2023-10-10 08:21:54 -04:00
davidmezzetti 7bd8717122 Update test 2023-10-09 20:28:27 -04:00
davidmezzetti 2548248778 Skip unit test on Windows 2023-10-09 19:49:05 -04:00
davidmezzetti fad9301dee Skip unit test on Windows 2023-10-09 17:02:49 -04:00
davidmezzetti 89397b7e91 Add CLS pooling, closes #565 2023-10-09 12:18:51 -04:00
davidmezzetti 96acee4f6b Update LLM pipeline to support template parameter, closes #566 2023-10-03 14:39:03 -04:00
davidmezzetti f8a6c6381b Add flatten parameter to RetrieveTask, closes #569 2023-10-03 12:42:31 -04:00
davidmezzetti 46ee7a34e1 Add application reindex method, closes #547. Add weights and index parameters, closes #561 2023-09-22 12:30:12 -04:00
davidmezzetti aadda6b5f7 Update reindex action to support new 6.x configuration, closes #557 2023-09-19 15:31:47 -04:00
davidmezzetti e48a8885ce Add support for custom scoring instances, closes #544 2023-09-06 17:21:56 -04:00
davidmezzetti c911f3438f Update test 2023-08-25 21:01:01 -04:00
davidmezzetti a1b92e0a33 Add metadata support for client-server databases, closes #532 2023-08-25 20:47:34 -04:00
davidmezzetti aebca3c2d1 Revert Makefile change 2023-08-09 22:01:41 -04:00
davidmezzetti 66da38b150 Revert skipped unit tests 2023-08-09 21:24:36 -04:00
davidmezzetti 9c504ec8a4 Refactor database tests to fix class structure 2023-08-09 20:51:09 -04:00