Matt Robinson 3c489be773 feat: optional post-processing for Unstructured loaders (#7850) ...

### Summary

Adds a post-processing method for Unstructured loaders that allows users
to optionally modify or clean extracted elements.

### Testing

```python
from langchain.document_loaders import UnstructuredFileLoader
from unstructured.cleaners.core import clean_extra_whitespace

loader = UnstructuredFileLoader(
    "./example_data/layout-parser-paper.pdf",
    mode="elements",
    post_processors=[clean_extra_whitespace],
)

docs = loader.load()
docs[:5]
```


### Reviewrs
  - @rlancemartin
  - @eyurtsev
  - @hwchase17

2023-07-17 12:13:05 -07:00

..

agents

Add Xorbits agent (#7647)

2023-07-17 07:09:51 -07:00

callbacks

Export Tracer from callbacks (#7812)

2023-07-16 20:58:13 -07:00

chains

feat(chains): adding ElasticsearchDatabaseChain for interacting with analytics database (#7686)

2023-07-14 10:30:57 -04:00

chat_models

Added support for examples for VertexAI chat models. (#7636)

2023-07-14 02:03:04 -04:00

docstore

docstrings: docstore and client (#6783)

2023-07-09 01:34:28 -04:00

document_loaders

feat: optional post-processing for Unstructured loaders (#7850)

2023-07-17 12:13:05 -07:00

document_transformers

Adds OpenAI functions powered document metadata tagger (#7521)

2023-07-13 01:12:41 -04:00

embeddings

Add GPT4All embeddings (#7743)

2023-07-15 10:04:29 -04:00

evaluation

Fix eval loader when overriding arguments (#7734)

2023-07-15 08:30:32 -07:00

experimental

[Breaking] Update Evaluation Functionality (#7388)

2023-07-13 02:13:06 -07:00

graphs

CPAL (#6255)

2023-07-11 10:11:21 -04:00

indexes

Allow passing custom prompts to GraphIndexCreator (#7381)

2023-07-08 01:47:53 -04:00

llms

Update to Anthropic's claude-v2 (#7793)

2023-07-17 08:55:49 -07:00

load

docstrings top level update (#7173)

2023-07-07 02:42:28 -04:00

memory

Support Redis Sentinel database connections (#5196)

2023-07-17 07:18:51 -07:00

output_parsers

feat(chains): adding ElasticsearchDatabaseChain for interacting with analytics database (#7686)

2023-07-14 10:30:57 -04:00

prompts

Jinja2 validation changed to issue warnings rather than issuing exceptions. (#7161)

2023-07-05 14:04:29 -04:00

retrievers

specify comparators (#7805)

2023-07-17 07:30:48 -07:00

schema

Load Run Evaluator (#7101)

2023-07-07 19:57:59 -07:00

smith

Fix chat example output mapper (#7808)

2023-07-16 17:47:05 -07:00

tools

fix: remove useless variable k (#6524)

2023-07-13 01:58:36 -04:00

utilities

Support Redis Sentinel database connections (#5196)

2023-07-17 07:18:51 -07:00

vectorstores

Support Redis Sentinel database connections (#5196)

2023-07-17 07:18:51 -07:00

__init__.py

move base prompt to schema (#6995)

2023-07-02 22:38:59 -04:00

base_language.py

Base language model docstrings (#7104)

2023-07-07 16:09:10 -04:00

cache.py

Fix SQLAlchemy LLM cache clear (#7653)

2023-07-13 09:39:04 -04:00

docker-compose.yaml

Update docker-compose.yaml (#3582)

2023-04-26 15:11:59 -07:00

env.py

Use LCP Client in Tracer (#5908)

2023-06-08 21:15:14 -07:00

example_generator.py

Base language model docstrings (#7104)

2023-07-07 16:09:10 -04:00

formatting.py

Validate input_variables when using jinja2 templates (#3140)

2023-04-19 16:18:32 -07:00

input.py

FileCallbackHandler (#5589)

2023-06-03 16:48:48 -07:00

math_utils.py

add get_top_k_cosine_similarity method to get max top k score and index (#5059)

2023-05-22 11:55:48 -07:00

model_laboratory.py

Harrison/improve cache (#368)

2022-12-18 16:22:42 -05:00

py.typed

Add py.typed marker to package (#121)

2022-11-12 11:22:32 -08:00

python.py

Move PythonRepl -> langchain.utilities (#2917)

2023-04-15 10:50:25 -07:00

requests.py

Allow passing auth objects in TextRequestsWrapper (#7701)

2023-07-14 08:38:24 -04:00

serpapi.py

codespell: workflow, config + some (quite a few) typos fixed (#6785)

2023-07-12 16:20:08 -04:00

server.py

[Breaking] Update Evaluation Functionality (#7388)

2023-07-13 02:13:06 -07:00

sql_database.py

docs : add cnosdb to Ecosystem Integrations (#7316)

2023-07-07 01:35:22 -04:00

text_splitter.py

codespell: workflow, config + some (quite a few) typos fixed (#6785)

2023-07-12 16:20:08 -04:00

utils.py

docstrings top level update (#7173)

2023-07-07 02:42:28 -04:00