Sergey Kozlov 6d15854cda Add JSON Lines support to JSONLoader (#6913) ...

**Description**:

The JSON Lines format is used by some services such as OpenAI and
HuggingFace. It's also a convenient alternative to CSV.

This PR adds JSON Lines support to `JSONLoader` and also updates related
tests.

**Tag maintainer**: @rlancemartin, @eyurtsev.

PS I was not able to build docs locally so didn't update related
section.

2023-07-02 12:32:41 -07:00

..

blob_loaders

YoutubeAudioLoader and updates to OpenAIWhisperParser (#5772)

2023-06-06 15:15:08 -07:00

parsers

Add password to PyPDR loader and parser (#6908)

2023-06-29 17:35:50 -07:00

__init__.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

acreom.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

airbyte_json.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

airtable.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

apify_dataset.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

arxiv.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

azlyrics.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

azure_blob_storage_container.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

azure_blob_storage_file.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

base.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

bibtex.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

bigquery.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

bilibili.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

blackboard.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

blockchain.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

chatgpt.py

docstrings document_loaders 1 (#6847)

2023-07-02 12:13:04 -07:00

college_confidential.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

confluence.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

conllu.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

csv_loader.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

dataframe.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

diffbot.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

directory.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

discord.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

docugami.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

duckdb_loader.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

email.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

embaas.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

epub.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

evernote.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

excel.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

facebook_chat.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

fauna.py

added docstrings where they missed (#6626)

2023-06-23 15:49:44 -07:00

figma.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

gcs_directory.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

gcs_file.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

generic.py

Add a generic document loader (#4875)

2023-05-17 22:38:55 -04:00

git.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

gitbook.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

github.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

googledrive.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

gutenberg.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

helpers.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

hn.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

html_bs.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

html.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

hugging_face_dataset.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

ifixit.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

image_captions.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

image.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

imsdb.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

iugu.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

joplin.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

json_loader.py

Add JSON Lines support to JSONLoader (#6913)

2023-07-02 12:32:41 -07:00

larksuite.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

markdown.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

mastodon.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

max_compute.py

add maxcompute (#5533)

2023-06-01 00:54:42 -07:00

mediawikidump.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

merge.py

Create merge loader that combines documents from a set of loaders (#6659)

2023-06-23 13:02:48 -07:00

mhtml.py

docstrings document_loaders 2 (#6890)

2023-07-02 12:14:22 -07:00

modern_treasury.py

added docstrings where they missed (#6626)

2023-06-23 15:49:44 -07:00

notebook.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

notion.py

Harrison/unstructured support (#903)

2023-02-05 23:02:07 -08:00

notiondb.py

Improve performance when retrieving Notion DB pages (#6710)

2023-06-26 05:46:09 -07:00

obsidian.py

Dev2049/obsidian patch (#4204)

2023-05-05 16:49:19 -07:00

odt.py

feat: add loader for open office odt files (#4405)

2023-05-10 01:37:17 -07:00

onedrive_file.py

Harrison/one drive loader (#4081)

2023-05-03 22:55:34 -07:00

onedrive.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

open_city_data.py

Loader for OpenCityData and minor cleanups to Pandas, Airtable loaders (#6301)

2023-06-22 22:20:42 -07:00

org_mode.py

feat: Add UnstructuredOrgModeLoader (#6842)

2023-06-27 16:34:17 -07:00

pdf.py

Add password to PyPDR loader and parser (#6908)

2023-06-29 17:35:50 -07:00

powerpoint.py

feat: batch multiple files in a single Unstructured API request (#4525)

2023-05-21 20:48:20 -07:00

psychic.py

Update to the latest Psychic python library version (#6804)

2023-06-27 22:26:38 -07:00

pyspark_dataframe.py

fix (#5457)

2023-05-30 10:42:20 -07:00

python.py

Add PythonLoader which auto-detects encoding of Python files (#3311)

2023-04-21 10:47:57 -07:00

readthedocs.py

Allow readthedoc loader to pass custom html tag (#5175)

2023-05-24 10:40:27 -07:00

recursive_url_loader.py

RecusiveUrlLoader to RecursiveUrlLoader (#6787)

2023-06-26 23:12:14 -07:00

reddit.py

Langchain with reddit (#3661) (#3768)

2023-04-28 20:59:56 -07:00

roam.py

Harrison/add roam loader (#939)

2023-02-08 00:35:33 -08:00

rst.py

feat: Add UnstructuredRSTLoader (#6594)

2023-06-25 12:41:57 -07:00

rtf.py

feat: add loader for rich text files (#3227)

2023-04-20 15:51:49 -07:00

s3_directory.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

s3_file.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

sitemap.py

Strips whitespace and \n from loc before filtering urls from sitemap (#5728)

2023-06-05 16:33:55 -07:00

slack_directory.py

Add Slack Directory Loader (#2841)

2023-04-13 21:31:59 -07:00

snowflake_loader.py

Fix: SnowflakeLoader returning empty documents (#5967)

2023-06-10 13:03:50 -07:00

spreedly.py

added docstrings where they missed (#6626)

2023-06-23 15:49:44 -07:00

srt.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

stripe.py

added docstrings where they missed (#6626)

2023-06-23 15:49:44 -07:00

telegram.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

tencent_cos_directory.py

feat(document_loaders): add tencent cos directory and file loader (#6401)

2023-06-27 23:07:20 -07:00

tencent_cos_file.py

feat(document_loaders): add tencent cos directory and file loader (#6401)

2023-06-27 23:07:20 -07:00

text.py

feat #4479: TextLoader auto detect encoding and improved exceptions (#4927)

2023-05-18 09:55:14 -04:00

tomarkdown.py

2markdown loader (#4796)

2023-05-16 23:42:53 -07:00

toml.py

Add PDF parser implementations (#4356)

2023-05-09 10:24:17 -04:00

trello.py

New Trello document loader (#4767)

2023-05-29 19:47:56 -07:00

twitter.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

unstructured.py

Harrison/unstructured page number (#6464)

2023-06-19 22:31:43 -07:00

url_playwright.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

url_selenium.py

changed ValueError to ImportError (#5103)

2023-05-22 15:24:45 -07:00

url.py

Fix typo (#7023)

2023-07-02 01:17:30 -06:00

weather.py

Adding Weather Loader (#5056)

2023-05-23 15:57:33 -07:00

web_base.py

Web Loader: Add proxy support (#6792)

2023-06-27 22:27:49 -07:00

whatsapp_chat.py

Enhancement : Ignore deleted messages and media in WhatsAppChatLoader (#6839)

2023-06-27 16:36:55 -07:00

wikipedia.py

Wiki loader lint (#6670)

2023-06-23 16:05:42 -07:00

word_document.py

feat: batch multiple files in a single Unstructured API request (#4525)

2023-05-21 20:48:20 -07:00

xml.py

feat: Add UnstructuredXMLLoader for .xml files (#5955)

2023-06-10 16:24:42 -07:00

youtube.py

Harrison/youtube multi language (#5758)

2023-06-05 16:38:07 -07:00