Eugene Yurtsev 0dc304ca80 Add html parsers (#4874) ...

# Add bs4 html parser

* Some minor refactors
* Extract the bs4 html parsing code from the bs html loader
* Move some tests from integration tests to unit tests

2023-05-17 22:39:11 -04:00

..

blob_loaders

Add progress bar to filesystemblob loader, update pytest config for unit tests (#4212)

2023-05-08 16:15:09 -04:00

parsers

Add html parsers (#4874)

2023-05-17 22:39:11 -04:00

__init__.py

2markdown loader (#4796)

2023-05-16 23:42:53 -07:00

airbyte_json.py

Dev2049/add modern treasury (#3924)

2023-05-01 20:28:02 -07:00

apify_dataset.py

Harrison/apify (#2215)

2023-03-30 20:58:14 -07:00

arxiv.py

Arxiv document loader (#3627)

2023-04-26 21:04:56 -07:00

azlyrics.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

azure_blob_storage_container.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

azure_blob_storage_file.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

base.py

docs retriever improvements (#4430)

2023-05-17 15:29:22 -07:00

bigquery.py

Harrison/big query (#2100)

2023-03-28 08:17:22 -07:00

bilibili.py

Remove unnecessary spaces from document object’s page_content of BiliBiliLoader (#4619)

2023-05-16 13:13:57 -04:00

blackboard.py

hotfix (#1742)

2023-03-17 09:05:08 -07:00

blockchain.py

Enhancement: option to Get All Tokens with a single Blockchain Document Loader call (#3797)

2023-05-03 15:46:44 -07:00

chatgpt.py

Add ChatGPT Data Loader (#3336)

2023-04-22 09:06:24 -07:00

college_confidential.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

confluence.py

Add Confluence Loader unit tests (#3333)

2023-05-16 15:17:07 -07:00

conllu.py

add CoNLL-U document loader (#1297)

2023-02-26 17:27:00 -08:00

csv_loader.py

simplify csv args (#4182)

2023-05-05 09:22:08 -07:00

dataframe.py

Fix typo in dataframe.py (#4786)

2023-05-16 11:49:04 -04:00

diffbot.py

consistently use getLogger(__name__), no root logger (#2989)

2023-04-16 12:49:35 -07:00

directory.py

Harrison/multithreading directory loader (#4650)

2023-05-13 21:46:02 -07:00

discord.py

Harrison/discord loader (#3200)

2023-04-19 21:04:12 -07:00

docugami.py

Tiny code review and docs fix for Docugami DataLoader (#4877)

2023-05-17 15:31:43 -07:00

duckdb_loader.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

email.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

epub.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

evernote.py

Update and rename everynote.py to evernote.py (#1060)

2023-02-15 22:41:42 -08:00

facebook_chat.py

Refactor TelegramChatLoader and FacebookChatLoader classes and add tests (#3863)

2023-05-03 15:59:19 -07:00

figma.py

Dev2049/add modern treasury (#3924)

2023-05-01 20:28:02 -07:00

gcs_directory.py

Support GCS Objects with / in GCS Loaders (#3356)

2023-04-24 22:05:44 -07:00

gcs_file.py

Support GCS Objects with / in GCS Loaders (#3356)

2023-04-24 22:05:44 -07:00

generic.py

Add a generic document loader (#4875)

2023-05-17 22:38:55 -04:00

git.py

Add source field to metadata (#4462)

2023-05-15 14:30:12 -07:00

gitbook.py

Gitbook enhancements (#2279)

2023-04-06 22:55:07 -07:00

googledrive.py

Improve error messages formatting in doc loaders (#4586)

2023-05-12 13:03:39 -04:00

gutenberg.py

gutenberg books (#946)

2023-02-08 12:00:47 -08:00

hn.py

Refactor some loops into list comprehensions (#1185)

2023-02-20 16:38:43 -08:00

html_bs.py

Add get_text_separator parameter to BSHTMLLoader (#3551)

2023-04-26 16:10:16 -07:00

html.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

hugging_face_dataset.py

Hugging Face Loader: Add lazy load (#4799)

2023-05-17 12:04:23 -04:00

ifixit.py

Harrison/ifixit (#1680)

2023-03-14 21:17:50 -07:00

image_captions.py

Improve error messages formatting in doc loaders (#4586)

2023-05-12 13:03:39 -04:00

image.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

imsdb.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

json_loader.py

Harrison/json loader fix (#4686)

2023-05-14 18:25:59 -07:00

markdown.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

mediawikidump.py

Harrison/media wiki xml (#4072)

2023-05-03 20:45:33 -07:00

modern_treasury.py

Dev2049/add modern treasury (#3924)

2023-05-01 20:28:02 -07:00

notebook.py

fix imports (#1288)

2023-02-25 08:48:02 -08:00

notion.py

Harrison/unstructured support (#903)

2023-02-05 23:02:07 -08:00

notiondb.py

Harrison/param notion db (#4689)

2023-05-14 18:26:25 -07:00

obsidian.py

Dev2049/obsidian patch (#4204)

2023-05-05 16:49:19 -07:00

odt.py

feat: add loader for open office odt files (#4405)

2023-05-10 01:37:17 -07:00

onedrive_file.py

Harrison/one drive loader (#4081)

2023-05-03 22:55:34 -07:00

onedrive.py

Improve error messages formatting in doc loaders (#4586)

2023-05-12 13:03:39 -04:00

pdf.py

Feature: pdfplumber PDF loader with BaseBlobParser (#4552)

2023-05-15 09:47:02 -04:00

powerpoint.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

python.py

Add PythonLoader which auto-detects encoding of Python files (#3311)

2023-04-21 10:47:57 -07:00

readthedocs.py

fix: ReadTheDocs loader main content filter (#2609)

2023-04-09 12:51:56 -07:00

reddit.py

Langchain with reddit (#3661) (#3768)

2023-04-28 20:59:56 -07:00

roam.py

Harrison/add roam loader (#939)

2023-02-08 00:35:33 -08:00

rtf.py

feat: add loader for rich text files (#3227)

2023-04-20 15:51:49 -07:00

s3_directory.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

s3_file.py

Improve error messages formatting in doc loaders (#4586)

2023-05-12 13:03:39 -04:00

sitemap.py

Harrison/sitemap local (#4704)

2023-05-14 22:04:38 -07:00

slack_directory.py

Add Slack Directory Loader (#2841)

2023-04-13 21:31:59 -07:00

spreedly.py

Harrison/spreedly (#3937)

2023-05-01 20:56:56 -07:00

srt.py

add srt loader (#1140)

2023-02-18 10:58:39 -08:00

stripe.py

Dev2049/add modern treasury (#3924)

2023-05-01 20:28:02 -07:00

telegram.py

fix(document_loaders/telegram): fix pandas calls + add tests (#4806)

2023-05-16 14:35:25 -07:00

text.py

Add encoding parameter to TextLoader (#2250)

2023-04-01 08:57:17 -07:00

tomarkdown.py

2markdown loader (#4796)

2023-05-16 23:42:53 -07:00

toml.py

Add PDF parser implementations (#4356)

2023-05-09 10:24:17 -04:00

twitter.py

Add Twitter Tweet Loader (#3050)

2023-04-17 21:44:54 -07:00

unstructured.py

feat: add loader for open office odt files (#4405)

2023-05-10 01:37:17 -07:00

url_playwright.py

Harrison/playwright selector (#3185)

2023-04-19 16:54:15 -07:00

url_selenium.py

Add support for passing binary_location to the SeleniumURLLoader when creating Chrome or Firefox web drivers (#4305)

2023-05-08 11:05:55 -04:00

url.py

enhancement: add elements mode to UnstructuredURLLoader (#3456)

2023-04-26 22:09:45 -07:00

web_base.py

Respect User-Specified User-Agent in WebBaseLoader (#4579)

2023-05-14 23:09:27 -04:00

whatsapp_chat.py

Update WhatsAppChatLoader to include the character ~ in the sender name (#4420)

2023-05-09 15:00:04 -07:00

wikipedia.py

added Wikipedia document loader (#4141)

2023-05-06 09:32:45 -07:00

word_document.py

Harrison/doc2txt (#3772)

2023-04-28 21:54:16 -07:00

youtube.py

YouTube Loader: Replace regexp with built-in parsing (#4729)

2023-05-15 08:34:41 -07:00