Jon Saginaw f8d69e4e52 Enhancement: Blockchain Document Loader with better Metadata support (#3710) ...

This PR includes some minor alignment updates, including:

- metadata object extended to support contractAddress, blockchainType,
and tokenId
- notebook doc better aligned to standard langchain format
- startToken changed from int to str to support multiple hex value types
on the Alchemy API

The updated metadata will look like the below. It's possible for a
single contractAddress to exist across multiple blockchains (e.g.
Ethereum, Polygon, etc.) so it's important to include the
blockchainType.

```
 metadata = {"source": self.contract_address, 
                      "blockchain": self.blockchainType,
                      "tokenId": tokenId}
```

2023-04-28 20:13:05 -07:00

..

blob_loaders

Blob: Add validator and use future annotations (#3650)

2023-04-27 14:33:59 -04:00

__init__.py

Add Mathpix pdf loader (#3727)

2023-04-28 20:11:22 -07:00

airbyte_json.py

Harrison/airbyte (#989)

2023-02-10 18:08:00 -08:00

apify_dataset.py

Harrison/apify (#2215)

2023-03-30 20:58:14 -07:00

arxiv.py

Arxiv document loader (#3627)

2023-04-26 21:04:56 -07:00

azlyrics.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

azure_blob_storage_container.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

azure_blob_storage_file.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

base.py

Add lazy iteration interface to document loaders (#3659)

2023-04-27 14:29:01 -04:00

bigquery.py

Harrison/big query (#2100)

2023-03-28 08:17:22 -07:00

bilibili.py

Added bilibili loader (#2673) (#2724)

2023-04-11 10:40:32 -07:00

blackboard.py

hotfix (#1742)

2023-03-17 09:05:08 -07:00

blockchain.py

Enhancement: Blockchain Document Loader with better Metadata support (#3710)

2023-04-28 20:13:05 -07:00

chatgpt.py

Add ChatGPT Data Loader (#3336)

2023-04-22 09:06:24 -07:00

college_confidential.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

confluence.py

Confluence: Add page status filter for spaces (#3732)

2023-04-28 19:56:53 -07:00

conllu.py

add CoNLL-U document loader (#1297)

2023-02-26 17:27:00 -08:00

csv_loader.py

Allow passing in encoding to csv_loader (#1836)

2023-03-20 22:03:00 -07:00

dataframe.py

rm pandas dependency (#2102)

2023-03-28 08:38:19 -07:00

diffbot.py

consistently use getLogger(__name__), no root logger (#2989)

2023-04-16 12:49:35 -07:00

directory.py

Adds progress bar using tqdm to directory_loader (#3349)

2023-04-24 21:42:42 -07:00

discord.py

Harrison/discord loader (#3200)

2023-04-19 21:04:12 -07:00

duckdb_loader.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

email.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

epub.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

evernote.py

Update and rename everynote.py to evernote.py (#1060)

2023-02-15 22:41:42 -08:00

facebook_chat.py

Harrison/fb loader (#1277)

2023-02-24 07:22:48 -08:00

figma.py

Harrison/figma doc loader (#1908)

2023-03-22 19:57:46 -07:00

gcs_directory.py

Support GCS Objects with / in GCS Loaders (#3356)

2023-04-24 22:05:44 -07:00

gcs_file.py

Support GCS Objects with / in GCS Loaders (#3356)

2023-04-24 22:05:44 -07:00

git.py

Ignore files from .gitignore in Git loader (#2909)

2023-04-14 15:02:21 -07:00

gitbook.py

Gitbook enhancements (#2279)

2023-04-06 22:55:07 -07:00

googledrive.py

Harrison/rec gd (#3054)

2023-04-17 21:02:35 -07:00

gutenberg.py

gutenberg books (#946)

2023-02-08 12:00:47 -08:00

hn.py

Refactor some loops into list comprehensions (#1185)

2023-02-20 16:38:43 -08:00

html_bs.py

Add get_text_separator parameter to BSHTMLLoader (#3551)

2023-04-26 16:10:16 -07:00

html.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

hugging_face_dataset.py

Harrison/hf document loader (#3394)

2023-04-23 10:17:43 -07:00

ifixit.py

Harrison/ifixit (#1680)

2023-03-14 21:17:50 -07:00

image_captions.py

Harrison/image caption loader (#3051)

2023-04-17 20:49:10 -07:00

image.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

imsdb.py

clean up loaders (#1178)

2023-02-20 08:20:48 -08:00

markdown.py

fix: pass unstructured kwargs down in all unstructured loaders (#2506)

2023-04-06 12:29:52 -07:00

notebook.py

fix imports (#1288)

2023-02-25 08:48:02 -08:00

notion.py

Harrison/unstructured support (#903)

2023-02-05 23:02:07 -08:00

notiondb.py

feat: Add Notion database document loader (#2056)

2023-03-28 08:07:09 -07:00

obsidian.py

Harrison/obsidian (#3060)

2023-04-17 21:57:32 -07:00

pdf.py

Add Mathpix pdf loader (#3727)

2023-04-28 20:11:22 -07:00

powerpoint.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

python.py

Add PythonLoader which auto-detects encoding of Python files (#3311)

2023-04-21 10:47:57 -07:00

readthedocs.py

fix: ReadTheDocs loader main content filter (#2609)

2023-04-09 12:51:56 -07:00

roam.py

Harrison/add roam loader (#939)

2023-02-08 00:35:33 -08:00

rtf.py

feat: add loader for rich text files (#3227)

2023-04-20 15:51:49 -07:00

s3_directory.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

s3_file.py

Minor: Remove duplicated word in error message (#2706)

2023-04-11 13:10:33 -07:00

sitemap.py

Support recursive sitemaps in SitemapLoader (#3146)

2023-04-22 08:48:04 -07:00

slack_directory.py

Add Slack Directory Loader (#2841)

2023-04-13 21:31:59 -07:00

srt.py

add srt loader (#1140)

2023-02-18 10:58:39 -08:00

stripe.py

Harrison/stripe (#3762)

2023-04-28 20:03:21 -07:00

telegram.py

fix telegram imports (#1110)

2023-02-17 00:53:01 -08:00

text.py

Add encoding parameter to TextLoader (#2250)

2023-04-01 08:57:17 -07:00

twitter.py

Add Twitter Tweet Loader (#3050)

2023-04-17 21:44:54 -07:00

unstructured.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

url_playwright.py

Harrison/playwright selector (#3185)

2023-04-19 16:54:15 -07:00

url_selenium.py

add --no-sandbox for chrome in url_selenium (#3589)

2023-04-26 21:48:43 -07:00

url.py

enhancement: add elements mode to UnstructuredURLLoader (#3456)

2023-04-26 22:09:45 -07:00

web_base.py

Harrison/site map tqdm (#3184)

2023-04-19 20:48:47 -07:00

whatsapp_chat.py

WhatsApp document loader - update regex (#2776)

2023-04-13 09:48:32 -07:00

word_document.py

feat: allow the unstructured kwargs to be passed in to Unstructured document loaders (#1667)

2023-03-14 18:15:28 -07:00

youtube.py

Improve youtube loader (#3395)

2023-04-23 10:24:41 -07:00