run-llama/llama_cloud_services
1
0
Fork 0
mirror of https://github.com/run-llama/llama_cloud_services.git synced 2026-08-26 16:56:36 -04:00
Code Issues 352 Packages Projects Releases 10 Wiki Activity

No metadata for async aload_data runs #134

New Issue
Open
opened 2026-02-16 00:16:58 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 00:16:58 -05:00
Owner
Copy Link
Copy Source

Originally created by @RobertHH-IS on GitHub (Jun 7, 2024).

When using aload_data the returned documents only carry an id but no metadata regarding filename. Batched returns are therefore impossible to pair.

# Initialize the parser
parser = LlamaParse(
    result_type="markdown", 
)

# Get the list of PDF files in the directory
directory = "./test"
pdf_files = [os.path.join(directory, filename) for filename in os.listdir(directory) if filename.endswith('.pdf')]

# Asynchronous function to load data
async def load_documents(file_list):
    documents = await parser.aload_data(file_list)
    return documents

# Run the asynchronous function
documents = asyncio.run(load_documents(pdf_files))

Returns...
[Document(id_='e9a15122-0ac6-4d09-b149-37695cb67aa3', embedding=None, metadata={}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, text="# U.......

Originally created by @RobertHH-IS on GitHub (Jun 7, 2024). When using aload_data the returned documents only carry an id but no metadata regarding filename. Batched returns are therefore impossible to pair. ``` # Initialize the parser parser = LlamaParse( result_type="markdown", ) # Get the list of PDF files in the directory directory = "./test" pdf_files = [os.path.join(directory, filename) for filename in os.listdir(directory) if filename.endswith('.pdf')] # Asynchronous function to load data async def load_documents(file_list): documents = await parser.aload_data(file_list) return documents # Run the asynchronous function documents = asyncio.run(load_documents(pdf_files)) ``` Returns... [Document(id_='e9a15122-0ac6-4d09-b149-37695cb67aa3', embedding=None, metadata={}, excluded_embed_metadata_keys=[], excluded_llm_metadata_keys=[], relationships={}, text="# U.......
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
LlamaCloud
LlamaExtract
LlamaParse
bug
client
complex layout
documentation
duplicate
enhancement
figure
font
header footer
help wanted
ocr
parser
pdf_debug
pdf_debug
pull-request
Mirrored from GitHub Pull Request
 python-lib
question
server_issue
server_issue
ui
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_cloud_services#134
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?