Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 14:13:35 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #5068] [FEAT]: Allow Agent Skills to Access Images Attached or Pasted in Chat #4901

New Issue
Closed
opened 2026-06-05 14:50:46 -04:00 by yindo · 0 comments
yindo commented 2026-06-05 14:50:46 -04:00
Owner
Copy Link
Copy Source

Originally created by @LudoE11 on GitHub (Feb 25, 2026).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5068

What would you like to see?

Context

I'm building a custom agent skill for AnythingLLM that edits images using an external API (Replicate) to call an AI Image editing model. The ideal user experience is for users to simply attach or paste an image into the chat and have the agent skill process it automatically based on their prompt (send the input image and the prompt to the API).

Current Situation

Currently, when a user sends a message to an agent skill (e.g., using @agent), only the text content of the message is passed to the skill handler. Any images attached or pasted into the chat are not accessible to the skill—there is no URL, file path, or base64 data provided. As far as I know.

Problem

This limitation means users must manually convert images to base64 or upload them to a specific folder, which adds friction and makes the workflow less user-friendly. The skill cannot process images directly from the chat, which is a common and expected use case for image editing or analysis skills.

Questions

  1. Is there currently any way for agent skills to access images that users attach or paste into the chat?
  2. If not, are there any recommended workarounds for this use case that don't add a lot of user friction?
  3. Are there plans to support passing image data (URL, file path, or base64) to agent skills in the future?

Desired Feature

It would be very useful and helfpuf if you could provide a way for agent skills to access images that users attach or paste into the chat, ideally as a URL, file path, or base64 string, so that skills can process them directly and provide a seamless user experience for image-based workflows.

Thanks in advance for your feedback.

Originally created by @LudoE11 on GitHub (Feb 25, 2026). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/5068 ### What would you like to see? ## Context I'm building a custom agent skill for AnythingLLM that edits images using an external API (Replicate) to call an AI Image editing model. The ideal user experience is for users to simply attach or paste an image into the chat and have the agent skill process it automatically based on their prompt (send the input image and the prompt to the API). ## Current Situation Currently, when a user sends a message to an agent skill (e.g., using `@agent`), only the text content of the message is passed to the skill handler. Any images attached or pasted into the chat are not accessible to the skill—there is no URL, file path, or base64 data provided. As far as I know. ## Problem This limitation means users must manually convert images to base64 or upload them to a specific folder, which adds friction and makes the workflow less user-friendly. The skill cannot process images directly from the chat, which is a common and expected use case for image editing or analysis skills. ## Questions 1. Is there currently any way for agent skills to access images that users attach or paste into the chat? 2. If not, are there any recommended workarounds for this use case that don't add a lot of user friction? 3. Are there plans to support passing image data (URL, file path, or base64) to agent skills in the future? ## Desired Feature It would be very useful and helfpuf if you could provide a way for agent skills to access images that users attach or paste into the chat, ideally as a URL, file path, or base64 string, so that skills can process them directly and provide a seamless user experience for image-based workflows. Thanks in advance for your feedback.
yindo added the enhancementfeature request labels 2026-06-05 14:50:46 -04:00
yindo closed this issue 2026-06-05 14:50:46 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#4901
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?