Mintplex-Labs/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm.git synced 2026-07-19 22:23:50 -04:00
Code Issues 328 Packages Projects Releases 10 Wiki Activity

[GH-ISSUE #3906] [FEAT]: Add a Global prompt #2490

New Issue
Closed
opened 2026-02-22 18:29:54 -05:00 by yindo · 4 comments
yindo commented 2026-02-22 18:29:54 -05:00
Owner
Copy Link
Copy Source

Originally created by @scottybo on GitHub (May 29, 2025).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3906

Originally assigned to: @angelplusultra on GitHub.

What would you like to see?

When looking at how people are using AnythingLLM, the vast majority ask questions about how to do things in their initial chats. The problem with this is that the user is just talking to an LLM, who has no idea about the context for their questions (none of them specifically mention AnythingLLM).

With this example, it would be useful to create a global prompt which gets inserted at the system prompt level which allows us to prompt things like

If the user asks about how to use a platform, direct them to email Bob (bob@example.com) for any questions

This way we can easily handle common questions or issues people are having when using AnythingLLM.

Originally created by @scottybo on GitHub (May 29, 2025). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/3906 Originally assigned to: @angelplusultra on GitHub. ### What would you like to see? When looking at how people are using AnythingLLM, the vast majority ask questions about how to do things in their initial chats. The problem with this is that the user is just talking to an LLM, who has no idea about the context for their questions (none of them specifically mention AnythingLLM). With this example, it would be useful to create a global prompt which gets inserted at the system prompt level which allows us to prompt things like ``` If the user asks about how to use a platform, direct them to email Bob (bob@example.com) for any questions ``` This way we can easily handle common questions or issues people are having when using AnythingLLM.
yindo added the enhancementfeature request labels 2026-02-22 18:29:54 -05:00
yindo closed this issue 2026-02-22 18:29:54 -05:00
yindo commented 2026-02-22 18:29:55 -05:00
Author
Owner
Copy Link
Copy Source

@timothycarambat commented on GitHub (Jun 3, 2025):

This can be achieved with System Variables where you can add this to each workspace's system prompt, and then that very same text would be injected into each prompt.

That would resolve this - no?

@timothycarambat commented on GitHub (Jun 3, 2025): This can be achieved with [System Variables](https://docs.anythingllm.com/features/system-prompt-variables#custom-variables) where you can add this to each workspace's system prompt, and then that very same text would be injected into each prompt. That would resolve this - no?
yindo commented 2026-02-22 18:29:55 -05:00
Author
Owner
Copy Link
Copy Source

@scottybo commented on GitHub (Jun 3, 2025):

@timothycarambat I'd disagree that this solves it, as it requires the workspace creator to know that this should be done, and also to do it.

When you have dozens of users using the system, this isn't practical or sustainable.

@scottybo commented on GitHub (Jun 3, 2025): @timothycarambat I'd disagree that this solves it, as it requires the workspace creator to know that this should be done, and also to do it. When you have dozens of users using the system, this isn't practical or sustainable.
yindo commented 2026-02-22 18:29:55 -05:00
Author
Owner
Copy Link
Copy Source

@ArturTask commented on GitHub (Sep 23, 2025):

Thanks for the platform it's really something brilliant!!

totally agree to the above messages, I started to dive into anythingLLM and actually didn't find how to configure pre-sending, I think it might be useful to change the default system prompt, not only in case of stating your contacts, but also when u use another language, e.g. "answer only in Spanish unless user asks to translate or to chat in another language, use context but don't repeat it....", cause most LLM answer in English by default, may be useful, but as for now it's impossible to configure it for all workspaces so the system prompt is always in English and if a user asks in another language the system prompt (and context retrieved) will be in 1 language, answer in another and it potentially may cause some problems and reduce the number of useful information given

  • it may also be handy to give examples of answers (contacts case example)

maybe adding a global customisable setting like default system-prompt (for all workspaces) is not a bad idea - I think it is worth adding) thank u anyway

@ArturTask commented on GitHub (Sep 23, 2025): Thanks for the platform it's really something brilliant!! totally agree to the above messages, I started to dive into anythingLLM and actually didn't find how to configure pre-sending, I think it might be useful to change the default system prompt, not only in case of stating your contacts, but also when u use another language, e.g. "answer only in Spanish unless user asks to translate or to chat in another language, use context but don't repeat it....", cause most LLM answer in English by default, may be useful, but as for now it's impossible to configure it for all workspaces so the system prompt is always in English and if a user asks in another language the system prompt (and context retrieved) will be in 1 language, answer in another and it potentially may cause some problems and reduce the number of useful information given + it may also be handy to give examples of answers (contacts case example) maybe adding a global customisable setting like default system-prompt (for all workspaces) is not a bad idea - I think it is worth adding) thank u anyway
yindo commented 2026-02-22 18:29:55 -05:00
Author
Owner
Copy Link
Copy Source

@HanJammer commented on GitHub (Nov 10, 2025):

The singular workspace-based system prompts are very limiting concept.

For this tool being truly useful there should be multi-level system prompt - similar to ChatGPT

ie.
[Global System Prompt] - set in the server settings which sets the most basic things (ie. "you are a helpful assistant for a company named acme", personality traits and so on).

[Workspace System Prompt] - builds on the Global Prompt fine tuning to a specific use case (similar to the ChatGPT or Claude Desktop Projects).

[Tool System Prompt] - Tools or Agent Skills are hardly usable for anything serious in the current state of them being set globally (vide #3855 ) - Each skill should be defined per workspace and have it's own description used as tool prompt. Also possibly another field to outline relations between tools.

[User Personalization] - additional instructions set by user (possibly taking into account the bio as well) - similar to ChatGPT personalization options.

They should be joined together and passed to the LLM as a system prompt.

Right now for each workspace I have a python tool which uses jinja2 template to build a system prompt from yaml "modules" so the experience stays the same across all workspaces but LLM understands what's expected in them and which tools to use. It works reasonably well but it's pain to manage.

@HanJammer commented on GitHub (Nov 10, 2025): The singular workspace-based system prompts are very limiting concept. For this tool being truly useful there should be multi-level system prompt - similar to ChatGPT ie. [Global System Prompt] - set in the server settings which sets the most basic things (ie. "you are a helpful assistant for a company named acme", personality traits and so on). [Workspace System Prompt] - builds on the Global Prompt fine tuning to a specific use case (similar to the ChatGPT or Claude Desktop Projects). [Tool System Prompt] - Tools or Agent Skills are hardly usable for anything serious in the current state of them being set globally (vide #3855 ) - Each skill should be defined per workspace and have it's own description used as tool prompt. Also possibly another field to outline relations between tools. [User Personalization] - additional instructions set by user (possibly taking into account the bio as well) - similar to ChatGPT personalization options. They should be joined together and passed to the LLM as a system prompt. Right now for each workspace I have a python tool which uses jinja2 template to build a system prompt from yaml "modules" so the experience stays the same across all workspaces but LLM understands what's expected in them and which tools to use. It works reasonably well but it's pain to manage.
yindo changed title from [FEAT]: Add a Global prompt to [GH-ISSUE #3906] [FEAT]: Add a Global prompt 2026-06-05 14:46:51 -04:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
Desktop
Docker
Integration Request
Integration Request
OS: Linux
OS: Mobile
OS: Windows
UI/UX
blocked
bug
bug
core-team-only
documentation
duplicate
embed-widget
enhancement
feature request
github_actions
good first issue
investigating
needs info / can't replicate
possible bug
pull-request
Mirrored from GitHub Pull Request
 question
stage: specifications
wontfix
No Label enhancement feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#2490
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?