[GH-ISSUE #59] Default prompting kills off creativity/hypothetical scenarios #38

Closed
opened 2026-02-22 18:17:36 -05:00 by yindo · 2 comments
Owner

Originally created by @danglingptr0x0 on GitHub (Jun 15, 2023).
Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/59

Hey there,

Based on my several experiments using both gpt-3.5-turbo-16k and gpt-4, I have observed that the responses returned by the API are incredibly rigid. Both models continuously refuse to be creative. I do writing as a side hustle and wanted to use semantic search as a tool for finding connections in a vast universe that I had already written, but here, it appears that the models either respond if they "find a match" or simply say that they don't know. Therefore, if you want to ask about hypothetical scenarios or developmental queries (e.g. "expand character XYZ based on the available details") based on some context given by your documents. I am pretty sure prompting is the issue here, so it would likely help if there was a user-friendly way to manipulate the prompt. I might take a look at it later, though I don't have much experience with web dev.

Thanks!

Originally created by @danglingptr0x0 on GitHub (Jun 15, 2023). Original GitHub issue: https://github.com/Mintplex-Labs/anything-llm/issues/59 Hey there, Based on my several experiments using both `gpt-3.5-turbo-16k` and `gpt-4`, I have observed that the responses returned by the API are incredibly rigid. Both models continuously refuse to be creative. I do writing as a side hustle and wanted to use semantic search as a tool for finding connections in a vast universe that I had already written, but here, it appears that the models either respond if they "find a match" or simply say that they don't know. Therefore, if you want to ask about hypothetical scenarios or developmental queries (e.g. "*expand character XYZ based on the available details*") based on some context given by your documents. I am pretty sure prompting is the issue here, so it would likely help if there was a user-friendly way to manipulate the prompt. I might take a look at it later, though I don't have much experience with web dev. Thanks!
yindo added the enhancementgood first issue labels 2026-02-22 18:17:36 -05:00
yindo closed this issue 2026-02-22 18:17:36 -05:00
Author
Owner

@timothycarambat commented on GitHub (Jun 16, 2023):

Great comment. Langchain does not give much clarity into how the query-mode prompt is arranged, but it could for sure be a setting on workspaces along with temperatue

@timothycarambat commented on GitHub (Jun 16, 2023): Great comment. Langchain does not give much clarity into how the query-mode prompt is arranged, but it could for sure be a setting on workspaces along with temperatue
Author
Owner

@timothycarambat commented on GitHub (Oct 30, 2023):

This has been done and is available in workspace settings! System prompt

@timothycarambat commented on GitHub (Oct 30, 2023): This has been done and is available in workspace settings! `System prompt`
yindo changed title from Default prompting kills off creativity/hypothetical scenarios to [GH-ISSUE #59] Default prompting kills off creativity/hypothetical scenarios 2026-06-05 14:33:08 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#38