[PR #708] [MERGED] [FEAT] RLHF on response messages #3462

Closed
opened 2026-02-22 18:33:50 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Mintplex-Labs/anything-llm/pull/708
Author: @shatfield4
Created: 2/9/2024
Status: Merged
Merged: 2/13/2024
Merged by: @timothycarambat

Base: masterHead: 595-feat-rhlf-like-feature


📝 Commits (10+)

  • f3e917e WIP RLHF works on historical messages
  • b61b338 refactor Actions component
  • ccfa733 completed RLHF up and down votes for chats
  • b128ebb add defaults for HistoricalMessage params
  • bb5286a Merge branch 'master' into 595-feat-rhlf-like-feature
  • 5a8190f Merge branch 'master' into 595-feat-rhlf-like-feature
  • fd86904 refactor RLHF implmenation
  • 1de3c5d remove dup id
  • 54db6e9 Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into 595-feat-rhlf-like-feature
  • 8ccc982 Add rating to CSV output

📊 Changes

14 files changed (+316 additions, -137 deletions)

View changed files

📝 embed/src/components/ChatWindow/ChatContainer/ChatHistory/index.jsx (+2 -0)
📝 frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/Actions/index.jsx (+75 -11)
📝 frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/index.jsx (+59 -53)
📝 frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/PromptReply/index.jsx (+54 -57)
📝 frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/index.jsx (+2 -4)
📝 frontend/src/models/workspace.js (+13 -0)
📝 frontend/src/utils/chat/index.js (+25 -2)
📝 server/endpoints/workspaces.js (+30 -0)
📝 server/models/workspaceChats.js (+17 -0)
server/prisma/migrations/20240210004405_init/migration.sql (+2 -0)
📝 server/prisma/schema.prisma (+1 -0)
📝 server/utils/chats/index.js (+8 -5)
📝 server/utils/chats/stream.js (+20 -4)
📝 server/utils/helpers/chat/convertTo.js (+8 -1)

📄 Description

Pull Request Type

  • feat
  • 🐛 fix
  • ♻️ refactor
  • 💄 style
  • 🔨 chore
  • 📝 docs

Relevant Issues

resolves #595

What is in this change?

Describe the changes in this PR that are impactful to the repo.

  • Implement RLHF in chats where user can thumbs up or down messages
  • Create column in workspace_chats table to keep track of feedback score

Additional Information

Add any other context about the Pull Request here that was not captured above.

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Mintplex-Labs/anything-llm/pull/708 **Author:** [@shatfield4](https://github.com/shatfield4) **Created:** 2/9/2024 **Status:** ✅ Merged **Merged:** 2/13/2024 **Merged by:** [@timothycarambat](https://github.com/timothycarambat) **Base:** `master` ← **Head:** `595-feat-rhlf-like-feature` --- ### 📝 Commits (10+) - [`f3e917e`](https://github.com/Mintplex-Labs/anything-llm/commit/f3e917e1b4a038f61363f2667f609b76cad584f2) WIP RLHF works on historical messages - [`b61b338`](https://github.com/Mintplex-Labs/anything-llm/commit/b61b338cd8570151678ffcd5bf91ef9222e3e228) refactor Actions component - [`ccfa733`](https://github.com/Mintplex-Labs/anything-llm/commit/ccfa733dd3ef636e878838fb7c854a859a1e2fea) completed RLHF up and down votes for chats - [`b128ebb`](https://github.com/Mintplex-Labs/anything-llm/commit/b128ebb65a94275c1be613d950397b36694bdeca) add defaults for HistoricalMessage params - [`bb5286a`](https://github.com/Mintplex-Labs/anything-llm/commit/bb5286aaeb5686f6543b4c0f20a8c4fe5a0aa413) Merge branch 'master' into 595-feat-rhlf-like-feature - [`5a8190f`](https://github.com/Mintplex-Labs/anything-llm/commit/5a8190fdc0b9e41b3f1f0219980e347208308a36) Merge branch 'master' into 595-feat-rhlf-like-feature - [`fd86904`](https://github.com/Mintplex-Labs/anything-llm/commit/fd869041d7c57c6b19880e7e5f1b46469bcfbf81) refactor RLHF implmenation - [`1de3c5d`](https://github.com/Mintplex-Labs/anything-llm/commit/1de3c5d4384dc00620d14d1a33f543baba0be018) remove dup id - [`54db6e9`](https://github.com/Mintplex-Labs/anything-llm/commit/54db6e9ce12fca77c505aa9b3729c26c42b9e143) Merge branch 'master' of github.com:Mintplex-Labs/anything-llm into 595-feat-rhlf-like-feature - [`8ccc982`](https://github.com/Mintplex-Labs/anything-llm/commit/8ccc982d35da1a9608fdd848fdf8c17e4864d669) Add rating to CSV output ### 📊 Changes **14 files changed** (+316 additions, -137 deletions) <details> <summary>View changed files</summary> 📝 `embed/src/components/ChatWindow/ChatContainer/ChatHistory/index.jsx` (+2 -0) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/Actions/index.jsx` (+75 -11) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/HistoricalMessage/index.jsx` (+59 -53) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/PromptReply/index.jsx` (+54 -57) 📝 `frontend/src/components/WorkspaceChat/ChatContainer/ChatHistory/index.jsx` (+2 -4) 📝 `frontend/src/models/workspace.js` (+13 -0) 📝 `frontend/src/utils/chat/index.js` (+25 -2) 📝 `server/endpoints/workspaces.js` (+30 -0) 📝 `server/models/workspaceChats.js` (+17 -0) ➕ `server/prisma/migrations/20240210004405_init/migration.sql` (+2 -0) 📝 `server/prisma/schema.prisma` (+1 -0) 📝 `server/utils/chats/index.js` (+8 -5) 📝 `server/utils/chats/stream.js` (+20 -4) 📝 `server/utils/helpers/chat/convertTo.js` (+8 -1) </details> ### 📄 Description ### Pull Request Type <!-- For change type, change [ ] to [x]. --> - [x] ✨ feat - [ ] 🐛 fix - [ ] ♻️ refactor - [ ] 💄 style - [ ] 🔨 chore - [ ] 📝 docs ### Relevant Issues <!-- Use "resolves #xxx" to auto resolve on merge. Otherwise, please use "connect #xxx" --> resolves #595 ### What is in this change? Describe the changes in this PR that are impactful to the repo. - Implement RLHF in chats where user can thumbs up or down messages - Create column in workspace_chats table to keep track of feedback score ### Additional Information Add any other context about the Pull Request here that was not captured above. ### Developer Validations <!-- All of the applicable items should be checked. --> - [x] I ran `yarn lint` from the root of the repo & committed changes - [x] Relevant documentation has been updated - [x] I have tested my code functionality - [x] Docker build succeeds locally --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-22 18:33:50 -05:00
yindo closed this issue 2026-02-22 18:33:50 -05:00
yindo changed title from [PR #708] [FEAT] RLHF on response messages to [PR #708] [MERGED] [FEAT] RLHF on response messages 2026-06-05 15:13:33 -04:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Mintplex-Labs/anything-llm#3462