[PR #453] [MERGED] feat: add support for multimodal #514

Closed
opened 2026-02-15 20:15:07 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/run-llama/create-llama/pull/453
Author: @leehuwuj
Created: 11/27/2024
Status: Merged
Merged: 11/29/2024
Merged by: @marcusschiesser

Base: mainHead: feat/multimodal


📝 Commits (10+)

  • fdb4c28 add support for multimodal
  • 1e647c2 update code
  • bc8df66 fix wrong signature override
  • 9d6f94b bump: chat-ui
  • a40da22 Create lazy-insects-share.md
  • 88d2918 add MultiModalSynthesizer
  • 7431705 Merge remote-tracking branch 'origin/feat/bump-chat-ui' into feat/multimodal
  • 89c3183 Merge remote-tracking branch 'origin/main' into feat/multimodal
  • fa17d39 add synthesize
  • 0ffb7ff use getter

📊 Changes

3 files changed (+164 additions, -9 deletions)

View changed files

.changeset/blue-hornets-boil.md (+5 -0)
📝 templates/components/engines/python/agent/tools/query_engine.py (+141 -7)
📝 templates/components/settings/python/settings.py (+18 -2)

📄 Description

Summary by CodeRabbit

  • New Features

    • Introduced MultiModalSynthesizer for enhanced multi-modal query processing, integrating both text and image nodes.
    • Added asynchronous synthesis capabilities with the asynthesize method.
    • Enhanced settings to support multi-modal language models based on specific model configurations.
    • Added support for multimodal indexes with integration into LlamaCloud for versatile data management.
  • Bug Fixes

    • Improved error handling for model support initialization.
  • Documentation

    • Updated import statements and method signatures for clarity and maintainability.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/run-llama/create-llama/pull/453 **Author:** [@leehuwuj](https://github.com/leehuwuj) **Created:** 11/27/2024 **Status:** ✅ Merged **Merged:** 11/29/2024 **Merged by:** [@marcusschiesser](https://github.com/marcusschiesser) **Base:** `main` ← **Head:** `feat/multimodal` --- ### 📝 Commits (10+) - [`fdb4c28`](https://github.com/run-llama/create-llama/commit/fdb4c284dedf375f1817be26922540aefc3fc84b) add support for multimodal - [`1e647c2`](https://github.com/run-llama/create-llama/commit/1e647c22186803faff1101903dfd675f6c7c254c) update code - [`bc8df66`](https://github.com/run-llama/create-llama/commit/bc8df660a11c5d153e50d04141615232d720dfb9) fix wrong signature override - [`9d6f94b`](https://github.com/run-llama/create-llama/commit/9d6f94b97226585a04412444453e5cedc42fc529) bump: chat-ui - [`a40da22`](https://github.com/run-llama/create-llama/commit/a40da22788337cadb14487a0c531892c608d9347) Create lazy-insects-share.md - [`88d2918`](https://github.com/run-llama/create-llama/commit/88d291801fe84284df80dbab481990ffc5e01d70) add MultiModalSynthesizer - [`7431705`](https://github.com/run-llama/create-llama/commit/7431705456d3c2176e9805f6ddaac2abb88429b2) Merge remote-tracking branch 'origin/feat/bump-chat-ui' into feat/multimodal - [`89c3183`](https://github.com/run-llama/create-llama/commit/89c31835d89be2467bfedc244e3de5d27a48fb00) Merge remote-tracking branch 'origin/main' into feat/multimodal - [`fa17d39`](https://github.com/run-llama/create-llama/commit/fa17d39e22832bf0176f7a4b27f4212d2c66f220) add synthesize - [`0ffb7ff`](https://github.com/run-llama/create-llama/commit/0ffb7ff4e1041d4e8b90202be140d50f3519ba36) use getter ### 📊 Changes **3 files changed** (+164 additions, -9 deletions) <details> <summary>View changed files</summary> ➕ `.changeset/blue-hornets-boil.md` (+5 -0) 📝 `templates/components/engines/python/agent/tools/query_engine.py` (+141 -7) 📝 `templates/components/settings/python/settings.py` (+18 -2) </details> ### 📄 Description <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit - **New Features** - Introduced `MultiModalSynthesizer` for enhanced multi-modal query processing, integrating both text and image nodes. - Added asynchronous synthesis capabilities with the `asynthesize` method. - Enhanced settings to support multi-modal language models based on specific model configurations. - Added support for multimodal indexes with integration into LlamaCloud for versatile data management. - **Bug Fixes** - Improved error handling for model support initialization. - **Documentation** - Updated import statements and method signatures for clarity and maintainability. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-15 20:15:07 -05:00
yindo closed this issue 2026-02-15 20:15:07 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/create-llama#514