run-llama/llama_deploy
1
0
Fork 0
mirror of https://github.com/run-llama/llama_deploy.git synced 2026-08-24 21:01:26 -04:00
Code Issues 37 Packages Projects Releases 10 Wiki Activity

[PR #148] [MERGED] Add KafkaMessageQueue #293

New Issue
Closed
opened 2026-02-16 01:16:46 -05:00 by yindo · 0 comments
yindo commented 2026-02-16 01:16:46 -05:00
Owner
Copy Link
Copy Source

📋 Pull Request Information

Original PR: https://github.com/run-llama/llama_deploy/pull/148
Author: @nerdai
Created: 7/20/2024
Status: ✅ Merged
Merged: 7/21/2024
Merged by: @nerdai

Base: main ← Head: nerdai/kafka

📝 Commits (10+)

📊 Changes

29 files changed (+1497 additions, -3 deletions)

View changed files

➕ examples/kafka/README.md (+183 -0)
➕ examples/kafka/pig-latin-translation/.gitignore (+11 -0)
➕ examples/kafka/pig-latin-translation/Dockerfile (+49 -0)
➕ examples/kafka/pig-latin-translation/README.md (+1 -0)
➕ examples/kafka/pig-latin-translation/docker-compose.yml (+142 -0)
➕ examples/kafka/pig-latin-translation/logging.ini (+18 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/__init__.py (+0 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/__init__.py (+0 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/human_consumer.py (+46 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/task_result.py (+89 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/__init__.py (+0 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/correct_first_character_agent.py (+106 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/decorators.py (+69 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/remove_ay_agent.py (+115 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/core_services/__init__.py (+0 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/core_services/control_plane.py (+71 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/core_services/message_queue.py (+10 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/local_launcher.py (+26 -0)
➕ examples/kafka/pig-latin-translation/pig_latin_translation/utils.py (+9 -0)
➕ examples/kafka/pig-latin-translation/pyproject.toml (+17 -0)

...and 9 more files

📄 Description

This PR adds the KafkaMessageQueue which is the integration for Apache Kafka.

  • It uses a combination of kafka-python-ng (the up-to-date fork of kafka-python) as well as aiokafka from the same folks who produced aiohttp.
  • Adds an examples in the examples/kafka folder that contain:
    • Single local launch using KafkaMessageQueue
    • Without Docker launch using KafkaMessageQueue
    • With Docker launch using KafkaMessageQueue

closes #144

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/run-llama/llama_deploy/pull/148 **Author:** [@nerdai](https://github.com/nerdai) **Created:** 7/20/2024 **Status:** ✅ Merged **Merged:** 7/21/2024 **Merged by:** [@nerdai](https://github.com/nerdai) **Base:** `main` ← **Head:** `nerdai/kafka` --- ### 📝 Commits (10+) - [`e87aa69`](https://github.com/run-llama/llama_deploy/commit/e87aa69b7887af035406508bd38bf3c1aebc0661) Bump certifi from 2024.6.2 to 2024.7.4 (#108) - [`29f33de`](https://github.com/run-llama/llama_deploy/commit/29f33deb8067542772b55a06fc7d0214f76c7a9b) Bump certifi from 2024.6.2 to 2024.7.4 (#108) - [`fa11f21`](https://github.com/run-llama/llama_deploy/commit/fa11f218d621ebc61e99a812c17c84be9a2fc78b) kafka dep aiokafka - [`c91c7a8`](https://github.com/run-llama/llama_deploy/commit/c91c7a8298f0a6cb59bdc2c7632c9b813fd34cea) start KafkaMessageQueue and impl create topic - [`9298490`](https://github.com/run-llama/llama_deploy/commit/9298490c5a81d35edabee30103def451f82bbf8a) todo note - [`0497f10`](https://github.com/run-llama/llama_deploy/commit/0497f10aaa808a3605c38c3b839551d2a408fa95) register consumer - [`cf9f92d`](https://github.com/run-llama/llama_deploy/commit/cf9f92df87ed52b31a93f70e10db5e6f879469d9) return start consuming callble - [`43a8970`](https://github.com/run-llama/llama_deploy/commit/43a8970bb621f81f6f1c2b3bf283ae530a27853d) bug - [`cced712`](https://github.com/run-llama/llama_deploy/commit/cced7127140f6e3cf90a4c06802d7af5c6b0f541) clean up delete topics - [`13f5d5d`](https://github.com/run-llama/llama_deploy/commit/13f5d5d741908f1e5f9fb349f4723523a6ab2ad2) functional ### 📊 Changes **29 files changed** (+1497 additions, -3 deletions) <details> <summary>View changed files</summary> ➕ `examples/kafka/README.md` (+183 -0) ➕ `examples/kafka/pig-latin-translation/.gitignore` (+11 -0) ➕ `examples/kafka/pig-latin-translation/Dockerfile` (+49 -0) ➕ `examples/kafka/pig-latin-translation/README.md` (+1 -0) ➕ `examples/kafka/pig-latin-translation/docker-compose.yml` (+142 -0) ➕ `examples/kafka/pig-latin-translation/logging.ini` (+18 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/__init__.py` (+0 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/__init__.py` (+0 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/human_consumer.py` (+46 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/additional_services/task_result.py` (+89 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/__init__.py` (+0 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/correct_first_character_agent.py` (+106 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/decorators.py` (+69 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/agent_services/remove_ay_agent.py` (+115 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/core_services/__init__.py` (+0 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/core_services/control_plane.py` (+71 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/core_services/message_queue.py` (+10 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/local_launcher.py` (+26 -0) ➕ `examples/kafka/pig-latin-translation/pig_latin_translation/utils.py` (+9 -0) ➕ `examples/kafka/pig-latin-translation/pyproject.toml` (+17 -0) _...and 9 more files_ </details> ### 📄 Description This PR adds the `KafkaMessageQueue` which is the integration for Apache Kafka. - It uses a combination of `kafka-python-ng` (the up-to-date fork of `kafka-python`) as well as `aiokafka` from the same folks who produced `aiohttp`. - Adds an examples in the `examples/kafka` folder that contain: - Single local launch using `KafkaMessageQueue` - Without Docker launch using `KafkaMessageQueue` - With Docker launch using `KafkaMessageQueue` closes #144 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 01:16:46 -05:00
yindo closed this issue 2026-02-16 01:16:46 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
P0
P1
P2
bug
documentation
documentation
enhancement
example
good first issue
invalid
pull-request
Mirrored from GitHub Pull Request
 question
topic:CLI
topic:SDK
topic:SDK
topic:SDK
topic:apiserver
topic:control_plane
topic:message_queues
wontfix
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
yindo
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_deploy#293
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?