[PR #462] [MERGED] feat: use Prometheus to publish API Server metrics #479

Closed
opened 2026-02-16 02:15:03 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/run-llama/llama_deploy/pull/462
Author: @masci
Created: 2/13/2025
Status: Merged
Merged: 2/13/2025
Merged by: @masci

Base: mainHead: massi/o11y


📝 Commits (2)

  • 78364d5 add prometheus client
  • 4f48558 feat: use Prometheus to publish API Server metrics

📊 Changes

6 files changed (+40 additions, -2 deletions)

View changed files

📝 docker/run_apiserver.py (+5 -0)
📝 docker/run_autodeploy.py (+6 -1)
📝 llama_deploy/apiserver/__main__.py (+5 -0)
📝 llama_deploy/apiserver/settings.py (+8 -0)
📝 poetry.lock (+15 -1)
📝 pyproject.toml (+1 -0)

📄 Description

In preparation of providing proper observability for the whole LlamaDeploy system, this PR introduces the use of Prometheus to collect and expose metrics. The Prometheus server is enable by default but can be disabled setting the environment variable LLAMA_DEPLOY_APISERVER_PROMETHEUS_ENABLED=false.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/run-llama/llama_deploy/pull/462 **Author:** [@masci](https://github.com/masci) **Created:** 2/13/2025 **Status:** ✅ Merged **Merged:** 2/13/2025 **Merged by:** [@masci](https://github.com/masci) **Base:** `main` ← **Head:** `massi/o11y` --- ### 📝 Commits (2) - [`78364d5`](https://github.com/run-llama/llama_deploy/commit/78364d5eabf64beaae4aec7752c138a7db9316b1) add prometheus client - [`4f48558`](https://github.com/run-llama/llama_deploy/commit/4f4855811544ccc11f9c3b4e64c0724b402ecb23) feat: use Prometheus to publish API Server metrics ### 📊 Changes **6 files changed** (+40 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `docker/run_apiserver.py` (+5 -0) 📝 `docker/run_autodeploy.py` (+6 -1) 📝 `llama_deploy/apiserver/__main__.py` (+5 -0) 📝 `llama_deploy/apiserver/settings.py` (+8 -0) 📝 `poetry.lock` (+15 -1) 📝 `pyproject.toml` (+1 -0) </details> ### 📄 Description In preparation of providing proper observability for the whole LlamaDeploy system, this PR introduces the use of Prometheus to collect and expose metrics. The Prometheus server is enable by default but can be disabled setting the environment variable `LLAMA_DEPLOY_APISERVER_PROMETHEUS_ENABLED=false`. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-16 02:15:03 -05:00
yindo closed this issue 2026-02-16 02:15:03 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: run-llama/llama_deploy#479