[PR #55] [CLOSED] Testing repeated calls #346

Closed
opened 2026-02-15 16:30:04 -05:00 by yindo · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama-python/pull/55
Author: @stevengans
Created: 2/6/2024
Status: Closed

Base: mainHead: main


📄 Description

Based on this issue: https://github.com/ollama/ollama/issues/2339

Script runs 4 tests.

  • 100 ollama.generate calls
  • 100 ollama.chat calls
  • 45 minute loop of ollama.generate calls
  • 45 minute loop of ollama.chat

Findings

  • On M3 Max 128GB 100 calls of either ollama.generate or ollama.chat doesn't cause hang. This is due to the speed in which the system completes the task in under 30 minutes.
  • On M3 Max 128GB 45 minutes of repeated calls of either ollama.generate or ollama.chat causes a hang. The issue (https://github.com/ollama/ollama/issues/2339) likely had the 100 calls take 30+ minutes with their system.
  • On M3 Max 128GB tested 30 minute loops and it failed 3/4 tests. Not sure why 1/4 passed - increased loop to 45 minutes in tests for reproducible hang.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama-python/pull/55 **Author:** [@stevengans](https://github.com/stevengans) **Created:** 2/6/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `main` --- ### 📄 Description Based on this issue: https://github.com/ollama/ollama/issues/2339 Script runs 4 tests. - 100 ollama.generate calls - 100 ollama.chat calls - 45 minute loop of ollama.generate calls - 45 minute loop of ollama.chat Findings - On M3 Max 128GB 100 calls of either ollama.generate or ollama.chat doesn't cause hang. This is due to the speed in which the system completes the task in under 30 minutes. - On M3 Max 128GB 45 minutes of repeated calls of either ollama.generate or ollama.chat causes a hang. The issue (https://github.com/ollama/ollama/issues/2339) likely had the 100 calls take 30+ minutes with their system. - On M3 Max 128GB tested 30 minute loops and it failed 3/4 tests. Not sure why 1/4 passed - increased loop to 45 minutes in tests for reproducible hang. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
yindo added the pull-request label 2026-02-15 16:30:04 -05:00
yindo closed this issue 2026-02-15 16:30:04 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ollama/ollama-python#346