mirror of
https://github.com/open-webui/docs.git
synced 2026-08-24 06:23:58 -04:00
[PR #89] [MERGED] Add tutorial: Local LLM Setup with IPEX-LLM on Intel GPU #215
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/open-webui/docs/pull/89
Author: @Oscilloscope98
Created: 6/3/2024
Status: ✅ Merged
Merged: 6/3/2024
Merged by: @tjbck
Base:
main← Head:ipex-llm📝 Commits (5)
b637d41Add tutorial draft: Local LLM Setup with IPEX-LLM on Intel GPU0b0c908Update for configuration04ef5b5typo fix3bc10aaMerge pull request #2 from Oscilloscope98/ipex-llm-tutorialb4191d9Small typo fixes📊 Changes
1 file changed (+38 additions, -0 deletions)
View changed files
➕
docs/tutorial/ipex_llm.md(+38 -0)📄 Description
IPEX-LLM is a PyTorch library for running LLM on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc A-Series, Flex and Max) with very low latency.
This tutorial demonstrates how to setup Open WebUI with IPEX-LLM accelerated Ollama backend hosted on Intel GPU. By following this guide, you will be able to setup Open WebUI even on a low-cost PC (i.e. only with integrated GPU) with a smooth experience.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.