Open WebUI lets you download and run large language models (LLMs) on your device using Ollama.

Install Ollama

See this guide: https://lemmy.world/post/27013201

Install Docker (recommended Open WebUI installation method)

1. Open Console, type the following command and press return. This may ask for your password but not show you typing it.

 undefined

    
sudo pacman -S docker


  

2. Enable the Docker service [on-device and runs in the background] to start with your device and start it now.

 undefined

    
sudo systemctl enable --now docker


  

3. Allow your current user to use Docker.

 undefined

    
sudo usermod -aG docker $(whoami)


  

4. Log out and log in again, for the previous command to take effect.

Install Open WebUI on Docker

1. Check whether your device has an NVIDIA GPU.
2. Use only one of the following commands.

Your device has an NVIDIA GPU:

 undefined

    
docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda

  

Your device has no NVIDIA GPU:

 undefined

    
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

  

Configure Ollama access

1. Edit the Ollama service file. This uses the text editor set in the $SYSTEMD_EDITOR environment variable.

 undefined

    
sudo systemctl edit ollama.service


  

2. Add the following, save and exit.

 undefined

    
[Service]
Environment="OLLAMA_HOST=0.0.0.0"


  

3. Restart the Ollama service.

 undefined

    
sudo systemctl restart ollama

  

Get automatic updates for Open WebUI (not models, Ollama or Docker)

1. Create a new service file to get updates using Watchtower once everytime Docker starts.

 undefined

    
sudoedit /etc/systemd/system/watchtower-open-webui.service


  

2. Add the following, save and exit.

 undefined

    
[Unit]
Description=Watchtower Open WebUI
After=docker.service
Requires=docker.service

[Service]
Type=oneshot
ExecStart=/usr/bin/docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui
RemainAfterExit=true

[Install]
WantedBy=multi-user.target


  

3. Enable this new service to start with your device and start it now.

 undefined

    
sudo systemctl enable --now watchtower-open-webui


  

4. (Optional) Get updates at regular intervals after Docker has started.

 undefined

    
docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui

  

Use Open WebUI

1. Open localhost:3000 in a web browser.
2. Create an on-device Open WebUI account as shown.