Tutorial 3: Chatbot Web Apps & Interfaces

By Jakub RusinowskiLast updated 5 min readBeginner

While Ollama runs in the terminal, most users prefer a graphical interface (GUI) similar to ChatGPT. Here are the best tools to give your local LLM a friendly face.

1. Open WebUI (formerly Ollama WebUI)

The closest clone to the ChatGPT interface. It connects directly to Ollama.

  • Features: Chat history, code syntax highlighting, voice input, and image generation support.
  • Installation (Docker required):
bash
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main
  • Access: Open http://localhost:3000 in your browser.

2. LM Studio

An all-in-one app that lets you download models and chat with them. Great if you don't want to use the command line at all.

  • Pros: Easy model discovery, visual configuration of GPU offload.
  • Cons: Closed source (but free to use).
  • Download: lmstudio.ai

3. Text-Generation-WebUI (Oobabooga)

The 'Swiss Army Knife' for advanced users. Supports every loader (ExLlamaV2, AutoGPTQ, GGUF).

  • Best for: Testing different quantization formats and extensions.
  • Installation: Clone the repo from GitHub and run the start_windows.bat or start_linux.sh script.

4. Jan.ai

A clean, native desktop application that runs offline. Open source and very beginner-friendly.