References

Notes

You should spawn ollama first and download the respective LLM models:

# spawn ollama
docker compose up -d ollama

# download an llm model
docker exec ollama ollama run llama3:8b

Afterwards, we can spawn Open WebUI and register our first user account:

# spawn ui
docker compose up -d ui

Finally, we may want to disable open user registration for Open WebUI by uncommenting the env ENABLE_SIGNUP variable and restarting the container.

[!TIP]

You likely want to pass a GPU into the Ollama container. Please read this.