ThothII/.superpowers/sdd/2026-08-08-internal-qdrant-ollama/task-7-report.md

Task 7 report — mandatory Qdrant and Ollama Compose services

Date: 2026-08-08

Status: completed

Summary:

• Added mandatory private qdrant, embedding, and embedding-model-init services to the base Compose stack.
• Pinned Qdrant v1.18.2 and Ollama 0.32.0 by immutable multi-arch digest.
• Persisted Qdrant storage in qdrant-data and Ollama model cache in embedding-models.
• Wired core to fixed internal semantic endpoints:
  • THT_INTERNAL_QDRANT_URL=http://qdrant:6333
  • THT_INTERNAL_EMBEDDING_URL=http://embedding:11434
  • THT_INTERNAL_EMBEDDING_MODEL=qwen3-embedding:0.6b
  • THT_INTERNAL_EMBEDDING_DIMENSIONS=1024
• Removed external vector / embedding endpoint requirements from the local and server env examples.
• Added an idempotent Ollama model bootstrap script that:
  • waits up to a bounded deadline for /api/tags
  • skips ollama pull when the model is already cached
  • pulls qwen3-embedding:0.6b only when needed
  • verifies the model appears in /api/tags after pull
• Added optional GPU override file deploy/compose.embedding-gpu.yaml; base Compose remains CPU-only.
• Updated scripts/run-stack.sh so the GPU override is included only when THOTH_ENABLE_EMBEDDING_GPU=1.

Verification:

• RED confirmed before implementation:
  • ./scripts/test-default-compose.sh failed on missing required services.
  • ./scripts/test-unified-compose.sh failed on missing required services.
  • ./scripts/test-internal-semantic-compose.sh failed because the GPU override file did not exist.
• GREEN after implementation:
  • ./scripts/test-default-compose.sh
  • ./scripts/test-unified-compose.sh
  • ./scripts/test-internal-semantic-compose.sh
  • git diff --check
• Additional shell verification:
  • scripts/run-stack.sh --wait includes only base + local Compose files by default.
  • THOTH_ENABLE_EMBEDDING_GPU=1 scripts/run-stack.sh --wait adds deploy/compose.embedding-gpu.yaml.

Resolved image digests:

• qdrant/qdrant:v1.18.2@sha256:75eab8c4ba42096724fdcfde8b4de0b5713d529dde32f285a1f86fdcb2c9e50c
• ollama/ollama:0.32.0@sha256:57f573b47f1f71ebb445789f279fe3e596a8beab182f7cf486db9205bad87c5a

Self-review:

• The first bootstrap-script draft depended on tools not guaranteed inside the Ollama image. This was corrected after image inspection; the final script uses only confirmed image tools (bash, ollama, grep) plus raw HTTP over /dev/tcp.
• The server overlay intentionally replaces most named core volumes with bind mounts, so the unified contract was tightened to require named semantic-cache volumes there while preserving the local/base named-volume checks.

Concerns:

• The model bootstrap waits for Ollama readiness and verifies cache state, but the first real cold-start will still take time to download qwen3-embedding:0.6b.
• The GPU override requests generic Docker GPU capability only; actual GPU availability remains host/runtime dependent and intentionally stays opt-in.