Skip to content

Files and privacy

Local inference executes the selected model on the host. Model downloads, updates and any external connections are separate operations.

Local files

Item Behavior
Model weights Loaded from the path you supply
Prompt and system files Read from local paths; UTF-8 text input
--output FILE Replaces the named file with the completed response
Image cache Can persist under ~/.spum/cache/images
Optional output history Stored under ~/.spum/history; off by default
AfterGlow output Written to the directory passed to --output

--no-image-cache prevents persistent image caching for the current invocation. It does not remove previously cached images. spum history clear removes saved engine history, not model files or the image cache.

spum run model.gguf --gpu --image image.jpg \
  --mmproj projector.gguf --no-image-cache --history off \
  -p "Describe the visible structures."

CLI JSON output and text exports may themselves contain sensitive information. Choose their storage and retention policies deliberately. Local execution does not automatically provide encryption, user access management or compliance certification.

Services

The HTTP server defaults to loopback. Spum Link uses explicitly started helper processes and a pairing key. Do not publish pairing keys or private prompt files in issue reports. Share a minimal reproducible example without patient data when reporting a problem.