Skip to content

fix(llm): turn LiteLLM metrics on for stacks upgraded with obol upgrade - #891

Merged
OisinKyne merged 3 commits into
mainfrom
fix/litellm-metrics-gitleaks
Oct 15, 2026
Merged

OisinKyne merged 3 commits into
mainfrom
fix/litellm-metrics-gitleaks

Conversation

@OisinKyne

Copy link
Copy Markdown
Contributor

� v0.17.1: LiteLLM metrics on upgraded stacks, and finishing the update
�
� - LiteLLM metrics: stacks upgraded from before v0.16 with obol upgrade never gained LiteLLM's Prometheus settings, so /metrics returned 401 and the LLM dashboards were empty. obol upgrade and stack up now add any missing settings to the live config and restart LiteLLM, without overriding operator values.
� - Finishing the update: obolup offers to bring a running stack up to the version it just installed. It asks on a terminal (default yes); without one it only does so with --yes or OBOL_UPGRADE_STACK=true. obol doctor and a one-line notice on other commands flag a stack that the current CLI hasn't brought up yet.
� - Gitleaks: the known false positives are now ignored at the #888 squash commit too.

The base chart keeps an existing stack's live LiteLLM config, so older
stacks only gain the Prometheus settings when obol adds them. Only
`obol stack up` did; `obol upgrade`, which obolup suggested after an
install, never did, so /metrics kept requiring the master key and the
LLM dashboards stayed empty.

- model.EnsureLiveLiteLLMObservability adds the missing settings to the
  live ConfigMap (never overriding operator values) and restarts LiteLLM.
- obol upgrade calls it after syncing the base release; stack up calls it
  when its config snapshot/restore did not run.
- obolup now suggests `obol stack up` for a running stack.
…tack

- `obol stack up` records the obol version that brought the stack up
  ($CONFIG/.stack-version).
- obolup, finding the stack running on an older version, explains what
  restarts and asks to upgrade it now (default yes). Without a terminal it
  only runs with --yes or OBOL_UPGRADE_STACK=true, else prints the command.
- `obol doctor` gains a "Stack version" check, and other commands print a
  one-line notice while the stack has not been brought up by this version
  (not for stack/doctor/version/passthroughs, JSON or --quiet).
@OisinKyne
OisinKyne merged commit 1ceb4cd into main Oct 15, 2026
15 checks passed
@OisinKyne
OisinKyne deleted the fix/litellm-metrics-gitleaks branch October 15, 2026 13:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant