Files
Dolon (Agent)andClaude Opus 5 3155d4a230 forgeway 0.1.1 — per-cluster OpenAI-compatible LLM router
Two endpoints over forge's Ollama gpt-oss:120b:
  /local-optimistic/v1  forge, else cloud gpt-5.4-mini
  /local-strict/v1      forge, else a clean 503 the caller handles

Discovery, not configuration: each instance probes an ordered candidate list
(stable DNS name, then the Lounge and future Serenity literals) concurrently but
in priority order, so the happy path is one round trip and silicon's move to
Serenity needs no rewrite.

/healthz runs a real 1-token completion — forge can be up with Ollama stopped.
Liveness/readiness are deliberately NOT forge-gated: otherwise k8s would evict
the pods during an outage and callers would get a connection failure instead of
the promised 503, and Kuma could not tell "forge down" from "router gone".

max_tokens/max_completion_tokens are translated per backend: Ollama accepts only
the former, gpt-5.4-mini rejects it outright.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-18 14:30:14 +00:00

28 lines
1.2 KiB
JSON

[
{
"op": "add",
"key": "forgeway — local LLM router (Lounge)|http|http://172.19.10.90/healthz",
"monitor": {
"name": "forgeway — local LLM router (Lounge)",
"type": "http",
"url": "http://172.19.10.90/healthz",
"method": "GET",
"parent": 302,
"active": true,
"interval": 60,
"retryInterval": 60,
"resendInterval": 0,
"maxretries": 2,
"timeout": 48,
"maxredirects": 0,
"ignoreTls": false,
"upsideDown": false,
"expiryNotification": false,
"accepted_statuscodes": [
"200-299"
],
"description": "Active probe of the LOCAL forgeway instance (172.19.10.90). /healthz runs a real 1-token completion against forge's gpt-oss:120b, not a ping: forge can be up with Ollama stopped.\n\n200 = forge answered. 503 = forge did not (local-strict is returning 503 to callers; local-optimistic is serving from gpt-5.4-mini). No response at all = the router itself is gone.\n\nTimeout is 48 s because a cold gpt-oss:120b load takes ~25-30 s and is a legitimate success.\n\nPAUSE THIS MONITOR before an ai-toolkit LoRA run on forge: a 60 s probe interval keeps the 67 GB model resident on card 1, which collides with training.",
"conditions": []
}
}
]