local model: an ollama provider + a local-model consumer (ADR 0055) #19

Merged
jschoubben merged 1 commits from feat/local-model into main 2026-09-07 03:26:02 +00:00
Owner

Model access answered by a node, not a licence. ollama runs the model server on host network (0.0.0.0:11434) and provides: [model-access] at node scope, serving its port and model — it mints nothing, so it is server-only (no runtime). local-model-consumer requires model-access, gets the endpoint (no secret), and its templated openai.env carries OPENAI_BASE_URL=http://<at>:<port>/v1 + OPENAI_MODEL. One provision, two answers — the mesh's own model behind the same interface as a vendor's.

Green end to end in the mesh-lab local-model bed. Depends on the mesh-control keyless-same-node-serve fix.

Model access answered by a **node**, not a licence. `ollama` runs the model server on host network (`0.0.0.0:11434`) and `provides: [model-access]` at node scope, serving its port and model — it mints nothing, so it is server-only (no runtime). `local-model-consumer` requires model-access, gets the endpoint (no secret), and its templated `openai.env` carries `OPENAI_BASE_URL=http://<at>:<port>/v1` + `OPENAI_MODEL`. One provision, two answers — the mesh's own model behind the same interface as a vendor's. Green end to end in the mesh-lab local-model bed. Depends on the mesh-control keyless-same-node-serve fix.
jschoubben added 1 commit 2026-09-07 03:25:47 +00:00
Model access answered by a NODE, not a licence. `ollama` runs the model server
on host network (0.0.0.0:11434) and provides model-access at node scope, serving
its port and model — it mints nothing, so it is server-only, no runtime. The
`local-model-consumer` requires model-access, gets the endpoint (no secret), and
its templated openai.env carries OPENAI_BASE_URL=http://<at>:<port>/v1 +
OPENAI_MODEL. One provision, two answers: the mesh's own model behind the same
interface as a vendor's.

Proven end to end by the mesh-lab local-model bed (green).

Claude-Session: https://claude.ai/code/session_01LrgweAeERJYBg88c5cKDzF
jschoubben merged commit e0456746c3 into main 2026-09-07 03:26:02 +00:00
jschoubben deleted branch feat/local-model 2026-09-07 03:26:02 +00:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: novox/mesh-catalog#19