Claims node-container-runtime (ADR 0207). Owns the packages, the socket and a weekly prune of dangling images and unused build cache. Serves 18 tools over every container, marking the mesh's. daemon.json, docker.service and the docker group are left to a proposed change: dnsmasq and zsh declare them today, and the controller refuses a second declaration (README).
9.0 KiB
docker
The container runtime as a module (novox/hq to-be 42 phase 1, item 8; research 027/01–02; ADR 0166,
ADR 0207). It claims the node seat node-container-runtime. That seat carries no verbs yet: its verbs,
and the host creating containers through its holder, wait on ADR 0166's acceptance. Until then the
tools below are the module's own.
What it declares
| resource | what | the host's rule |
|---|---|---|
package |
docker |
installed if absent; never uninstalled when the module goes |
buildx |
docker-buildx |
the same. Only the build machine has it today; docker build needs it for BuildKit everywhere |
socket |
docker.socket running, enabled at boot |
given back as found when the module goes (ADR 0118) |
prune-service, prune-timer |
/etc/systemd/system/docker-prune.{service,timer}, written whole |
removed with the module |
prune |
docker-prune.timer running, enabled at boot; restarted when either file changes |
stopped and disabled with the module (the mesh made the unit) |
The weekly prune takes dangling images and build cache unused for a week, and nothing else. It takes no volume, no container and no image a container uses, so it never touches a container the mesh holds. It runs at idle priority, at a random point in the hour after the weekly mark. A run missed while the machine was off happens at the next boot.
Capabilities: package-manager, service-manager, privileged. It does not declare
container-runtime: under ADR 0165, which is still proposed, that word means a running daemon, and
the module that installs the daemon cannot require it.
What it does not declare yet, and why
Three things this module should own are already declared by other modules on every machine. The
controller refuses two modules on one node that declare the same path, unit, name or package
(checkResources, mesh-controller internal/catalogue/resolve.go). Declaring any of them here would
make the module unassignable everywhere. The refusals were checked against the controller's own
check:
zsh and docker both declare the name "${machine:account}"
dnsmasq and docker both declare the path "/etc/docker/daemon.json"
dnsmasq and docker both declare the unit "docker.service"
1. /etc/docker/daemon.json and docker.service (issue 190)
Today the file has three writers. Each writes into it (into: json, ADR 0102) and reloads the
service:
dnsmasqwritesdnsandlive-restore, throughdnsmasq.runtime-dnsanddnsmasq.runtime.- The private network, generated by the controller (
internal/overlay/generator.go), writesinsecure-registries. The collision check does not see generated resources. - Nobody writes log rotation. One machine has
log-driverandlog-optsby hand.
The change proposed, in one merge:
-
dnsmasqdrops itsruntime-dnsandruntimeresources. -
dockeradds the two resources below:{"id": "daemon", "type": "file", "path": "/etc/docker/daemon.json", "mode": "0644", "into": "json", "content": "{\"dns\": [\"${machine:address}\"], \"live-restore\": true, \"log-driver\": \"json-file\", \"log-opts\": {\"max-size\": \"100m\", \"max-file\": \"5\"}}\n"}, {"id": "runtime", "type": "service", "unit": "docker.service", "state": "running", "boot": "enabled", "reload-on": ["daemon"]}The service is reloaded, never restarted: a restart stops every container. The daemon reads
live-restoreon a reload. It readsdns,log-driverandlog-optsonly at its next start, so they apply then (to containers created afterwards, for the log keys). Withlive-restoreon, that start keeps every container running.
Why one merge, and only after this module is on every machine:
- In one apply, the host first gives back the resources that are no longer declared, then applies
the new ones (mesh-host
apply.go). dnsmasqgives backdnsandlive-restoreto what they held before it, anddockersets them again in the same apply. The daemon is reloaded once, after both steps.- A machine pushed the new
dnsmasqwithout this module would keep its pre-mesh values for both keys. On one machine that islive-restore: false, and the next daemon restart there would stop every container.
Later: the controller hands the registry to this module as a value, and the overlay stops
generating its two resources (issue 190, steps 2 and 5). Until then the overlay keeps writing its one
key beside this module's. The host merges disjoint keys correctly; the mesh-host into.go record is
per resource.
2. The operator account's membership of the docker group
The right shape is the host's user shape. Its groups are additive: the host runs
usermod --append and never takes a group away.
{"id": "group", "type": "user", "name": "${machine:account}", "groups": ["docker"]}
zsh already declares a user resource for the same account (its login shell). The controller
compares name across modules, so the two collide.
The change proposed (mesh-controller, checkResources): judge a user resource by the fields it
sets, not by its name:
shellandhomestay single-owner;groupsmay be declared by any number of modules, because the host only adds them.
Then this module declares the resource above, and no module has to carry another's group.
Today the operator account is in the group on every machine, by hand. Nothing is lost while it waits.
The bootstrap's runtime
On the machine the mesh was first installed on, the foundation bundle declared package docker
(container-runtime) and docker.service running and enabled (container-runtime-running). ADR 0207
§5 exempts them.
- The host records them under their bare ids, with origin carried. A mesh declaration's orphan pass
never sees them (mesh-host
store.go). - So
docker.packagehere is a second record of the same package. The apply says "already installed", and neither record ever uninstalls it. - This module does not declare
docker.servicetoday, so nothing overlaps there. The proposed step 1 would add a second record of that unit. Its found state is running, because genesis started it, so undeclaring this module would leave the daemon running.
Tools
The tools run as the operator account. If the daemon's socket refuses that account, a call is asked
again through sudo -n (a process keeps the groups it started with). Every call has a 20 s bound.
A failure is an error naming how it failed, never an empty answer.
Every container on the machine is in scope. A container the mesh holds carries the host's label
mesh-host.id (its value names the assignment), and every answer says mesh_held.
| tool | what | |
|---|---|---|
docker_list |
r | every container: image, state, health, restarts, ports, mounts, compose project, mesh_held; filter by owner, state or name |
docker_inspect |
r | one container whole, environment values left out (names kept) |
docker_logs |
r | the last lines of both streams, merged in order, with timestamps (default 200, at most 2000) |
docker_stats |
r | CPU, memory, I/O and process count per running container, heaviest first |
docker_start / docker_stop / docker_restart |
a | one container. On a mesh-held one, the answer says the host restores its declared state at its next apply |
docker_top |
r | the processes inside one container |
docker_images |
r | images, largest first, with the containers using each; dangling, unused or used |
docker_prune |
a | dangling images and build cache, and stopped containers the mesh does not hold if containers is true. A dry run unless dry_run is false. Never a volume |
docker_disk_usage |
r | docker system df -v: total, active and reclaimable per kind, with the largest of each |
docker_networks |
r | networks, subnets, and the containers on each |
docker_volumes |
r | volumes, who mounts each, whether the mesh holds one of them, anonymous or not, and sizes if asked |
docker_events |
r | the runtime's events over a window ending now (default 60 min, at most 24 h), without exec noise |
docker_daemon_config |
r | daemon.json as on disk, docker info's essentials, and keys the daemon has not taken yet |
docker_unlabelled |
r | the containers the mesh does not hold: the cleanup list |
docker_problems |
r | unhealthy, restarting, dead, killed for memory, failed, or restarted five times or more |
docker_ports |
r | every published port, and the containers on the host's network |
Tests
go test ./...
The tests run against a fake runner and cover:
- escalation through
sudo -non a refused socket, and never as root; - each failure named by its cause;
- a name or id never read as an option;
- mesh-held marking;
- the environment left out of
inspect; - the restore note on a mesh-held act;
- prune being a dry run by default and never reaching a volume, a mesh container or
--volumes; - the log merge;
- size parsing;
- what the daemon has not yet taken;
- event filtering;
- volume ownership;
- that the tools served are exactly the manifest's
tools.