From 55828ceeecb15d73f1b86cc02c5361a4ff7d6c34 Mon Sep 17 00:00:00 2001 From: jochen Date: Sat, 21 Nov 2026 18:03:05 +0100 Subject: [PATCH] Design 47 H: section 10, finding 154 --- .../01-to-be/47-milestones/H-deliver-the-delivery-system.md | 1 + 1 file changed, 1 insertion(+) diff --git a/03-DESIGN/01-to-be/47-milestones/H-deliver-the-delivery-system.md b/03-DESIGN/01-to-be/47-milestones/H-deliver-the-delivery-system.md index 64fb30aa..e02e5514 100644 --- a/03-DESIGN/01-to-be/47-milestones/H-deliver-the-delivery-system.md +++ b/03-DESIGN/01-to-be/47-milestones/H-deliver-the-delivery-system.md @@ -670,3 +670,4 @@ Added by the lead at 21:30 CET, from the run of 19:50 to 21:30; a row met again | The SDK's event hub fix (row 150) merged at 16:51, and its release re-pins 126 modules into one pipeline, the tool runner among them. Every merge of the afternoon moved the tool runner to a newer pipeline before the older one could pass (rows 142 and 147), so the lead holds further merges from 16:52 until the queue runs through to the tool runner's pass; the one approved change still unmerged (row 146) waits on the operator's word. The builder's read-once pack goes onto the build node meanwhile, so the events backlog drains faster (rows 142, 146 and 150); the pipeline runner (`mesh-delivery-pipeline`), the builder and the runbook. | H1 | | The builder was built again against the SDK's hub fix (row 151) and placed on the build node at 16:58 (its read-once pack at 16:52 before it, with no change in the drain rate): the redelivery stopped (two redelivered, against 175 before; nineteen unacknowledged, against the batch of twenty), and the drain rose to about 1.2 messages a second, so the backlog of 2,167 at 17:05 falls under the bound in about half an hour. What remains is about one second of work per event. Each restart of the builder cut one publish in flight, which the loop asking a publish again asked again; the tool runner's release 0.1.40 waits in main.117 on thirteen publishes (rows 149, 150 and 151); the builder. Owed: the cost per event of the builder's published handling, measured and cut. | H1 (the fixes live); H2 (the cost per event) | | Once the builder's backlog had drained (17:19), the tool runner's release could not publish for another reason: the tool runner imports about twenty packages its own pipeline releases, each package's publish re-pins it (H-A-204), each re-pin keeps a revision of the same source, each such revision's pipeline takes it out of the running one (H-A-223), and each newer build withdraws the older before it publishes; its release ran from 0.1.41 to 0.1.48 in nine minutes with none published: a livelock for any module that imports many packages of one pipeline (rows 142, 147 and 152); the pipeline runner (`mesh-delivery-pipeline`) and the indexer (`mesh-delivery-indexer`). Settled by H-A-283 (a re-pin revision of the same source keeps a mover in its pipeline and asks its build again there; only a new source moves movers), in build in the runner. Owed: pins taken from the reservation and confirmed at publish, so a release re-pins once. | H1 (the runner); H2 (the pins) | +| The pipeline runner's fix for the re-pin livelock (row 153) took two review rounds: the first found the placed-again steps' ask ids equal to the ids the runner had just dropped (the build node refuses a dropped id; the work queue dedupes the composition's; a restart found none of them), and a kept mover placed later reading the branch's held view instead of its kept revision. H-A-286 settled both (every ask id of a kept mover carries its kept revision; its entry and pins are read at that revision wherever it is placed or pin-checked), and H-A-287 aligned the rule of one validate: a pipeline has one validate run, which a kept mover's own validate ask joins. Approved at the second round and merged at 18:01 into a pipeline of its own, with its hand pack for the control-node built beside it; merges are held again from then (rows 112 and 153); the pipeline runner (`mesh-delivery-pipeline`). Owed: the runner's unplaced line for a kept mover whose revision is not yet readable. | H1 (the fix); H2 (the line) |