Design 47 H: H-A-290, the builder's publish queue: live asks first, no publish of a withdrawn build, one listing per pass
This commit is contained in:
@@ -1668,3 +1668,17 @@ Where two preparers disagreed, the chosen one is named.
|
||||
The reads an end needs (widens, the catalog revision, the holders) are made once, before the compare-and-set, and
|
||||
shared by every mover and every retry of the write; a retry rereads only the pipeline's key. P3, P-NATS-native (a
|
||||
write to own state waits on no other part).
|
||||
- **H-A-290 (the builder's publish queue: live asks first, no publish of a withdrawn build, one listing per pass, 18:16)**
|
||||
Met live: the tool runner's release waited forty minutes behind old versions, because the builder's publish queue
|
||||
(a state bucket, one key per holder and version) is worked one version at a time, oldest first, the whole bucket
|
||||
listed and read again before each send (quadratic), and every start asks a publish again for every done build
|
||||
without a release, so old versions ride ahead of the ones a pipeline waits on. In the builder, H1: (1) a publish a
|
||||
pipeline's build step waits on (the build ended in this run) is sent before any publish asked again at a start;
|
||||
within a class, oldest first; (2) a build whose reservation was withdrawn or taken over never publishes: its queued
|
||||
key is dropped and its publish item ended, at enqueue, at the pass, and at the start; (3) a pass lists the holder's
|
||||
keys once, sends them in order and relists only when the list is spent, with the sends of one holder bounded at
|
||||
four at a time; (4) a send that returns without sending says why in the journal; the call bound a send is given is
|
||||
honoured by every call it makes; (5) the publish-queue read tool answers at any size: counts per holder and class,
|
||||
the oldest and newest queue time, a capped list, and an item's class. Owed, H2: the publish queue as a work-queue
|
||||
stream per holder with a pull consumer (no listing), and tools to drop or put first one item. P3, P7, P-NATS-native;
|
||||
tools-are-how-a-module-is-spoken-to; H-A-269, H-A-271, H-A-275.
|
||||
|
||||
Reference in New Issue
Block a user