The runner hears a take-in on its own durable and acknowledges a late event of an ended ask at once; a held key-ttl state gets per-message TTL (design 47 H2 H-A-500, H-A-501) #339

Merged
mesh-tools merged 7 commits from fix/runner-consumer-ttl into main 2026-11-22 22:07:32 +00:00
Member

Design 47 H2, lead answers H-A-500 with its addenda (1)-(2), third, fourth and fifth addendum, and H-A-501 corrected (hq design/47-H1-answers-59, pull request #797, commits 8e2035d3, 600fa295, 0a6e9527).

Runner (mesh-delivery-pipeline): the test-runs state keeps an ask.<ask> key per run, created with the run and deleted with it (also by the Ager); a late event of an ended ask is acknowledged at once from that key. The runner hears take-in.taken on its own durable <node>_<module>_takeins on EVENTS, bound at its start and again on each registration-changed event (no timer); until the bind, the main durable works each take-in, from the bind it acknowledges those the takeins durable delivers (stream sequence boundary).
Grants (mesh-grants): a held bucket of a key-ttl state gets per-message TTL (add-only, once per manifest); every module principal, on its own account or carried by a tool runner, is granted CONSUMER.CREATE, CONSUMER.INFO, MSG.NEXT and ACK of its takeins durable.

Review: two rounds, mesh-code-reviewer. Suites: go vet at both levels, unit suites of both modules, the runner's and grants' integration tests, all pass at the head.

Reviewed-by: mesh-code-reviewer@shanks at a8240f5549

Design 47 H2, lead answers H-A-500 with its addenda (1)-(2), third, fourth and fifth addendum, and H-A-501 corrected (hq design/47-H1-answers-59, pull request #797, commits 8e2035d3, 600fa295, 0a6e9527). Runner (mesh-delivery-pipeline): the test-runs state keeps an `ask.<ask>` key per run, created with the run and deleted with it (also by the Ager); a late event of an ended ask is acknowledged at once from that key. The runner hears take-in.taken on its own durable `<node>_<module>_takeins` on EVENTS, bound at its start and again on each registration-changed event (no timer); until the bind, the main durable works each take-in, from the bind it acknowledges those the takeins durable delivers (stream sequence boundary). Grants (mesh-grants): a held bucket of a key-ttl state gets per-message TTL (add-only, once per manifest); every module principal, on its own account or carried by a tool runner, is granted CONSUMER.CREATE, CONSUMER.INFO, MSG.NEXT and ACK of its takeins durable. Review: two rounds, mesh-code-reviewer. Suites: go vet at both levels, unit suites of both modules, the runner's and grants' integration tests, all pass at the head. Reviewed-by: mesh-code-reviewer@shanks at a8240f55491a5e822b12e70488f0ac8f8c1f2684
mesh-tools added 7 commits 2026-11-22 22:07:13 +00:00
Every ask-taken and step-progress listed and read every pipeline to find its
test run, so after a cancel hundreds of late events of ended runs cost one to
two seconds each and held the runner's one event consumer for minutes. The
state test-runs now keeps an ask key ask.<ask> holding the run's key, written
with each ask a run is given and deleted with the run; an event of an ended
run's ask is judged from that key and the run alone and acknowledged at once,
one journal line per hundred.

Builds: design 47 H2 H-A-500 (a) and its addenda (1)
The indexer's state heard is declared key-ttl, but its bucket was made before
that declaration, and grants' handling of a held stream only added subjects,
raised caps and moved a source filter: every version-reserved the indexer
kept with a time to live was refused (per-message TTL is disabled, 10166) and
given up after five tries. A held bucket whose state is declared key-ttl now
has per-message time to live turned on, add-only like the cap raise, once per
manifest, and said as asserted; the indexer's TTL stays.

Builds: design 47 H2 H-A-501 (corrected)
A module that hears take-in.taken behind a long run of other events hears it
late; it now hears it on a durable of its own, <node>_<module>_takeins, which
it makes itself. Every module principal, on its own account or carried by a
tool runner, is granted the create, information, pull and acknowledgement of
that one name on EVENTS, none special-cased.

Builds: design 47 H2 H-A-500 (b) and its addenda (2), third addendum (Q1)
The runner heard every event on one serial durable, so a take-in waited behind
hundreds of late step events and its pipeline started ten minutes late. The
runner now makes its own durable <node>_<module>_takeins on EVENTS, filtered
to take-in.taken, and acts on a take-in there alone; the main durable
acknowledges a take-in at once with no work. The test-runs integration test
keeps the runner's findings on their own stream, as the manifest declares:
on EVENTS each reached the main durable unhandled and wrote event-unhandled
again, a flood the take-in now overtakes.

Builds: design 47 H2 H-A-500 (b) and its addenda (2), third addendum (Q2)
The takeins durable delivers from the moment it is made, so a take-in said
while the runner was down reached only the main durable, which acknowledged
it with no work: that take-in started no pipeline. Until the takeins durable
is bound, the main durable now works each take-in.taken; from the bind, it
acknowledges with no work those the takeins durable delivers, told apart by
the stream sequence the durable delivers after, so a take-in still waiting on
the main durable is worked whatever the moment it is heard.

Builds: design 47 H2 H-A-500 fourth addendum
The ask key ask.<ask> is created with the run and deleted with it, but the
Ager deleted an aged run and left its ask keys in test-runs for good; only a
run whose last reader left lost them. The Ager now holds the run clock and
unmarks the aged run's ask keys as the Hearer does.

Builds: design 47 H2 H-A-500 addenda (1)
A takeins bind that failed was tried again every five seconds. Nothing in the
mesh waits on a timer for another part: the runner binds its takeins durable
at its start and again on each registration-changed, as the indexer binds a
branch's consumer, and says each failed bind; until bound, the main durable
works each take-in.

Builds: design 47 H2 H-A-500 fifth addendum
mesh-tools merged commit 29c4673ad1 into main 2026-11-22 22:07:32 +00:00
mesh-tools deleted branch fix/runner-consumer-ttl 2026-11-22 22:07:33 +00:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: novox/mesh-delivery#339