Issue 306: a check on the control node ran past its timeout #191

2026-10-08T08:21:56Z

mesh-admin commented

2026-10-08 08:21:56 +00:00

Registers issue 306, located, with the fix in novox/mesh-controller PR #133.

The packages that never touch a store run equally fast on every holder. The store-bound packages run five to seven times slower on the control node. Every controller check that landed there ran past the suite's 30-minute timeout.
Cause: the throwaway store runs with full durability, and its flushes go to a disk the mesh's own store, bus and forge keep busy. It wrote 16-20 GB per check.
Also: a holder recreated mid-check left its store and bus running, and the redelivery went to another machine. Eleven pairs were left across the four machines.

The 19-21 minutes "in flight" were several deliveries of the same check, each ended by a plan recreating the build agent.

Registers issue 306, located, with the fix in novox/mesh-controller PR #133. - The packages that never touch a store run equally fast on every holder. The store-bound packages run five to seven times slower on the control node. Every controller check that landed there ran past the suite's 30-minute timeout. - Cause: the throwaway store runs with full durability, and its flushes go to a disk the mesh's own store, bus and forge keep busy. It wrote 16-20 GB per check. - Also: a holder recreated mid-check left its store and bus running, and the redelivery went to another machine. Eleven pairs were left across the four machines. The 19-21 minutes "in flight" were several deliveries of the same check, each ended by a plan recreating the build agent.

mesh-admin added 1 commit 2026-10-08 08:21:56 +00:00

Issue 306: a check on the control node ran past its timeout

mesh/merge-gate pass: the change touches no module of the mesh's graph

Details

mesh/repo-check pass: its merge-check.sh passed

Details

mesh/delivery delivered

Details

db0fea6067

Store-bound packages ran five to seven times slower there while the rest
ran alike: the throwaway store flushes to a disk the mesh's own data keeps
busy. And a holder recreated mid-check left its store and bus running.

mesh-admin commented

2026-10-08 08:22:22 +00:00

Delivery novox/hq@db0fea6067ba — delivered since 2026-10-08T08:35:43Z

Delivery plan — builds nothing: the change touches no module of the mesh's graph

Transitions

2026-10-08 08:22 (new) → proposed (announced): novox/hq#191's head announced
2026-10-08 08:23 proposed → checked (checked): the verdict names this commit
2026-10-08 08:23 checked → ready (accepted): the gate passed or warned, and the repository's own check did not fail
2026-10-08 08:35 ready → published (merged): on the trunk its modules follow: merged there, and its walk opened — or nothing for a walk to move
2026-10-08 08:35 published → delivered (done): nothing for a walk to move

The commit's note under refs/notes/mesh-plan keeps every transition: git log --notes=mesh-plan.

**Delivery** `novox/hq@db0fea6067ba` — **delivered** since 2026-10-08T08:35:43Z **Delivery plan** — builds nothing: the change touches no module of the mesh's graph **Transitions** - 2026-10-08 08:22 (new) → proposed (announced): novox/hq#191's head announced - 2026-10-08 08:23 proposed → checked (checked): the verdict names this commit - 2026-10-08 08:23 checked → ready (accepted): the gate passed or warned, and the repository's own check did not fail - 2026-10-08 08:35 ready → published (merged): on the trunk its modules follow: merged there, and its walk opened — or nothing for a walk to move - 2026-10-08 08:35 published → delivered (done): nothing for a walk to move The commit's note under `refs/notes/mesh-plan` keeps every transition: `git log --notes=mesh-plan`.

mesh-admin merged commit fcb76ca29d into main

2026-10-08 08:35:00 +00:00

mesh-admin deleted branch issues/306-a-check-on-the-control-node-ran-past-its-timeout

2026-10-08 08:35:01 +00:00

mesh-tools referenced this pull request

2026-11-13 10:35:12 +00:00

Design 47 G: A-343 to A-348, the third reader release before G #603

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: novox/hq#191