pipeline runner: a step-log read never waits for a batch it cannot fill #241

Merged
mesh-tools merged 1 commits from fix/47-G-runner-ends into main 2026-11-17 09:40:11 +00:00
Member

Live 2026-11-17 ~10:30: the runner took the seat mesh-wants' step-ended one every 1.5-6 minutes. stepLog.Read (cmd/mesh-delivery-pipeline/aged.go) pulled Fetch(20, FetchMaxWait 2s); Hearer.OnStepEnded calls Ager.Age, which reads three retentions, so each end waited about 6 s when fewer than 20 entries were past the pointer. The read now clamps its batch to what the log holds past max(from, FirstSeq): the same entries, without the wait (design 47 G §75; principle 3).

Test: TestStepLogReadDoesNotWaitForABatchItCannotFill fails on the old code (11 entries in 2.0 s) and passes. vet, vet -tags integration, go test ./... pass; the runner has 66 unit and 2 integration tests.

Quick vs thorough: thorough for the read (no batch waits); the live lag is read again after delivery (if it stays, Widens and Failures are timed next).

Reviewed-by: mesh-code-reviewer for lead-47@shanks at 8d93c3ff9f (round 1)

Live 2026-11-17 ~10:30: the runner took the seat mesh-wants' step-ended one every 1.5-6 minutes. stepLog.Read (cmd/mesh-delivery-pipeline/aged.go) pulled Fetch(20, FetchMaxWait 2s); Hearer.OnStepEnded calls Ager.Age, which reads three retentions, so each end waited about 6 s when fewer than 20 entries were past the pointer. The read now clamps its batch to what the log holds past max(from, FirstSeq): the same entries, without the wait (design 47 G §75; principle 3). Test: TestStepLogReadDoesNotWaitForABatchItCannotFill fails on the old code (11 entries in 2.0 s) and passes. vet, vet -tags integration, go test ./... pass; the runner has 66 unit and 2 integration tests. Quick vs thorough: thorough for the read (no batch waits); the live lag is read again after delivery (if it stays, Widens and Failures are timed next). Reviewed-by: mesh-code-reviewer for lead-47@shanks at 8d93c3ff9f743f475b4520a089f56777f581fcd3 (round 1)
mesh-tools added 1 commit 2026-11-17 09:40:07 +00:00
Every step's end waited 2 s per retention (6 s) in the step log's Fetch when fewer than 20 entries lay past the aged pointer, so ends were taken one in 6 s serially.

Builds: design 47 G §330 (ageing of the runner's own data at each step's end)
mesh-tools merged commit 6bb6452603 into main 2026-11-17 09:40:11 +00:00
mesh-tools deleted branch fix/47-G-runner-ends 2026-11-17 09:40:11 +00:00
Author
Member

{
"records": [
{
"instance": "record/main_1004_51af09b8/6a3a2b567c5cfd3b",
"sequence": 9781,
"bytes": 5770,
"of-bytes": 262144,
"waits": "its difference is not known yet",
"record": {
"milestone": "main.1004",
"heads": {
"novox/mesh-delivery@241": "6bb645260353b92ab9304f33a9413be450b42dec"
},
"opened": "2026-11-17T13:19:50.782366936Z",
"form": 1,
"group": {
"group": "",
"members": [
"novox/mesh-catalog@698",
"novox/mesh-delivery@244",
"novox/mesh-host@235"
],
"pulls": [
{
"repository": "novox/mesh-delivery",
"number": 241,
"head": "6bb645260353b92ab9304f33a9413be450b42dec",
"state": "merged",
"commit": "6bb645260353b92ab9304f33a9413be450b42dec"
}
]
},
"entries": {
"artifact-store-tools|src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c|": {
"key": "artifact-store-tools|src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c|",
"module": "artifact-store-tools",
"fingerprint": "src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c"
},
"mesh-build-go|src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a|": {
"key": "mesh-build-go|src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a|",
"module": "mesh-build-go",
"fingerprint": "src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a"
},
"mesh-conditions|src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026|": {
"key": "mesh-conditions|src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026|",
"module": "mesh-conditions",
"fingerprint": "src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026"
},
"mesh-config|src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc|": {
"key": "mesh-config|src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc|",
"module": "mesh-config",
"fingerprint": "src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc"
},
"mesh-delivery-assigner|src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e|": {
"key": "mesh-delivery-assigner|src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e|",
"module": "mesh-delivery-assigner",
"fingerprint": "src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e"
},
"mesh-delivery-builder|src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6|": {
"key": "mesh-delivery-builder|src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6|",
"module": "mesh-delivery-builder",
"fingerprint": "src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6"
},
"mesh-delivery-checker|src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849|": {
"key": "mesh-delivery-checker|src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849|",
"module": "mesh-delivery-checker",
"fingerprint": "src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849"
},
"mesh-delivery-gate|src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96|": {
"key": "mesh-delivery-gate|src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96|",
"module": "mesh-delivery-gate",
"fingerprint": "src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96"
},
"mesh-delivery-pipeline|src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957|": {
"key": "mesh-delivery-pipeline|src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957|",
"module": "mesh-delivery-pipeline",
"fingerprint": "src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957"
},
"mesh-delivery-sdk|src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e|": {
"key": "mesh-delivery-sdk|src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e|",
"module": "mesh-delivery-sdk",
"fingerprint": "src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e"
},
"mesh-delivery-teller|src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1|": {
"key": "mesh-delivery-teller|src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1|",
"module": "mesh-delivery-teller",
"fingerprint": "src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1"
},
"mesh-delivery-view|src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2|": {
"key": "mesh-delivery-view|src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2|",
"module": "mesh-delivery-view",
"fingerprint": "src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2"
},
"mesh-delivery-watchman|src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2|": {
"key": "mesh-delivery-watchman|src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2|",
"module": "mesh-delivery-watchman",
"fingerprint": "src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2"
},
"mesh-grants|src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3|": {
"key": "mesh-grants|src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3|",
"module": "mesh-grants",
"fingerprint": "src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3"
},
"mesh-host|src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d|": {
"key": "mesh-host|src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d|",
"module": "mesh-host",
"fingerprint": "src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d"
},
"mesh-provisioner|src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe|": {
"key": "mesh-provisioner|src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe|",
"module": "mesh-provisioner",
"fingerprint": "src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe"
}
},
"outcomes": {
"|||take-in": {
"key": "|||take-in",
"module": "",
"step": "take-in",
"outcome": "taken-in",
"why": "lead-47@shanks: validation try 10 accepted the revision at 14:17; it waits for indexer build c07c2499, whose code (main 4b75791d) runs on novox since 13:27, placed by hand (pack45) under its old fingerprint e34efaac from the hand drop-in, so the named build can never be seen to run",
"at": "2026-11-17T13:19:50.781371455Z"
}
}
}
}
]
}

<!-- mesh-delivery:view --> { "records": [ { "instance": "record/main_1004_51af09b8/6a3a2b567c5cfd3b", "sequence": 9781, "bytes": 5770, "of-bytes": 262144, "waits": "its difference is not known yet", "record": { "milestone": "main.1004", "heads": { "novox/mesh-delivery@241": "6bb645260353b92ab9304f33a9413be450b42dec" }, "opened": "2026-11-17T13:19:50.782366936Z", "form": 1, "group": { "group": "", "members": [ "novox/mesh-catalog@698", "novox/mesh-delivery@244", "novox/mesh-host@235" ], "pulls": [ { "repository": "novox/mesh-delivery", "number": 241, "head": "6bb645260353b92ab9304f33a9413be450b42dec", "state": "merged", "commit": "6bb645260353b92ab9304f33a9413be450b42dec" } ] }, "entries": { "artifact-store-tools|src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c|": { "key": "artifact-store-tools|src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c|", "module": "artifact-store-tools", "fingerprint": "src2:ef84e753a0ff0e51be6ab3de3a3e79fe3c98173496c4ce927bdc1e436ee6346c" }, "mesh-build-go|src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a|": { "key": "mesh-build-go|src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a|", "module": "mesh-build-go", "fingerprint": "src2:eeb00d135f0163a5cd5dda5d08175aea03a8a66d87ab909f2a4553253e35270a" }, "mesh-conditions|src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026|": { "key": "mesh-conditions|src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026|", "module": "mesh-conditions", "fingerprint": "src2:6f8daed461f270ef6ddbe7f10175aae5f9909110b1cd0090f025895cdaa1a026" }, "mesh-config|src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc|": { "key": "mesh-config|src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc|", "module": "mesh-config", "fingerprint": "src2:229acf6934c50ce2691909516c36c9a2c277c1e9001481be6cf5ab009723f9cc" }, "mesh-delivery-assigner|src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e|": { "key": "mesh-delivery-assigner|src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e|", "module": "mesh-delivery-assigner", "fingerprint": "src2:a2a1ad190a64aac37e172eefebf53ca17d0cd60702e14a09a0c42fe8790cee8e" }, "mesh-delivery-builder|src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6|": { "key": "mesh-delivery-builder|src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6|", "module": "mesh-delivery-builder", "fingerprint": "src2:f03e63c2ee3f3576d08c2282a7abb3efa0a4e320df745d3566755c8110d3cbe6" }, "mesh-delivery-checker|src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849|": { "key": "mesh-delivery-checker|src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849|", "module": "mesh-delivery-checker", "fingerprint": "src2:7916b9b70c8cb290d1aef06ce1274595e97309c76dfbbbd3c92cc636b820c849" }, "mesh-delivery-gate|src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96|": { "key": "mesh-delivery-gate|src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96|", "module": "mesh-delivery-gate", "fingerprint": "src2:23cb0641b8ac9f3bdedb492ab1dab9956bce1f23992b3d004e0b88272702da96" }, "mesh-delivery-pipeline|src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957|": { "key": "mesh-delivery-pipeline|src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957|", "module": "mesh-delivery-pipeline", "fingerprint": "src2:42dc46e4605b9f1fdcfb1d4e5eb43eec7d02e5b4ee20f5a206b633ff549fd957" }, "mesh-delivery-sdk|src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e|": { "key": "mesh-delivery-sdk|src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e|", "module": "mesh-delivery-sdk", "fingerprint": "src2:ef81c903e9692ae12cb36d8f2f53e19c45a9ee7356df0b340f7545a835ac1e7e" }, "mesh-delivery-teller|src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1|": { "key": "mesh-delivery-teller|src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1|", "module": "mesh-delivery-teller", "fingerprint": "src2:f8cf8284b0c7222ce85f68a959dda992a0e1983f220a0a176cdcaa28103f6bf1" }, "mesh-delivery-view|src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2|": { "key": "mesh-delivery-view|src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2|", "module": "mesh-delivery-view", "fingerprint": "src2:7b672a972b4c4dfa95a8ce703d1a1cba7f1d8585009b654a04154a1465b253d2" }, "mesh-delivery-watchman|src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2|": { "key": "mesh-delivery-watchman|src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2|", "module": "mesh-delivery-watchman", "fingerprint": "src2:07a12bf5c014d85916c882f881ee476cc75479700aaf83412d4f07fed228ddb2" }, "mesh-grants|src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3|": { "key": "mesh-grants|src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3|", "module": "mesh-grants", "fingerprint": "src2:a9eb09892c5a460239c5ee0ba8d8579bebca68b7c62e236f9f038e4a511d93b3" }, "mesh-host|src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d|": { "key": "mesh-host|src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d|", "module": "mesh-host", "fingerprint": "src2:d371f9696729a20a2d5846f5203f2b9b4cbab50a88a46988bed6e333d6e85d6d" }, "mesh-provisioner|src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe|": { "key": "mesh-provisioner|src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe|", "module": "mesh-provisioner", "fingerprint": "src2:013bf2ad1ff861a9b4434385467735dd86b6ca76b253f4fbe791a35c742efcbe" } }, "outcomes": { "|||take-in": { "key": "|||take-in", "module": "", "step": "take-in", "outcome": "taken-in", "why": "lead-47@shanks: validation try 10 accepted the revision at 14:17; it waits for indexer build c07c2499, whose code (main 4b75791d) runs on novox since 13:27, placed by hand (pack45) under its old fingerprint e34efaac from the hand drop-in, so the named build can never be seen to run", "at": "2026-11-17T13:19:50.781371455Z" } } } } ] } <!-- mesh-act:view.record/main_1004_51af09b8/6a3a2b567c5cfd3b.novox/mesh-delivery#241@1794921594636161584.5910ee2d -->
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: novox/mesh-delivery#241