Discussion about this post

User's avatar
Aruzhan's avatar

interesting article! seems like bigger companies are unable to deliver the same loop engineering system while being affordable. will go check the product out!

MetaCortex Dynamics's avatar

One thing worth examining: what does the evaluator actually return?

If it returns pass/fail, the generator can't distinguish "wrong code" from "can't evaluate yet because the test environment isn't running" from "correct if another module's contract holds." All three trigger a full iteration. The loop burns tokens regenerating work that was already right.

We hit this exact problem and solved it with four return values instead of two: NO (fails, here's the named reason — accumulates as exclusions), YES (done), MAYBE (can't evaluate — evidence missing, hold until gathered), IFF (correct if a named dependency holds — bind and wait).

The exclusion list becomes the loop's memory — each NO tells the generator what not to do next time, so iterations get more constrained rather than starting from scratch.

The writeup: https://metacortexdynamics.substack.com/p/your-loop-has-two-states-it-needs

Reference implementation (zero deps, MIT): https://github.com/MetaCortex-Dynamics/verdict4

1 more comment...

No posts

Ready for more?