sema-evalsIndependent evaluations

Hook Enforcement — 20260719T120000000Z-codex-run2

144-trial multi-hop babel relay through OpenAI Codex with the unmodified sema Claude Code plugin (gpt-5.6-luna low): warn detects 32/32 but 9 drifted relays ship anyway; enforce halts 32/32 pre-model.

Provenance

Deviations

Condition Trials Drift detection Silent divergence Drift halted Task success False halts Malformed Hop failed
off 48 10/32 22/32 10/32 25/48 1 0 0
warn 48 32/32 0/32 23/32 35/48 4 0 0
enforce 48 32/32 0/32 32/32 48/48 0 0 0

Drift-conditioned columns use drift-injected trials as the denominator; task success uses all trials in the condition.