I like the paper's direction, but I’m surprised how under-instrumented the critiqued monitoring is. Free-text CoT is a noisy proxy: models can stylize, redact, or role-play. If your safety window depends on “please narrate your thoughts,” you’ve already ceded too much.
We’ve been experimenting with a lightweight alternative I call Micro-Beam:
• At each turn, force the model to generate k clearly different strategy beams (not token samples).
• Map each to an explicit goal vector of user-relevant axes (kid-fun, budget, travel friction, etc.).
• Score numerically (cosine or scalar) and pick the winner.
• Next turn, re-beam against the residual gap (dimensions still unsatisfied), so scores cause different choices.
• Log the whole thing: beams, scores, chosen path. Instant audit trail; easy to diff, replay “what if B instead of A,” or auto-flag when visible reasoning stops moving the score.
This ends up giving you the monitorability the paper wants— in the form of a scorecard per answer-slice, not paragraphs the model can pretty up for the grader. It also primary makes more adopt-ready answers with less refinement required.
Not claiming a breakthrough—call it “value-guided decoding without a reward net + built-in audit logs.”
We’ve been experimenting with a lightweight alternative I call Micro-Beam:
• At each turn, force the model to generate k clearly different strategy beams (not token samples).
• Map each to an explicit goal vector of user-relevant axes (kid-fun, budget, travel friction, etc.).
• Score numerically (cosine or scalar) and pick the winner.
• Next turn, re-beam against the residual gap (dimensions still unsatisfied), so scores cause different choices.
• Log the whole thing: beams, scores, chosen path. Instant audit trail; easy to diff, replay “what if B instead of A,” or auto-flag when visible reasoning stops moving the score.
This ends up giving you the monitorability the paper wants— in the form of a scorecard per answer-slice, not paragraphs the model can pretty up for the grader. It also primary makes more adopt-ready answers with less refinement required.
Not claiming a breakthrough—call it “value-guided decoding without a reward net + built-in audit logs.”
Workshop paper is here: https://drive.google.com/file/d/1AvbxGh6K5kTXjjqyH-2Hv6lizz3...