Why we execute candidate code instead of scoring it by eye
A model asked whether code looks correct will say yes to code that does not compile. We run submissions against test cases in a sandbox and score what passes, because plausible and working are different properties.
Read it →