Skip to content
mager-bench1.3
Original 13 / Historical coding results

Not run.

This model has only been tested on Counterexample Lab 1.1.

Counterexample Lab / Version 1.1

4 attempts. Every result.

low reasoning · faulty versions exposed · preliminary calibration

No original-suite results

No historical coding score is assigned to this model. Its saved evidence is the Counterexample Lab attempts below.

New challenge / 1.1

What did its tests actually catch?

A model must predict the correct ledger’s outputs exactly before its tests can earn credit for exposing a fault. These counts show how often GPT-5.6 Luna caught each fault.

Understand the test
  • 01Lost request history
    3 / 3 attempts
  • 02Forgotten rejection
    3 / 3 attempts
  • 03Unchecked payload
    3 / 3 attempts
  • 04Revalidated retry
    3 / 3 attempts
  • 05Partial transfer
    0 / 3 attempts
  • 06Missing revision
    3 / 3 attempts
  • 07Stale write
    2 / 3 attempts
  • 08Overwritten history
    1 / 3 attempts

Same frozen contract and settings across all attempts. 8 of 8 graded traces matched the reference. All responses are preserved, including weaker attempts and unscored failures.