Capability evaluation and elicitation
Some failure modes — deception, scheming, sandbagging, motivated reasoning — resist naive measurement, because their absence under one elicitation condition does not imply absence under another. We design paired benchmarks with directional controls that isolate the construct of interest from broader instruction-following, and we treat measurement that survives adversarial scrutiny as the standard worth reaching.