Research program A

AI behavior and reliability

How models actually behave under realistic and adversarial task conditions, measured from observable input and output rather than from self-description.

Single-turn benchmarks report what a model can do once. Deployed systems are judged by what they do repeatedly, after context accumulates, after instructions compete, and after a newer version replaces the one that was tested. This program builds controlled tests for those conditions, so that a reliability claim names the conditions under which it holds.

Open questions

  1. Does a model keep an explicit constraint after the conversation moves on to other work?
  2. When a model contradicts an earlier decision, can the contradiction be reproduced, and under which conditions?
  3. Does stated confidence track the evidence available to the model at the time it answers?
  4. After a correction, does the corrected behavior hold, or does the original error return?

Scope boundary

The object of evaluation is observable behavior. A model's explanation of its own answer is treated as another output to evaluate, not as a view of its internal reasoning.

Research in this program

ALG-001
Publication status: Research question

Longitudinal AI reliability

Do models keep constraints, corrections and earlier decisions intact across extended, multi-session work? This entry defines the question and the evidence that would answer it. It reports no results.

  • Program A · AI behavior and reliability
  • Program C · Human-AI interaction
  • No artifacts yet
ALG-003
Publication status: Research question

Post-hoc explanation and decision consistency

When a model explains a decision after making it, does the explanation match the evidence that was available to justify the decision? This entry defines the question without any claim about hidden internal reasoning. It reports no results.

  • Program A · AI behavior and reliability
  • Program D · Evaluation methodology
  • No artifacts yet