What is the Judgment Panel?
The Judgment Panel is Annie's multi-model consensus and verification layer. For significant outputs — decisions, recommendations, summaries with material consequences — Annie does not rely on a single model's output. Instead, the Judgment Panel routes the task to multiple specialist models, collects their independent outputs, and applies a structured consensus algorithm.
The result includes:
- The accepted output
- Which models were consulted and their individual responses
- Whether consensus was reached or a threshold was applied
- Confidence scores and dissenting signals
This structured record forms a verifiable audit trail — a critical requirement for regulated industries where decisions must be explainable to regulators, auditors, or courts.
The Judgment Panel cannot be bypassed for outputs above a configurable confidence threshold. This is a platform-level control, not an optional feature.