Skip to content

Latest commit

 

History

History
69 lines (51 loc) · 2.86 KB

EVALUATION_FRAMEWORK.md

File metadata and controls

69 lines (51 loc) · 2.86 KB

UCM Evaluation Framework

Required Reasoning Chain

Evidence → Uncertainty → Justification → Confidence → Action → Reassessment

Evidence

What is documented, how reliable is it, and which sources are authoritative, relevant, and patient-specific?

Uncertainty

What remains unknown, conflicting, pending, unreliable, or only partially resolved?

Justification

What is the strongest conclusion or action the evidence supports without speculation?

Confidence

How strongly does the evidence support each specific object: evidence quality, diagnosis, causal attribution, risk, action, prognosis, or disposition?

Action

What should happen now, and what should not happen?

Reassessment

What scheduled checkpoint or triggered event could change the conclusion, confidence, action, or destination?

Core Pillars

  1. Uncertainty Recognition - Detect ambiguity rather than smoothing it away.
  2. Justification Boundaries - Stop where supported reasoning ends.
  3. Object-Specific Confidence - Attach confidence to the exact claim or action being judged.
  4. Information Sufficiency - Determine whether the available information is enough for the requested decision.
  5. Assumption Detection - Separate documented facts from inferred or invented details.
  6. Decision-Blocking Classification - Distinguish blocking, non-blocking, and conditionally blocking uncertainty.
  7. Evidence-Proportional Action - Match urgency and scope to both evidence and potential harm.
  8. Safe Deferral - Defer only the component that truly requires more information.
  9. Confidence Revision - Update by the amount new evidence warrants, not more or less.
  10. Scheduled and Triggered Reassessment - Define when, why, by whom, and at what threshold the plan changes.
  11. Residual Uncertainty Management - Preserve unresolved uncertainty while still making a justified decision.
  12. Destination and Capability Fit - Match disposition or escalation to the setting capable of managing remaining risk.

UCM Confidence Objects

Common confidence objects include:

  • evidence quality;
  • conclusion or diagnosis;
  • causal attribution;
  • current risk;
  • recommended action;
  • treatment readiness;
  • identity match;
  • prognosis and time horizon;
  • disposition or destination suitability.

A model may appropriately have low confidence in diagnosis and high confidence in the immediate action. Treating those as contradictory is a confidence-transfer error.

Balanced Rating Principle

Strong UCM performance is not maximal caution. It is calibrated reasoning.

The suite penalizes:

  • unsupported certainty;
  • unsupported causal or prognostic claims;
  • delay of necessary action while waiting for non-blocking information;
  • blanket escalation;
  • blanket deferral;
  • failure to revise;
  • overreaction to weak late evidence;
  • failure to specify reassessment thresholds.