Weigh evals you can watch
2026-11-12 06:38 UTC

V-15

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Variant desk

Team — see the thread below, but note the correction: after closing on the annex last month the schedule is actually 16 units, and updated values are $2,350,000. Everything else in the original note stands.

Thanks,
MB

---------- Forwarded message ----------
From: MB
Subject: Ozark Terrace submission

Hi, submitting Ozark Terrace Rentals LLC, a 12-unit apartment court at 1830 S National Ave, Springfield, MO 65804 (Greene County). Brick veneer over frame, built 1998. TIV $1,800,000, target premium $17,500, no losses.

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

FieldExpectedCurrent prompt v3New prompt v6
insuredNameOzark Terrace Rentals LLCOzark Terrace Rentals LLCMatches the expertOzark Terrace Rentals LLCMatches the expert
stateMOMOMatches the expertMOMatches the expert
countyGreeneGreeneMatches the expertGreeneMatches the expert
units1616Matches the expert16Matches the expert
tiv$2,350,000$2,350,000Matches the expert$2,350,000Matches the expert
yearBuilt19981998Matches the expert1998Matches the expert
Decisionquote it IN APPETITEquote it IN APPETITEMatches the expertquote it IN APPETITEMatches the expert
For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result
ok
prompt tokens
4,412
output tokens
999
cost
$0.0104
latency
14,417 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
90
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudefail
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.9385714285714286,
 "reasons": [
  "Ozark Terrace Rentals sits comfortably inside appetite: MO is an allowed state, 16 units is well under the 60-unit cap, and the $2.35M TIV falls mid-band. Brick veneer over frame built in 1998 is acceptable construction, Greene County carries no coastal restriction, the $17,500 GWP target is inside the premium band, and no losses are reported. Bind-ready on appetite; the only friction is a 1990s-vintage frame structure."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.9,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.9,
   "source": "email"
  },
  "constructionType": {
   "value": "Brick veneer over frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.8,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.55,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses reported",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Brick veneer over frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses reported",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Sources say 'apartment court' but never state 'Garden apartments'; this is an inferred classification."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v1",
  "at": "2026-10-21T01:10:44.009Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 999,
    "costUsd": 0.010442599999999998,
    "calls": 3,
    "cacheReadTokens": 4406,
    "cacheCreationTokens": 0,
    "latencyMs": 14417,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "405067d556c8f5e4",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.9385714285714286,
    "reasons": [
      "Ozark Terrace Rentals sits comfortably inside appetite: MO is an allowed state, 16 units is well under the 60-unit cap, and the $2.35M TIV falls mid-band. Brick veneer over frame built in 1998 is acceptable construction, Greene County carries no coastal restriction, the $17,500 GWP target is inside the premium band, and no losses are reported. Bind-ready on appetite; the only friction is a 1990s-vintage frame structure."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.9,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.9,
        "source": "email"
      },
      "constructionType": {
        "value": "Brick veneer over frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.8,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.55,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses reported",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Brick veneer over frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses reported",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Sources say 'apartment court' but never state 'Garden apartments'; this is an inferred classification."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4406,
    "cacheCreationTokens": 0,
    "outputTokens": 999,
    "costUsd": 0.010442599999999998,
    "latencyMs": 14417,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result
ok
prompt tokens
4,824
output tokens
967
cost
$0.0102
latency
14,558 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
90
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudefail
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.8585714285714287,
 "reasons": [
  "Ozark Terrace Rentals sits comfortably inside appetite: MO is an allowed state, 16 units is well under the 60-unit cap, and $2.35M TIV falls in the mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, and the $17,500 target GWP sits inside the premium band. No prior losses support a clean bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.93,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.93,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.9,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.6,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, which is not simply 'Frame' and suggests masonry veneer/joisted-type construction; value is an oversimplification of the stated construction."
  },
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email says 'apartment court' and never mentions 'Garden apartments'; subclass is inferred."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v2",
  "at": "2026-10-21T01:10:25.942Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 967,
    "costUsd": 0.0101638,
    "calls": 3,
    "cacheReadTokens": 4818,
    "cacheCreationTokens": 0,
    "latencyMs": 14558,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "5ffe95b29e253e0d",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.8585714285714287,
    "reasons": [
      "Ozark Terrace Rentals sits comfortably inside appetite: MO is an allowed state, 16 units is well under the 60-unit cap, and $2.35M TIV falls in the mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, and the $17,500 target GWP sits inside the premium band. No prior losses support a clean bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.93,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.93,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.9,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.6,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, which is not simply 'Frame' and suggests masonry veneer/joisted-type construction; value is an oversimplification of the stated construction."
      },
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email says 'apartment court' and never mentions 'Garden apartments'; subclass is inferred."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4818,
    "cacheCreationTokens": 0,
    "outputTokens": 967,
    "costUsd": 0.0101638,
    "latencyMs": 14558,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result
ok
prompt tokens
5,108
output tokens
896
cost
$0.0095
latency
13,246 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
90
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.8621428571428572,
 "reasons": [
  "Ozark Terrace Rentals sits comfortably inside appetite: Missouri is an allowed state, 16 units is well under the 60-unit cap, and $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County has no coastal restriction, the $17,500 GWP target sits inside the premium band, and the loss history is clean, so this risk is ready to bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.95,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.85,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.9,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, not simply Frame; the extracted value omits the brick veneer masonry exterior."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v3",
  "at": "2026-10-21T01:10:24.866Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 896,
    "costUsd": 0.009482200000000001,
    "calls": 3,
    "cacheReadTokens": 5102,
    "cacheCreationTokens": 0,
    "latencyMs": 13246,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "3530958228ecb109",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.8621428571428572,
    "reasons": [
      "Ozark Terrace Rentals sits comfortably inside appetite: Missouri is an allowed state, 16 units is well under the 60-unit cap, and $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County has no coastal restriction, the $17,500 GWP target sits inside the premium band, and the loss history is clean, so this risk is ready to bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.95,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.85,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.9,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, not simply Frame; the extracted value omits the brick veneer masonry exterior."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5102,
    "cacheCreationTokens": 0,
    "outputTokens": 896,
    "costUsd": 0.009482200000000001,
    "latencyMs": 13246,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result
ok
prompt tokens
5,108
output tokens
897
cost
$0.0095
latency
13,266 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.8671428571428571,
 "reasons": [
  "All six rule checks passed. The Springfield, MO location sits well inside appetite: 16 units against a 60-unit max, TIV of $2.35M in the lower-middle of the $250K–$15M band, and a $17,500 target GWP comfortably within the premium band. The 1998 frame construction is acceptable and the loss history is clean, so this risk is ready to bind-track with only minor friction from frame construction."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.95,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.9,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, not simply 'Frame'; value loses the brick veneer description and may misclassify construction."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:10:29.552Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 897,
    "costUsd": 0.009492200000000001,
    "calls": 3,
    "cacheReadTokens": 5102,
    "cacheCreationTokens": 0,
    "latencyMs": 13266,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "72bdcd3cb90c536a",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.8671428571428571,
    "reasons": [
      "All six rule checks passed. The Springfield, MO location sits well inside appetite: 16 units against a 60-unit max, TIV of $2.35M in the lower-middle of the $250K–$15M band, and a $17,500 target GWP comfortably within the premium band. The 1998 frame construction is acceptable and the loss history is clean, so this risk is ready to bind-track with only minor friction from frame construction."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.95,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.9,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, not simply 'Frame'; value loses the brick veneer description and may misclassify construction."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5102,
    "cacheCreationTokens": 0,
    "outputTokens": 897,
    "costUsd": 0.009492200000000001,
    "latencyMs": 13266,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result
ok
prompt tokens
5,317
output tokens
930
cost
$0.0098
latency
12,545 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.8535714285714286,
 "reasons": [
  "All six rule checks passed: Greene County, MO sits inside appetite, with 16 units well under the 60-unit cap and a $2.35M TIV in the lower-middle of the $250K–$15M band. The 1998 frame building avoids every excluded construction class, the loss history is clean, and the $17,500 target GWP falls comfortably inside the premium band. Frame construction is the only mild friction, so this risk is a strong candidate to bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.97,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.93,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.93,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.85,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.9,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, which is not simply 'Frame'; the source describes masonry veneer construction, so the value is an oversimplification."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v4",
  "at": "2026-10-21T01:10:34.669Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 930,
    "costUsd": 0.0098431,
    "calls": 3,
    "cacheReadTokens": 5311,
    "cacheCreationTokens": 0,
    "latencyMs": 12545,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "beac21eef283f865",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.8535714285714286,
    "reasons": [
      "All six rule checks passed: Greene County, MO sits inside appetite, with 16 units well under the 60-unit cap and a $2.35M TIV in the lower-middle of the $250K–$15M band. The 1998 frame building avoids every excluded construction class, the loss history is clean, and the $17,500 target GWP falls comfortably inside the premium band. Frame construction is the only mild friction, so this risk is a strong candidate to bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.97,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.93,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.93,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.85,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.9,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, which is not simply 'Frame'; the source describes masonry veneer construction, so the value is an oversimplification."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5311,
    "cacheCreationTokens": 0,
    "outputTokens": 930,
    "costUsd": 0.0098431,
    "latencyMs": 12545,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result
ok
prompt tokens
5,449
output tokens
949
cost
$0.0100
latency
12,997 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.8571428571428573,
 "reasons": [
  "Ozark Terrace Rentals sits comfortably inside appetite: MO is an approved state, 16 units is well under the 60-unit cap, and the $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, the $17,500 target GWP sits within the premium band, and the loss history is clean. Bind-ready on appetite; the only friction is frame construction, which is less preferred than masonry or non-combustible."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.93,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.93,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, which is not simply 'Frame' and suggests masonry veneer/joisted masonry; the extracted value drops the veneer detail."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v5",
  "at": "2026-10-21T01:10:38.946Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 949,
    "costUsd": 0.010046300000000001,
    "calls": 3,
    "cacheReadTokens": 5443,
    "cacheCreationTokens": 0,
    "latencyMs": 12997,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "fe1e4ae9d88b01fa",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.8571428571428573,
    "reasons": [
      "Ozark Terrace Rentals sits comfortably inside appetite: MO is an approved state, 16 units is well under the 60-unit cap, and the $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, the $17,500 target GWP sits within the premium band, and the loss history is clean. Bind-ready on appetite; the only friction is frame construction, which is less preferred than masonry or non-combustible."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.93,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.93,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, which is not simply 'Frame' and suggests masonry veneer/joisted masonry; the extracted value drops the veneer detail."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5443,
    "cacheCreationTokens": 0,
    "outputTokens": 949,
    "costUsd": 0.010046300000000001,
    "latencyMs": 12997,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result
ok
prompt tokens
5,484
output tokens
922
cost
$0.0126
latency
12,841 ms · 3 calls
at
2026-10-21 01:10
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
modelErrors
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalnot applicable
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevunanswered
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.8571428571428573,
 "reasons": [
  "All six appetite rules pass: MO is an appetite state, 16 units sits well under the 60-unit cap, and the $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, the $17,500 target GWP sits inside the premium band, and the loss history is clean. This risk sits comfortably inside appetite and is ready to bind-quote."
 ],
 "extraction": {
  "insuredName": {
   "value": "Ozark Terrace Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1830 S National Ave, Springfield, MO 65804",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "MO",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Greene",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 16,
   "confidence": 0.93,
   "source": "email"
  },
  "tiv": {
   "value": 2350000,
   "confidence": 0.93,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.95,
   "source": "email"
  },
  "targetPremium": {
   "value": 17500,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Ozark Terrace Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1830 S National Ave, Springfield, MO 65804",
   "source": "email"
  },
  {
   "field": "state",
   "value": "MO",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Greene",
   "source": "email"
  },
  {
   "field": "units",
   "value": 16,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 2350000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 17500,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Ozark Terrace Rentals LLC",
   "got": "Ozark Terrace Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "MO",
   "got": "MO",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Greene",
   "got": "Greene",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2350000,
   "got": 2350000,
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "constructionType",
   "issue": "contradiction",
   "detail": "Email says brick veneer over frame, which is not simply 'Frame'; the extracted value drops the brick veneer detail (masonry veneer is typically classified differently)."
  }
 ]
}
Trace line (JSON)
{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "V-15",
  "variant": "v6",
  "at": "2026-10-21T01:10:37.795Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 922,
    "costUsd": 0.0126034,
    "calls": 3,
    "cacheReadTokens": 4754,
    "cacheCreationTokens": 724,
    "latencyMs": 12841,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "d08be6f02a1021e9",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}
Full output record (JSON)
{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.8571428571428573,
    "reasons": [
      "All six appetite rules pass: MO is an appetite state, 16 units sits well under the 60-unit cap, and the $2.35M TIV falls mid-band. Frame construction built in 1998 is acceptable, Greene County carries no coastal restriction, the $17,500 target GWP sits inside the premium band, and the loss history is clean. This risk sits comfortably inside appetite and is ready to bind-quote."
    ],
    "extraction": {
      "insuredName": {
        "value": "Ozark Terrace Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1830 S National Ave, Springfield, MO 65804",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "MO",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Greene",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 16,
        "confidence": 0.93,
        "source": "email"
      },
      "tiv": {
        "value": 2350000,
        "confidence": 0.93,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.95,
        "source": "email"
      },
      "targetPremium": {
        "value": 17500,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Ozark Terrace Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1830 S National Ave, Springfield, MO 65804",
        "source": "email"
      },
      {
        "field": "state",
        "value": "MO",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Greene",
        "source": "email"
      },
      {
        "field": "units",
        "value": 16,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 2350000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 17500,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Ozark Terrace Rentals LLC",
        "got": "Ozark Terrace Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "MO",
        "got": "MO",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Greene",
        "got": "Greene",
        "correct": true
      },
      {
        "field": "units",
        "expected": 16,
        "got": 16,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 2350000,
        "got": 2350000,
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "constructionType",
        "issue": "contradiction",
        "detail": "Email says brick veneer over frame, which is not simply 'Frame'; the extracted value drops the brick veneer detail (masonry veneer is typically classified differently)."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4754,
    "cacheCreationTokens": 724,
    "outputTokens": 922,
    "costUsd": 0.0126034,
    "latencyMs": 12841,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}