GOLD-04

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Tom Whitfield, Whitfield Insurance Group

Hi,

Small habitational account for you. Boise Bench Properties LLC owns two fourplexes (8 units total) at 1710 & 1714 S Latah St, Boise, ID 83705 (Ada County). Both frame construction, 2 stories, both built in 2003, updated electrical and plumbing 2018.

Combined TIV $1,150,000. Target premium $9,500. No claims ever filed — owner has held these since new.

Happy to get supplementals if needed.

Tom Whitfield
Whitfield Insurance Group

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

Field	Expected	Current prompt v3	New prompt v6
insuredName	Boise Bench Properties LLC	Boise Bench Properties LLCMatches the expert	Boise Bench Properties LLCMatches the expert
state	ID	IDMatches the expert	IDMatches the expert
county	Ada	AdaMatches the expert	AdaMatches the expert
units	8	8Matches the expert	8Matches the expert
tiv	$1,150,000	$1,150,000Matches the expert	$1,150,000Matches the expert
constructionType	frame	FrameMatches the expert	FrameMatches the expert
yearBuilt	2003	2003Matches the expert	2003Matches the expert
targetPremium	$9,500	$9,500Matches the expert	$9,500Matches the expert
subclass	Duplex/fourplex schedule	Duplex/fourplex scheduleMatches the expert	Duplex/fourplex scheduleMatches the expert
Decision	quote it IN APPETITE	quote it IN APPETITEMatches the expert	quote it IN APPETITEMatches the expert

For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result: ok
prompt tokens: 4,392
output tokens: 986
cost: $0.0103
latency: 13,383 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9642857142857143,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. The 2003 frame build is acceptable construction, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. Loss-free history since new supports a bind; the low GWP relative to the band is the only minor friction."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.9,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.93,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email describes two fourplexes as a habitational account but never mentions a 'Duplex/fourplex schedule' subclass; this is an inference."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v1",
  "at": "2026-10-21T01:01:52.393Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 986,
    "costUsd": 0.010310599999999998,
    "calls": 3,
    "cacheReadTokens": 4386,
    "cacheCreationTokens": 0,
    "latencyMs": 13383,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "fd8f0e2ccc1e0452",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9642857142857143,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. The 2003 frame build is acceptable construction, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. Loss-free history since new supports a bind; the low GWP relative to the band is the only minor friction."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.9,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.93,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email describes two fourplexes as a habitational account but never mentions a 'Duplex/fourplex schedule' subclass; this is an inference."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4386,
    "cacheCreationTokens": 0,
    "outputTokens": 986,
    "costUsd": 0.010310599999999998,
    "latencyMs": 13383,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result: ok
prompt tokens: 4,826
output tokens: 980
cost: $0.0103
latency: 11,944 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 92
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 92,
 "confidence": 0.97,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: Idaho is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. The 2003 frame build is acceptable construction, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor. A clean loss history since new supports a bind; the only friction is GWP sitting near the low end of the premium band."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.93,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email describes two fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v2",
  "at": "2026-10-21T01:01:30.521Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 980,
    "costUsd": 0.010294,
    "calls": 3,
    "cacheReadTokens": 4820,
    "cacheCreationTokens": 0,
    "latencyMs": 11944,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "ee10fec46b84dc21",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 92,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 92,
    "confidence": 0.97,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: Idaho is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. The 2003 frame build is acceptable construction, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor. A clean loss history since new supports a bind; the only friction is GWP sitting near the low end of the premium band."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.93,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email describes two fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4820,
    "cacheCreationTokens": 0,
    "outputTokens": 980,
    "costUsd": 0.010294,
    "latencyMs": 11944,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 92,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result: ok
prompt tokens: 5,140
output tokens: 993
cost: $0.0105
latency: 12,906 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9685714285714285,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. 2003 frame construction is acceptable and not excluded, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. A long-tenured owner with zero claims supports a bind-ready profile; the only friction is the low GWP near the band minimum and frame construction."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.93,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v3",
  "at": "2026-10-21T01:01:37.739Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 993,
    "costUsd": 0.010455399999999998,
    "calls": 3,
    "cacheReadTokens": 5134,
    "cacheCreationTokens": 0,
    "latencyMs": 12906,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "2344c04077165f11",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9685714285714285,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. 2003 frame construction is acceptable and not excluded, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. A long-tenured owner with zero claims supports a bind-ready profile; the only friction is the low GWP near the band minimum and frame construction."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.9,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.93,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5134,
    "cacheCreationTokens": 0,
    "outputTokens": 993,
    "costUsd": 0.010455399999999998,
    "latencyMs": 12906,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result: ok
prompt tokens: 5,140
output tokens: 1,000
cost: $0.0105
latency: 13,589 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9685714285714285,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. The 2003 frame build is acceptable, the owner reports no losses since new, and the $9,500 target GWP clears the $5K floor with modest margin. Only minor friction: the premium sits near the low end of the band and frame construction carries fire exposure, but this risk is a clean bind candidate."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email does not state a subclass; it is inferred from the fourplex description (and 'Duplex/fourplex schedule' is not a broker-stated term)."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:01:38.998Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 1000,
    "costUsd": 0.0105254,
    "calls": 3,
    "cacheReadTokens": 5134,
    "cacheCreationTokens": 0,
    "latencyMs": 13589,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "b13f137b1aa11940",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9685714285714285,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. The 2003 frame build is acceptable, the owner reports no losses since new, and the $9,500 target GWP clears the $5K floor with modest margin. Only minor friction: the premium sits near the low end of the band and frame construction carries fire exposure, but this risk is a clean bind candidate."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.9,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email does not state a subclass; it is inferred from the fourplex description (and 'Duplex/fourplex schedule' is not a broker-stated term)."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5134,
    "cacheCreationTokens": 0,
    "outputTokens": 1000,
    "costUsd": 0.0105254,
    "latencyMs": 13589,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result: ok
prompt tokens: 5,349
output tokens: 1,179
cost: $0.0123
latency: 14,290 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9671428571428571,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. The 2003 frame construction is acceptable and not excluded, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with little margin. A loss-free history since new supports a bind, with minor friction from the modest premium near the band minimum."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email describes habitational fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v4",
  "at": "2026-10-21T01:01:43.208Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 1179,
    "costUsd": 0.012336299999999998,
    "calls": 3,
    "cacheReadTokens": 5343,
    "cacheCreationTokens": 0,
    "latencyMs": 14290,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "33597bbd1c6496e7",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9671428571428571,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is well under the 60-unit cap, and $1.15M TIV falls in the lower-middle of the $250K-$15M band. The 2003 frame construction is acceptable and not excluded, Ada County carries no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with little margin. A loss-free history since new supports a bind, with minor friction from the modest premium near the band minimum."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.9,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email describes habitational fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5343,
    "cacheCreationTokens": 0,
    "outputTokens": 1179,
    "costUsd": 0.012336299999999998,
    "latencyMs": 14290,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result: ok
prompt tokens: 5,481
output tokens: 987
cost: $0.0104
latency: 12,604 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9642857142857143,
 "reasons": [
  "Boise Bench Properties sits well inside appetite: Idaho is an allowed state, 8 units is far under the 60-unit cap, and the $1.15M TIV falls mid-band with a $9,500 GWP target above the $5,000 floor. Frame construction from 2003 is acceptable, Ada County has no coastal restriction, and the loss record is clean since inception. Minor friction from the low GWP relative to the band and frame construction keeps this short of top score, but the risk is ready to bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email describes habitational fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v5",
  "at": "2026-10-21T01:01:50.626Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 987,
    "costUsd": 0.0104295,
    "calls": 3,
    "cacheReadTokens": 5475,
    "cacheCreationTokens": 0,
    "latencyMs": 12604,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "8eb48e3c7fe7213c",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9642857142857143,
    "reasons": [
      "Boise Bench Properties sits well inside appetite: Idaho is an allowed state, 8 units is far under the 60-unit cap, and the $1.15M TIV falls mid-band with a $9,500 GWP target above the $5,000 floor. Frame construction from 2003 is acceptable, Ada County has no coastal restriction, and the loss record is clean since inception. Minor friction from the low GWP relative to the band and frame construction keeps this short of top score, but the risk is ready to bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.9,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email describes habitational fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; this is an inferred classification."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5475,
    "cacheCreationTokens": 0,
    "outputTokens": 987,
    "costUsd": 0.0104295,
    "latencyMs": 12604,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result: ok
prompt tokens: 5,516
output tokens: 997
cost: $0.0133
latency: 12,766 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9685714285714286,
 "reasons": [
  "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. Frame construction from 2003 is acceptable, Ada County has no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. A clean loss history with a single long-term owner supports bind; the small premium relative to the band is the only friction."
 ],
 "extraction": {
  "insuredName": {
   "value": "Boise Bench Properties LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "confidence": 0.95,
   "source": "email"
  },
  "state": {
   "value": "ID",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Ada",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 8,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 1150000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2003,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 9500,
   "confidence": 0.98,
   "source": "email"
  },
  "subclass": {
   "value": "Duplex/fourplex schedule",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No claims ever filed; owner has held the properties since new.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Boise Bench Properties LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1710 & 1714 S Latah St, Boise, ID 83705",
   "source": "email"
  },
  {
   "field": "state",
   "value": "ID",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Ada",
   "source": "email"
  },
  {
   "field": "units",
   "value": 8,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 1150000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2003,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 9500,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Duplex/fourplex schedule",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No claims ever filed; owner has held the properties since new.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Boise Bench Properties LLC",
   "got": "Boise Bench Properties LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "ID",
   "got": "ID",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Ada",
   "got": "Ada",
   "correct": true
  },
  {
   "field": "units",
   "expected": 8,
   "got": 8,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 1150000,
   "got": 1150000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2003,
   "got": 2003,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 9500,
   "got": 9500,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Duplex/fourplex schedule",
   "got": "Duplex/fourplex schedule",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email says two fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; it is an inferred classification and duplex is not mentioned."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-04",
  "variant": "v6",
  "at": "2026-10-21T01:01:43.629Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 997,
    "costUsd": 0.0132786,
    "calls": 3,
    "cacheReadTokens": 4806,
    "cacheCreationTokens": 704,
    "latencyMs": 12766,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "22a2e91006cf4348",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9685714285714286,
    "reasons": [
      "Boise Bench Properties sits comfortably inside appetite: ID is an allowed state, 8 units is far under the 60-unit cap, and $1.15M TIV is mid-band. Frame construction from 2003 is acceptable, Ada County has no coastal restriction, and the $9,500 target GWP clears the $5,000 floor with modest margin. A clean loss history with a single long-term owner supports bind; the small premium relative to the band is the only friction."
    ],
    "extraction": {
      "insuredName": {
        "value": "Boise Bench Properties LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "confidence": 0.95,
        "source": "email"
      },
      "state": {
        "value": "ID",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Ada",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 8,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 1150000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2003,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 9500,
        "confidence": 0.98,
        "source": "email"
      },
      "subclass": {
        "value": "Duplex/fourplex schedule",
        "confidence": 0.9,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No claims ever filed; owner has held the properties since new.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Boise Bench Properties LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1710 & 1714 S Latah St, Boise, ID 83705",
        "source": "email"
      },
      {
        "field": "state",
        "value": "ID",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Ada",
        "source": "email"
      },
      {
        "field": "units",
        "value": 8,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 1150000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2003,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 9500,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Duplex/fourplex schedule",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No claims ever filed; owner has held the properties since new.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Boise Bench Properties LLC",
        "got": "Boise Bench Properties LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "ID",
        "got": "ID",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Ada",
        "got": "Ada",
        "correct": true
      },
      {
        "field": "units",
        "expected": 8,
        "got": 8,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 1150000,
        "got": 1150000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2003,
        "got": 2003,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 9500,
        "got": 9500,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Duplex/fourplex schedule",
        "got": "Duplex/fourplex schedule",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email says two fourplexes but never mentions a 'Duplex/fourplex schedule' subclass; it is an inferred classification and duplex is not mentioned."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4806,
    "cacheCreationTokens": 704,
    "outputTokens": 997,
    "costUsd": 0.0132786,
    "latencyMs": 12766,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": false,
      "detail": "subclass"
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}