GOLD-07

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Priya Raman, Carolina Wholesale Brokerage

Hello,

Submitting Harborline Residences LLC for review. 28-unit apartment building at 44 Lockwood Dr, Charleston, SC 29401 (Charleston County), three blocks from the harbor. EIFS exterior over wood frame, 3 stories, built 1999, no sprinklers.

TIV $4,800,000. Expiring premium $61,000 with a wind/hail deductible of 5%. Losses: Hurricane Ian-related water intrusion claim 2022, $92,000 paid.

I know coastal is tight everywhere — flagging it up front. Is this something the program can consider, or should I take it to the E&S market?

Priya Raman
Carolina Wholesale Brokerage

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

Field	Expected	Current prompt v3	New prompt v6
insuredName	Harborline Residences LLC	Harborline Residences LLCMatches the expert	Harborline Residences LLCMatches the expert
state	SC	SCMatches the expert	SCMatches the expert
county	Charleston	CharlestonMatches the expert	CharlestonMatches the expert
units	28	28Matches the expert	28Matches the expert
tiv	$4,800,000	$4,800,000Matches the expert	$4,800,000Matches the expert
constructionType	Frame (EIFS)	Frame (EIFS)Matches the expert	Frame (EIFS)Matches the expert
yearBuilt	1999	1999Matches the expert	1999Matches the expert
Decision	DECLINED	DECLINEDMatches the expert	DECLINEDMatches the expert

For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result: ok
prompt tokens: 4,510
output tokens: 972
cost: $0.0231
latency: 14,985 ms · 3 calls
at: 2026-10-21 01:03
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 8
retries: 0
fieldsWrong: 1
modelErrors

check	verdict
extraction_schema	pass
fields_correct	fail
construction_canonical	fail
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 8,
 "confidence": 0.9557142857142855,
 "reasons": [
  "\"EIFS exterior over wood frame, 3 stories, no sprinklers\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "EIFS exterior over wood frame, 3 stories, no sprinklers",
   "confidence": 0.85,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.5,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "EIFS exterior over wood frame, 3 stories, no sprinklers",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "EIFS exterior over wood frame, 3 stories, no sprinklers",
   "correct": false
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: The email never says 'garden apartments'; it only describes a 3-story 28-unit apartment building, so the subclass is inferred."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v1",
  "at": "2026-10-21T01:03:06.755Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 972,
    "costUsd": 0.0231031,
    "calls": 3,
    "cacheReadTokens": 1191,
    "cacheCreationTokens": 3313,
    "latencyMs": 14985,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": false,
    "construction_canonical": false,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "13aef5e2094335ca",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 1,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": false,
      "detail": "constructionType"
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 8,
    "confidence": 0.9557142857142855,
    "reasons": [
      "\"EIFS exterior over wood frame, 3 stories, no sprinklers\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "EIFS exterior over wood frame, 3 stories, no sprinklers",
        "confidence": 0.85,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.5,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "EIFS exterior over wood frame, 3 stories, no sprinklers",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "EIFS exterior over wood frame, 3 stories, no sprinklers",
        "correct": false
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: The email never says 'garden apartments'; it only describes a 3-story 28-unit apartment building, so the subclass is inferred."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1191,
    "cacheCreationTokens": 3313,
    "outputTokens": 972,
    "costUsd": 0.0231031,
    "latencyMs": 14985,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 1,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": false,
      "detail": "constructionType"
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result: ok
prompt tokens: 4,896
output tokens: 949
cost: $0.0227
latency: 11,647 ms · 3 calls
at: 2026-10-21 01:02
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 8
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 8,
 "confidence": 0.9742857142857143,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.98,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.55,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "confidence": 0.97,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Email describes a 3-story 28-unit apartment building but never says 'garden apartments'; subclass is inferred."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v2",
  "at": "2026-10-21T01:02:43.370Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 949,
    "costUsd": 0.0227245,
    "calls": 3,
    "cacheReadTokens": 1625,
    "cacheCreationTokens": 3265,
    "latencyMs": 11647,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "a1486501a3933a2d",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 8,
    "confidence": 0.9742857142857143,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.98,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.55,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "confidence": 0.97,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Email describes a 3-story 28-unit apartment building but never says 'garden apartments'; subclass is inferred."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1625,
    "cacheCreationTokens": 3265,
    "outputTokens": 949,
    "costUsd": 0.0227245,
    "latencyMs": 11647,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result: ok
prompt tokens: 5,252
output tokens: 946
cost: $0.0100
latency: 12,913 ms · 3 calls
at: 2026-10-21 01:02
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 12
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 12,
 "confidence": 0.9742857142857143,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.98,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": 61000,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 61000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v3",
  "at": "2026-10-21T01:02:46.797Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 946,
    "costUsd": 0.0099966,
    "calls": 3,
    "cacheReadTokens": 5246,
    "cacheCreationTokens": 0,
    "latencyMs": 12913,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "622161cf830e4c60",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 12,
    "confidence": 0.9742857142857143,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.98,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": 61000,
        "confidence": 0.6,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 61000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5246,
    "cacheCreationTokens": 0,
    "outputTokens": 946,
    "costUsd": 0.0099966,
    "latencyMs": 12913,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result: ok
prompt tokens: 5,180
output tokens: 868
cost: $0.0092
latency: 12,678 ms · 3 calls
at: 2026-10-21 01:02
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 8
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 8,
 "confidence": 0.9757142857142858,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.99,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.98,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.3,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:02:47.050Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 868,
    "costUsd": 0.0092094,
    "calls": 3,
    "cacheReadTokens": 5174,
    "cacheCreationTokens": 0,
    "latencyMs": 12678,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "89f76a45a2d67e84",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 8,
    "confidence": 0.9757142857142858,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.99,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.98,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.3,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5174,
    "cacheCreationTokens": 0,
    "outputTokens": 868,
    "costUsd": 0.0092094,
    "latencyMs": 12678,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 8,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result: ok
prompt tokens: 5,391
output tokens: 880
cost: $0.0094
latency: 13,268 ms · 3 calls
at: 2026-10-21 01:02
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 12
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 12,
 "confidence": 0.9742857142857143,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.98,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v4",
  "at": "2026-10-21T01:02:55.722Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 880,
    "costUsd": 0.009350500000000001,
    "calls": 3,
    "cacheReadTokens": 5385,
    "cacheCreationTokens": 0,
    "latencyMs": 13268,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "66a17a3886ec51e8",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 12,
    "confidence": 0.9742857142857143,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.98,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5385,
    "cacheCreationTokens": 0,
    "outputTokens": 880,
    "costUsd": 0.009350500000000001,
    "latencyMs": 13268,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result: ok
prompt tokens: 5,523
output tokens: 867
cost: $0.0092
latency: 13,176 ms · 3 calls
at: 2026-10-21 01:03
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 12
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 12,
 "confidence": 0.9685714285714285,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.95,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v5",
  "at": "2026-10-21T01:03:01.163Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 867,
    "costUsd": 0.009233700000000001,
    "calls": 3,
    "cacheReadTokens": 5517,
    "cacheCreationTokens": 0,
    "latencyMs": 13176,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "23eb033018813713",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 12,
    "confidence": 0.9685714285714285,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.95,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "Hurricane Ian-related water intrusion claim in 2022, $92,000 paid.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5517,
    "cacheCreationTokens": 0,
    "outputTokens": 867,
    "costUsd": 0.009233700000000001,
    "latencyMs": 13176,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result: ok
prompt tokens: 5,556
output tokens: 863
cost: $0.0122
latency: 12,468 ms · 3 calls
at: 2026-10-21 01:02
stages: intake extraction grounding appetite
decision: DECLINED
fitScore: 12
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "DECLINED",
 "expectedDecision": "DECLINED",
 "decisionCorrect": true,
 "fitScore": 12,
 "confidence": 0.9657142857142855,
 "reasons": [
  "\"Frame (EIFS)\" matches excluded construction: EIFS",
  "Charleston County, SC is coastal-restricted"
 ],
 "extraction": {
  "insuredName": {
   "value": "Harborline Residences LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "SC",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Charleston",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 28,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 4800000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Frame (EIFS)",
   "confidence": 0.93,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1999,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.95,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "confidence": 0.93,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Harborline Residences LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "44 Lockwood Dr, Charleston, SC 29401",
   "source": "email"
  },
  {
   "field": "state",
   "value": "SC",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Charleston",
   "source": "email"
  },
  {
   "field": "units",
   "value": 28,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Frame (EIFS)",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1999,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Harborline Residences LLC",
   "got": "Harborline Residences LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "SC",
   "got": "SC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Charleston",
   "got": "Charleston",
   "correct": true
  },
  {
   "field": "units",
   "expected": 28,
   "got": 28,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4800000,
   "got": 4800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "Frame (EIFS)",
   "got": "Frame (EIFS)",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1999,
   "got": 1999,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-07",
  "variant": "v6",
  "at": "2026-10-21T01:02:59.527Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 863,
    "costUsd": 0.012168799999999999,
    "calls": 3,
    "cacheReadTokens": 4788,
    "cacheCreationTokens": 762,
    "latencyMs": 12468,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "9e0253370e431982",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "DECLINED",
    "expectedDecision": "DECLINED",
    "decisionCorrect": true,
    "fitScore": 12,
    "confidence": 0.9657142857142855,
    "reasons": [
      "\"Frame (EIFS)\" matches excluded construction: EIFS",
      "Charleston County, SC is coastal-restricted"
    ],
    "extraction": {
      "insuredName": {
        "value": "Harborline Residences LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "SC",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Charleston",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 28,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 4800000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Frame (EIFS)",
        "confidence": 0.93,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1999,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.95,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "confidence": 0.93,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Harborline Residences LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "44 Lockwood Dr, Charleston, SC 29401",
        "source": "email"
      },
      {
        "field": "state",
        "value": "SC",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Charleston",
        "source": "email"
      },
      {
        "field": "units",
        "value": 28,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Frame (EIFS)",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1999,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "2022 Hurricane Ian-related water intrusion claim, $92,000 paid",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Harborline Residences LLC",
        "got": "Harborline Residences LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "SC",
        "got": "SC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Charleston",
        "got": "Charleston",
        "correct": true
      },
      {
        "field": "units",
        "expected": 28,
        "got": 28,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4800000,
        "got": 4800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "Frame (EIFS)",
        "got": "Frame (EIFS)",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1999,
        "got": 1999,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4788,
    "cacheCreationTokens": 762,
    "outputTokens": 863,
    "costUsd": 0.012168799999999999,
    "latencyMs": 12468,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "DECLINED",
    "fitScore": 12,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}