GOLD-03

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Priya Raman, Carolina Wholesale Brokerage

Hello underwriting,

Please review Queen City Rentals LLC for your rental property program. Schedule is a 40-unit apartment community, two buildings on one campus at 8830 Stonehaven Dr, Charlotte, NC 28215 (Mecklenburg County). Wood frame, 2 stories, built 2015, hardwired smoke detection throughout, hydrant within 500 ft.

TIV $6,500,000 across the schedule. Expiring premium $52,000 and the insured will move for anything close. Five-year loss history: one wind claim 2022 ($21,000 paid), otherwise clean.

SOV attached. Appreciate a quick look.

Priya Raman
Carolina Wholesale Brokerage

ATTACHMENT:
location,address,state,county,units,construction,year_built,tiv
1,8830 Stonehaven Dr Bldg A Charlotte NC 28215,NC,Mecklenburg,24,Frame 2 story,2015,3900000
2,8830 Stonehaven Dr Bldg B Charlotte NC 28215,NC,Mecklenburg,16,Frame 2 story,2015,2600000

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

Field	Expected	Current prompt v3	New prompt v6
insuredName	Queen City Rentals LLC	Queen City Rentals LLCMatches the expert	Queen City Rentals LLCMatches the expert
state	NC	NCMatches the expert	NCMatches the expert
county	Mecklenburg	MecklenburgMatches the expert	MecklenburgMatches the expert
units	40	40Matches the expert	40Matches the expert
tiv	$6,500,000	$6,500,000Matches the expert	$6,500,000Matches the expert
constructionType	frame	FrameMatches the expert	FrameMatches the expert
yearBuilt	2015	2015Matches the expert	2015Matches the expert
Decision	quote it IN APPETITE	quote it IN APPETITEMatches the expert	quote it IN APPETITEMatches the expert

For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result: ok
prompt tokens: 4,890
output tokens: 1,074
cost: $0.0250
latency: 13,001 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 86
retries: 0
fieldsWrong: 1
modelErrors

check	verdict
extraction_schema	pass
fields_correct	fail
construction_canonical	fail
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 86,
 "confidence": 0.9714285714285715,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, and 40 units, $6.5M TIV, and $52,000 GWP all fall well within limits. The 2015 two-story wood frame garden-apartment build is preferred construction. A single $21,000 wind claim in 2022 is the only friction, so this risk is bindable at a strong fit."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Wood frame, 2 stories",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.6,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five-year history.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Wood frame, 2 stories",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five-year history.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Wood frame, 2 stories",
   "correct": false
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "targetPremium",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: $52,000 is the expiring premium, not a stated target; the broker only said the insured will move for anything close."
  },
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: 'Garden apartments' is not stated in the sources; they say only 40-unit apartment community with two buildings."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v1",
  "at": "2026-10-21T01:01:22.376Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 1074,
    "costUsd": 0.0249918,
    "calls": 3,
    "cacheReadTokens": 1358,
    "cacheCreationTokens": 3526,
    "latencyMs": 13001,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": false,
    "construction_canonical": false,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "2b84e3c60d6ecf5a",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 86,
    "retries": 0,
    "fieldsWrong": 1,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": false,
      "detail": "constructionType"
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 86,
    "confidence": 0.9714285714285715,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, and 40 units, $6.5M TIV, and $52,000 GWP all fall well within limits. The 2015 two-story wood frame garden-apartment build is preferred construction. A single $21,000 wind claim in 2022 is the only friction, so this risk is bindable at a strong fit."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.99,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.98,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.98,
        "source": "both"
      },
      "constructionType": {
        "value": "Wood frame, 2 stories",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.98,
        "source": "both"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.6,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.6,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five-year history.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Wood frame, 2 stories",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five-year history.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Wood frame, 2 stories",
        "correct": false
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "targetPremium",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: $52,000 is the expiring premium, not a stated target; the broker only said the insured will move for anything close."
      },
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: 'Garden apartments' is not stated in the sources; they say only 40-unit apartment community with two buildings."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1358,
    "cacheCreationTokens": 3526,
    "outputTokens": 1074,
    "costUsd": 0.0249918,
    "latencyMs": 13001,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 86,
    "retries": 0,
    "fieldsWrong": 1,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": false,
      "detail": "constructionType"
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result: ok
prompt tokens: 5,296
output tokens: 1,091
cost: $0.0115
latency: 13,439 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 84
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 84,
 "confidence": 0.9714285714285715,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County carries no coastal restriction, and 40 units, $6.5M TIV, and $52,000 GWP all fall within mid-range bands. The 2015 frame build is newer construction and passes the construction rule. The 2022 wind claim ($21,000 paid) is the only friction, and it is minor against an otherwise clean five-year loss record, so this risk is bindable at standard terms."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.6,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "warn"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": [
  {
   "field": "subclass",
   "issue": "ambiguous",
   "detail": "not clearly supported by source: Sources describe a 40-unit apartment community of two 2-story buildings but never use the term 'garden apartments'; this is an inference."
  }
 ]
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v2",
  "at": "2026-10-21T01:01:07.087Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 1091,
    "costUsd": 0.011451,
    "calls": 3,
    "cacheReadTokens": 5290,
    "cacheCreationTokens": 0,
    "latencyMs": 13439,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "742576f6d007ac26",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 84,
    "confidence": 0.9714285714285715,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County carries no coastal restriction, and 40 units, $6.5M TIV, and $52,000 GWP all fall within mid-range bands. The 2015 frame build is newer construction and passes the construction rule. The 2022 wind claim ($21,000 paid) is the only friction, and it is minor against an otherwise clean five-year loss record, so this risk is bindable at standard terms."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.99,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.98,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.98,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.98,
        "source": "both"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.6,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.6,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "warn"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": [
      {
        "field": "subclass",
        "issue": "ambiguous",
        "detail": "not clearly supported by source: Sources describe a 40-unit apartment community of two 2-story buildings but never use the term 'garden apartments'; this is an inference."
      }
    ]
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5290,
    "cacheCreationTokens": 0,
    "outputTokens": 1091,
    "costUsd": 0.011451,
    "latencyMs": 13439,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result: ok
prompt tokens: 5,586
output tokens: 987
cost: $0.0104
latency: 13,388 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 84
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 84,
 "confidence": 0.972857142857143,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: all six rule checks passed, with 40 units under the 60 cap, $6.5M TIV in the mid-band, and $52K GWP well within the premium band. Mecklenburg County is clear of NC coastal restrictions, and 2015 frame construction is acceptable. A single $21K wind claim in 2022 is the only friction, so this risk merits a bind-ready review."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.99,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v3",
  "at": "2026-10-21T01:01:08.510Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 987,
    "costUsd": 0.010440000000000001,
    "calls": 3,
    "cacheReadTokens": 5580,
    "cacheCreationTokens": 0,
    "latencyMs": 13388,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "7afb27b1d7f6f77b",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 84,
    "confidence": 0.972857142857143,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: all six rule checks passed, with 40 units under the 60 cap, $6.5M TIV in the mid-band, and $52K GWP well within the premium band. Mecklenburg County is clear of NC coastal restrictions, and 2015 frame construction is acceptable. A single $21K wind claim in 2022 is the only friction, so this risk merits a bind-ready review."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.99,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.99,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.98,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.98,
        "source": "both"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.6,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5580,
    "cacheCreationTokens": 0,
    "outputTokens": 987,
    "costUsd": 0.010440000000000001,
    "latencyMs": 13388,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result: ok
prompt tokens: 5,586
output tokens: 995
cost: $0.0105
latency: 13,446 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 82
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	fail

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 82,
 "confidence": 0.972857142857143,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County carries no coastal restriction, and 40 units, $6.5M TIV, and $52,000 GWP all fall mid-band. The 2015 frame build is acceptable and newer than the pre-1950 exclusions. A single $21,000 wind claim in 2022 is the only friction, so this risk is bindable at a strong fit."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.99,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:01:09.368Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 995,
    "costUsd": 0.010519999999999998,
    "calls": 3,
    "cacheReadTokens": 5580,
    "cacheCreationTokens": 0,
    "latencyMs": 13446,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": false
  },
  "output_hash": "4300436e7062762d",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 82,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 82,
    "confidence": 0.972857142857143,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County carries no coastal restriction, and 40 units, $6.5M TIV, and $52,000 GWP all fall mid-band. The 2015 frame build is acceptable and newer than the pre-1950 exclusions. A single $21,000 wind claim in 2022 is the only friction, so this risk is bindable at a strong fit."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.99,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.99,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.98,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.98,
        "source": "both"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.6,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "Five-year history: one wind claim in 2022, $21,000 paid; otherwise clean.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5580,
    "cacheCreationTokens": 0,
    "outputTokens": 995,
    "costUsd": 0.010519999999999998,
    "latencyMs": 13446,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 82,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result: ok
prompt tokens: 5,725
output tokens: 1,269
cost: $0.0265
latency: 14,639 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 84
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 84,
 "confidence": 0.9685714285714285,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, and 40 units and $6.5M TIV fall mid-band. The 2015 frame build is acceptable and newer, and the single 2022 wind claim ($21,000 paid) is minor, so this risk merits a bind-ready quote."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.98,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.97,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.97,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0,
   "source": null
  },
  "priorLossSummary": {
   "value": "Five-year history: one wind claim in 2022 with $21,000 paid; otherwise clean.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "priorLossSummary",
   "value": "Five-year history: one wind claim in 2022 with $21,000 paid; otherwise clean.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v4",
  "at": "2026-10-21T01:01:14.432Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 1269,
    "costUsd": 0.026549499999999997,
    "calls": 3,
    "cacheReadTokens": 2315,
    "cacheCreationTokens": 3404,
    "latencyMs": 14639,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "f0a9063e7d730559",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 84,
    "confidence": 0.9685714285714285,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, and 40 units and $6.5M TIV fall mid-band. The 2015 frame build is acceptable and newer, and the single 2022 wind claim ($21,000 paid) is minor, so this risk merits a bind-ready quote."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.98,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.98,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.97,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.97,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.98,
        "source": "both"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0,
        "source": null
      },
      "priorLossSummary": {
        "value": "Five-year history: one wind claim in 2022 with $21,000 paid; otherwise clean.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "priorLossSummary",
        "value": "Five-year history: one wind claim in 2022 with $21,000 paid; otherwise clean.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 2315,
    "cacheCreationTokens": 3404,
    "outputTokens": 1269,
    "costUsd": 0.026549499999999997,
    "latencyMs": 14639,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result: ok
prompt tokens: 5,849
output tokens: 969
cost: $0.0103
latency: 12,665 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 84
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 84,
 "confidence": 0.9785714285714286,
 "reasons": [
  "All five rule checks passed: NC is an appetite state, 40 units sits under the 60-unit cap, $6.5M TIV falls mid-band, Frame construction is acceptable, and Mecklenburg County carries no coastal restriction. The 2015 build is newer and the loss history is light, with one $21,000 wind claim in 2022, so the account sits comfortably inside appetite with minor friction from that wind loss. Frame construction and 40 units leave modest headroom, so confirm roof age and wind mitigation before bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.97,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.99,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.99,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.99,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.95,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "priorLossSummary",
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v5",
  "at": "2026-10-21T01:01:21.185Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 969,
    "costUsd": 0.0102863,
    "calls": 3,
    "cacheReadTokens": 5843,
    "cacheCreationTokens": 0,
    "latencyMs": 12665,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "c6eb53d0f5d0a975",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 84,
    "confidence": 0.9785714285714286,
    "reasons": [
      "All five rule checks passed: NC is an appetite state, 40 units sits under the 60-unit cap, $6.5M TIV falls mid-band, Frame construction is acceptable, and Mecklenburg County carries no coastal restriction. The 2015 build is newer and the loss history is light, with one $21,000 wind claim in 2022, so the account sits comfortably inside appetite with minor friction from that wind loss. Frame construction and 40 units leave modest headroom, so confirm roof age and wind mitigation before bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.97,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.99,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.99,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.99,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.98,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.99,
        "source": "both"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.95,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "priorLossSummary",
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5843,
    "cacheCreationTokens": 0,
    "outputTokens": 969,
    "costUsd": 0.0102863,
    "latencyMs": 12665,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result: ok
prompt tokens: 5,884
output tokens: 919
cost: $0.0267
latency: 12,544 ms · 3 calls
at: 2026-10-21 01:01
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 84
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 84,
 "confidence": 0.9657142857142856,
 "reasons": [
  "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, 40 units is under the 60-unit cap, and $6.5M TIV falls mid-band. The 2015 frame build is acceptable construction, and a single $21K wind claim in 2022 is the only friction on an otherwise clean five-year loss history. Strong candidate to quote and bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Queen City Rentals LLC",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "confidence": 0.95,
   "source": "both"
  },
  "state": {
   "value": "NC",
   "confidence": 0.98,
   "source": "both"
  },
  "county": {
   "value": "Mecklenburg",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 40,
   "confidence": 0.97,
   "source": "both"
  },
  "tiv": {
   "value": 6500000,
   "confidence": 0.97,
   "source": "both"
  },
  "constructionType": {
   "value": "Frame",
   "confidence": 0.95,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2015,
   "confidence": 0.97,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.95,
   "source": null
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Queen City Rentals LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
   "source": "both"
  },
  {
   "field": "state",
   "value": "NC",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Mecklenburg",
   "source": "both"
  },
  {
   "field": "units",
   "value": 40,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 6500000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Frame",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2015,
   "source": "both"
  },
  {
   "field": "priorLossSummary",
   "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Queen City Rentals LLC",
   "got": "Queen City Rentals LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "NC",
   "got": "NC",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Mecklenburg",
   "got": "Mecklenburg",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6500000,
   "got": 6500000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "frame",
   "got": "Frame",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2015,
   "got": 2015,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-03",
  "variant": "v6",
  "at": "2026-10-21T01:01:19.637Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 919,
    "costUsd": 0.026657300000000002,
    "calls": 3,
    "cacheReadTokens": 1553,
    "cacheCreationTokens": 4325,
    "latencyMs": 12544,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "46fc678a6f02e215",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 84,
    "confidence": 0.9657142857142856,
    "reasons": [
      "Queen City Rentals sits comfortably inside appetite: NC is an allowed state, Mecklenburg County is clear of coastal restrictions, 40 units is under the 60-unit cap, and $6.5M TIV falls mid-band. The 2015 frame build is acceptable construction, and a single $21K wind claim in 2022 is the only friction on an otherwise clean five-year loss history. Strong candidate to quote and bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Queen City Rentals LLC",
        "confidence": 0.97,
        "source": "email"
      },
      "propertyAddress": {
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "confidence": 0.95,
        "source": "both"
      },
      "state": {
        "value": "NC",
        "confidence": 0.98,
        "source": "both"
      },
      "county": {
        "value": "Mecklenburg",
        "confidence": 0.98,
        "source": "both"
      },
      "units": {
        "value": 40,
        "confidence": 0.97,
        "source": "both"
      },
      "tiv": {
        "value": 6500000,
        "confidence": 0.97,
        "source": "both"
      },
      "constructionType": {
        "value": "Frame",
        "confidence": 0.95,
        "source": "both"
      },
      "yearBuilt": {
        "value": 2015,
        "confidence": 0.97,
        "source": "both"
      },
      "targetPremium": {
        "value": null,
        "confidence": 0.95,
        "source": null
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "confidence": 0.95,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Queen City Rentals LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "8830 Stonehaven Dr, Charlotte, NC 28215",
        "source": "both"
      },
      {
        "field": "state",
        "value": "NC",
        "source": "both"
      },
      {
        "field": "county",
        "value": "Mecklenburg",
        "source": "both"
      },
      {
        "field": "units",
        "value": 40,
        "source": "both"
      },
      {
        "field": "tiv",
        "value": 6500000,
        "source": "both"
      },
      {
        "field": "constructionType",
        "value": "Frame",
        "source": "both"
      },
      {
        "field": "yearBuilt",
        "value": 2015,
        "source": "both"
      },
      {
        "field": "priorLossSummary",
        "value": "One wind claim in 2022, $21,000 paid; otherwise clean over five years.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Queen City Rentals LLC",
        "got": "Queen City Rentals LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "NC",
        "got": "NC",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Mecklenburg",
        "got": "Mecklenburg",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6500000,
        "got": 6500000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "frame",
        "got": "Frame",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2015,
        "got": 2015,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1553,
    "cacheCreationTokens": 4325,
    "outputTokens": 919,
    "costUsd": 0.026657300000000002,
    "latencyMs": 12544,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 84,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}