GOLD-27

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Regression desk

Hi team,

New commercial property risk for the landlord program. Insured is Kestrel Holdings LLC, a 40-unit building at 1820 Palmetto Row, Columbus, OH 43215 (Franklin County). Joisted masonry construction, built 2009, fully sprinklered, roofs replaced 2021.

TIV is $6,800,000 building and contents. Target premium $52,000. No losses in the past five years, loss runs attached.

Thanks.

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

Field	Expected	Current prompt v3	New prompt v6
insuredName	Kestrel Holdings LLC	Kestrel Holdings LLCMatches the expert	Kestrel Holdings LLCMatches the expert
state	OH	OHMatches the expert	OHMatches the expert
county	Franklin	FranklinMatches the expert	FranklinMatches the expert
units	40	40Matches the expert	40Matches the expert
tiv	$6,800,000	$6,800,000Matches the expert	$6,800,000Matches the expert
constructionType	joisted masonry	Joisted MasonryMatches the expert	Joisted MasonryMatches the expert
yearBuilt	2009	2009Matches the expert	2009Matches the expert
targetPremium	$52,000	$52,000Matches the expert	$52,000Matches the expert
subclass	Not provided	Not providedMatches the expert	Not providedMatches the expert
Decision	quote it IN APPETITE	quote it IN APPETITEMatches the expert	quote it IN APPETITEMatches the expert

For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result: ok
prompt tokens: 4,315
output tokens: 900
cost: $0.0094
latency: 13,225 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9642857142857143,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. The 2009 joisted masonry build is acceptable construction, Franklin County has no coastal restriction, and the $52,000 target GWP is inside the premium band. Five years of clean losses support a bind, with the small deduction reflecting joisted masonry's lower fire-resistance versus preferred construction types."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.95,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.95,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.4,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached per broker.",
   "confidence": 0.85,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached per broker.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v1",
  "at": "2026-10-21T01:11:38.231Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 900,
    "costUsd": 0.0094429,
    "calls": 3,
    "cacheReadTokens": 4309,
    "cacheCreationTokens": 0,
    "latencyMs": 13225,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "6629e5da05d94a2a",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9642857142857143,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. The 2009 joisted masonry build is acceptable construction, Franklin County has no coastal restriction, and the $52,000 target GWP is inside the premium band. Five years of clean losses support a bind, with the small deduction reflecting joisted masonry's lower fire-resistance versus preferred construction types."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.95,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.95,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.4,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached per broker.",
        "confidence": 0.85,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached per broker.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4309,
    "cacheCreationTokens": 0,
    "outputTokens": 900,
    "costUsd": 0.0094429,
    "latencyMs": 13225,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result: ok
prompt tokens: 4,746
output tokens: 883
cost: $0.0093
latency: 13,253 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9699999999999999,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and the $6.8M TIV falls mid-band. 2009 joisted masonry construction, a $52,000 GWP target within the premium band, and five clean loss years make this a strong bind candidate. Joisted masonry is acceptable but not the most preferred construction class, which keeps the score from the top of the range."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.97,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.5,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v2",
  "at": "2026-10-21T01:11:11.213Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 883,
    "costUsd": 0.009316000000000001,
    "calls": 3,
    "cacheReadTokens": 4740,
    "cacheCreationTokens": 0,
    "latencyMs": 13253,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "ce4989fe82e7dc0a",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9699999999999999,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and the $6.8M TIV falls mid-band. 2009 joisted masonry construction, a $52,000 GWP target within the premium band, and five clean loss years make this a strong bind candidate. Joisted masonry is acceptable but not the most preferred construction class, which keeps the score from the top of the range."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.97,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.5,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4740,
    "cacheCreationTokens": 0,
    "outputTokens": 883,
    "costUsd": 0.009316000000000001,
    "latencyMs": 13253,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result: ok
prompt tokens: 5,066
output tokens: 880
cost: $0.0218
latency: 14,348 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9699999999999999,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. Joisted masonry built in 2009, a clean five-year loss record, and a $52,000 target GWP within the premium band make this a strong bind candidate. Minor friction: joisted masonry is less preferred than fire-resistive construction."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached per broker.",
   "confidence": 0.85,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached per broker.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v3",
  "at": "2026-10-21T01:11:16.261Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 880,
    "costUsd": 0.0218097,
    "calls": 3,
    "cacheReadTokens": 1857,
    "cacheCreationTokens": 3203,
    "latencyMs": 14348,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "7dd959e583da7517",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9699999999999999,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. Joisted masonry built in 2009, a clean five-year loss record, and a $52,000 target GWP within the premium band make this a strong bind candidate. Minor friction: joisted masonry is less preferred than fire-resistive construction."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached per broker.",
        "confidence": 0.85,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached per broker.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1857,
    "cacheCreationTokens": 3203,
    "outputTokens": 880,
    "costUsd": 0.0218097,
    "latencyMs": 14348,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result: ok
prompt tokens: 5,068
output tokens: 890
cost: $0.0219
latency: 15,026 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9699999999999999,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an appetite state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. 2009 joisted masonry construction is acceptable, Franklin County carries no coastal restriction, and the $52,000 target GWP is within the premium band. Clean five-year loss history supports bind; the loss runs are referenced as attached but not yet verified."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.98,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs referenced as attached.",
   "confidence": 0.85,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs referenced as attached.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:11:21.355Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 890,
    "costUsd": 0.021917700000000002,
    "calls": 3,
    "cacheReadTokens": 1857,
    "cacheCreationTokens": 3205,
    "latencyMs": 15026,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "92c629faebcd4090",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9699999999999999,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an appetite state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. 2009 joisted masonry construction is acceptable, Franklin County carries no coastal restriction, and the $52,000 target GWP is within the premium band. Clean five-year loss history supports bind; the loss runs are referenced as attached but not yet verified."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.98,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs referenced as attached.",
        "confidence": 0.85,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs referenced as attached.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1857,
    "cacheCreationTokens": 3205,
    "outputTokens": 890,
    "costUsd": 0.021917700000000002,
    "latencyMs": 15026,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result: ok
prompt tokens: 5,269
output tokens: 874
cost: $0.0093
latency: 13,799 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9699999999999999,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and the $6.8M TIV falls mid-band. Joisted masonry built in 2009 is acceptable construction, Franklin County carries no coastal restriction, and the $52,000 target GWP sits well inside the premium band. Five clean loss years support a bind-ready file."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.97,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v4",
  "at": "2026-10-21T01:11:25.221Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 874,
    "costUsd": 0.0092783,
    "calls": 3,
    "cacheReadTokens": 5263,
    "cacheCreationTokens": 0,
    "latencyMs": 13799,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "71f924933e92172c",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9699999999999999,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and the $6.8M TIV falls mid-band. Joisted masonry built in 2009 is acceptable construction, Franklin County carries no coastal restriction, and the $52,000 target GWP sits well inside the premium band. Five clean loss years support a bind-ready file."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.97,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5263,
    "cacheCreationTokens": 0,
    "outputTokens": 874,
    "costUsd": 0.0092783,
    "latencyMs": 13799,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result: ok
prompt tokens: 5,401
output tokens: 894
cost: $0.0095
latency: 12,694 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9699999999999999,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls in the mid-band of the $250K-$15M range. Joisted masonry built in 2009 is acceptable construction, the five-year loss history is clean, and the $52,000 target GWP sits well inside the premium band. Franklin County carries no coastal restriction, so this risk is ready to bind-quote."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.97,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.97,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v5",
  "at": "2026-10-21T01:11:33.990Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 894,
    "costUsd": 0.0094915,
    "calls": 3,
    "cacheReadTokens": 5395,
    "cacheCreationTokens": 0,
    "latencyMs": 12694,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "dae2ea476e7d2a1f",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9699999999999999,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls in the mid-band of the $250K-$15M range. Joisted masonry built in 2009 is acceptable construction, the five-year loss history is clean, and the $52,000 target GWP sits well inside the premium band. Franklin County carries no coastal restriction, so this risk is ready to bind-quote."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.97,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.97,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5395,
    "cacheCreationTokens": 0,
    "outputTokens": 894,
    "costUsd": 0.0094915,
    "latencyMs": 12694,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result: ok
prompt tokens: 5,436
output tokens: 905
cost: $0.0123
latency: 12,606 ms · 3 calls
at: 2026-10-21 01:11
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	pass
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9714285714285713,
 "reasons": [
  "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. Joisted masonry built in 2009 is acceptable construction, Franklin County carries no coastal restriction, and the $52,000 target GWP sits inside the premium band. Five clean loss years support a bind-ready file; joisted masonry is slightly less preferred than fire-resistive, which holds the score below the top tier."
 ],
 "extraction": {
  "insuredName": {
   "value": "Kestrel Holdings LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 40,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 6800000,
   "confidence": 0.95,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.97,
   "source": "email"
  },
  "yearBuilt": {
   "value": 2009,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 52000,
   "confidence": 0.97,
   "source": "email"
  },
  "subclass": {
   "value": null,
   "confidence": 0.9,
   "source": null
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; loss runs attached.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Kestrel Holdings LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "1820 Palmetto Row, Columbus, OH 43215",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 40,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 6800000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 2009,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 52000,
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; loss runs attached.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Kestrel Holdings LLC",
   "got": "Kestrel Holdings LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 40,
   "got": 40,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 6800000,
   "got": 6800000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2009,
   "got": 2009,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 52000,
   "got": 52000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": null,
   "got": null,
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-27",
  "variant": "v6",
  "at": "2026-10-21T01:11:24.731Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 905,
    "costUsd": 0.012257,
    "calls": 3,
    "cacheReadTokens": 4750,
    "cacheCreationTokens": 680,
    "latencyMs": 12606,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "nulls_stay_null": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "2721fe769b0c4fbb",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9714285714285713,
    "reasons": [
      "Kestrel Holdings sits comfortably inside appetite: Ohio is an allowed state, 40 units is well under the 60-unit cap, and $6.8M TIV falls mid-band. Joisted masonry built in 2009 is acceptable construction, Franklin County carries no coastal restriction, and the $52,000 target GWP sits inside the premium band. Five clean loss years support a bind-ready file; joisted masonry is slightly less preferred than fire-resistive, which holds the score below the top tier."
    ],
    "extraction": {
      "insuredName": {
        "value": "Kestrel Holdings LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 40,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 6800000,
        "confidence": 0.95,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.97,
        "source": "email"
      },
      "yearBuilt": {
        "value": 2009,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 52000,
        "confidence": 0.97,
        "source": "email"
      },
      "subclass": {
        "value": null,
        "confidence": 0.9,
        "source": null
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; loss runs attached.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Kestrel Holdings LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "1820 Palmetto Row, Columbus, OH 43215",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 40,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 6800000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 2009,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 52000,
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; loss runs attached.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Kestrel Holdings LLC",
        "got": "Kestrel Holdings LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 40,
        "got": 40,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 6800000,
        "got": 6800000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 2009,
        "got": 2009,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 52000,
        "got": 52000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": null,
        "got": null,
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 4750,
    "cacheCreationTokens": 680,
    "outputTokens": 905,
    "costUsd": 0.012257,
    "latencyMs": 12606,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}