GOLD-01

extraction-prompts · run 2026-10-20-v6

What the broker wrote

What every version was given, as the suite chose to show it.

Broker: Danielle Ortiz, Ortiz & Lane Insurance Services

Hi team,

New habitational risk for your landlord program. Insured is Maple Row Apartments LLC, a 24-unit garden-style apartment complex at 4410 Kenway Blvd, Columbus, OH 43220 (Franklin County). Joisted masonry construction, built 1998, fully sprinklered, updated roofs 2019.

TIV is $4,200,000 (building + contents + 12 months loss of rents). Target premium around $38,000. No losses in the past five years — clean loss runs attached to the prior carrier's renewal.

Current carrier is non-renewing habitational statewide, so the insured needs terms in two weeks. Let me know if this fits appetite.

Thanks,
Danielle Ortiz
Ortiz & Lane Insurance Services

What each version answered

Compare each answer with the expert's answer. Highlighted cells differ from the expert; marked rows show where the versions disagree.

Field	Expected	Current prompt v3	New prompt v6
insuredName	Maple Row Apartments LLC	Maple Row Apartments LLCMatches the expert	Maple Row Apartments LLCMatches the expert
state	OH	OHMatches the expert	OHMatches the expert
county	Franklin	FranklinMatches the expert	FranklinMatches the expert
units	24	24Matches the expert	24Matches the expert
tiv	$4,200,000	$4,200,000Matches the expert	$4,200,000Matches the expert
constructionType	joisted masonry	Joisted MasonryMatches the expert	Joisted MasonryMatches the expert
yearBuilt	1998	1998Matches the expert	1998Matches the expert
targetPremium	$38,000	$38,000Matches the expert	$38,000Matches the expert
subclass	Garden apartments	Garden apartmentsMatches the expert	Garden apartmentsMatches the expert
Decision	quote it IN APPETITE	quote it IN APPETITEMatches the expert	quote it IN APPETITEMatches the expert

For engineers

Checks are the suite's binary checks on each output; a judge that gave no verdict is unanswered and not counted.

v1

result: ok
prompt tokens: 4,575
output tokens: 980
cost: $0.0234
latency: 15,088 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9714285714285714,
 "reasons": [
  "Maple Row Apartments sits comfortably inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is acceptable construction, the $38,000 target GWP sits inside the premium band, and five clean loss years support a bind. Franklin County carries no coastal restriction, and the only friction is the carrier-referenced (not directly verified) loss runs."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.8,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.92,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs referenced from the prior carrier's renewal.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs referenced from the prior carrier's renewal.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v1",
  "at": "2026-10-21T01:00:31.378Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 980,
    "costUsd": 0.0233612,
    "calls": 3,
    "cacheReadTokens": 1212,
    "cacheCreationTokens": 3357,
    "latencyMs": 15088,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "4ea8a0f19ffd2d91",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9714285714285714,
    "reasons": [
      "Maple Row Apartments sits comfortably inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is acceptable construction, the $38,000 target GWP sits inside the premium band, and five clean loss years support a bind. Franklin County carries no coastal restriction, and the only friction is the carrier-referenced (not directly verified) loss runs."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.8,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.92,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs referenced from the prior carrier's renewal.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs referenced from the prior carrier's renewal.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 1212,
    "cacheCreationTokens": 3357,
    "outputTokens": 980,
    "costUsd": 0.0233612,
    "latencyMs": 15088,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v2

result: ok
prompt tokens: 5,010
output tokens: 953
cost: $0.0100
latency: 13,221 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 88
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9714285714285714,
 "reasons": [
  "Maple Row Apartments sits comfortably inside appetite: Ohio is an appetite state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, Franklin County carries no coastal restriction, and the $38,000 target GWP sits inside the premium band. Five years of clean loss runs support a bind; the only friction is that loss runs are referenced rather than attached."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v2",
  "at": "2026-10-21T01:00:15.234Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 953,
    "costUsd": 0.0100424,
    "calls": 3,
    "cacheReadTokens": 5004,
    "cacheCreationTokens": 0,
    "latencyMs": 13221,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "1e8b6526bd41de33",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 88,
    "confidence": 0.9714285714285714,
    "reasons": [
      "Maple Row Apartments sits comfortably inside appetite: Ohio is an appetite state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, Franklin County carries no coastal restriction, and the $38,000 target GWP sits inside the premium band. Five years of clean loss runs support a bind; the only friction is that loss runs are referenced rather than attached."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5004,
    "cacheCreationTokens": 0,
    "outputTokens": 953,
    "costUsd": 0.0100424,
    "latencyMs": 13221,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 88,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3

result: ok
prompt tokens: 5,324
output tokens: 940
cost: $0.0099
latency: 13,164 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 90
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.9714285714285714,
 "reasons": [
  "Maple Row Apartments sits comfortably inside appetite: Ohio is an approved state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is acceptable construction, Franklin County carries no coastal restriction, and the $38,000 target GWP sits within the premium band. Five clean loss years support a bind-ready submission."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v3",
  "at": "2026-10-21T01:00:15.182Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 940,
    "costUsd": 0.009943799999999997,
    "calls": 3,
    "cacheReadTokens": 5318,
    "cacheCreationTokens": 0,
    "latencyMs": 13164,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "2b10a024e7cdc78a",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.9714285714285714,
    "reasons": [
      "Maple Row Apartments sits comfortably inside appetite: Ohio is an approved state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is acceptable construction, Franklin County carries no coastal restriction, and the $38,000 target GWP sits within the premium band. Five clean loss years support a bind-ready submission."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5318,
    "cacheCreationTokens": 0,
    "outputTokens": 940,
    "costUsd": 0.009943799999999997,
    "latencyMs": 13164,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v3-repeat

result: ok
prompt tokens: 5,304
output tokens: 928
cost: $0.0098
latency: 13,485 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 90
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.9714285714285714,
 "reasons": [
  "Maple Row Apartments sits well inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV falls in the middle of the $250K–$15M band. Joisted masonry built in 1998 is preferred construction, the $38,000 GWP target is within band, and five years of clean loss runs support a straightforward bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs per broker.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs per broker.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v3-repeat",
  "at": "2026-10-21T01:00:15.520Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 928,
    "costUsd": 0.0098218,
    "calls": 3,
    "cacheReadTokens": 5298,
    "cacheCreationTokens": 0,
    "latencyMs": 13485,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "62552a105bc80a74",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.9714285714285714,
    "reasons": [
      "Maple Row Apartments sits well inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV falls in the middle of the $250K–$15M band. Joisted masonry built in 1998 is preferred construction, the $38,000 GWP target is within band, and five years of clean loss runs support a straightforward bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs per broker.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs per broker.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 5298,
    "cacheCreationTokens": 0,
    "outputTokens": 928,
    "costUsd": 0.0098218,
    "latencyMs": 13485,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v4

result: ok
prompt tokens: 5,507
output tokens: 896
cost: $0.0225
latency: 14,866 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 92
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 92,
 "confidence": 0.97,
 "reasons": [
  "Maple Row sits well inside appetite: Ohio is an approved state, 24 units is far below the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, the $38,000 GWP target sits comfortably within the premium band, and five clean loss years make this a strong candidate to bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.97,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.95,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.95,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v4",
  "at": "2026-10-21T01:00:16.882Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 896,
    "costUsd": 0.0225169,
    "calls": 3,
    "cacheReadTokens": 2169,
    "cacheCreationTokens": 3332,
    "latencyMs": 14866,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "8a95de7d81456b39",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 92,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 92,
    "confidence": 0.97,
    "reasons": [
      "Maple Row sits well inside appetite: Ohio is an approved state, 24 units is far below the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, the $38,000 GWP target sits comfortably within the premium band, and five clean loss years make this a strong candidate to bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.97,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.95,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.95,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 2169,
    "cacheCreationTokens": 3332,
    "outputTokens": 896,
    "costUsd": 0.0225169,
    "latencyMs": 14866,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 92,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v5

result: ok
prompt tokens: 5,673
output tokens: 962
cost: $0.0233
latency: 13,453 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 90
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.9742857142857142,
 "reasons": [
  "Maple Row Apartments sits comfortably inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV is mid-band. Joisted masonry built in 1998 is preferred construction, the $38K GWP target falls inside the premium band, and five clean loss years support a bind. Loss runs are referenced as attached to the prior carrier's renewal, so confirm them before binding."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.97,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs referenced as attached to the prior carrier's renewal.",
   "confidence": 0.9,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs referenced as attached to the prior carrier's renewal.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v5",
  "at": "2026-10-21T01:00:28.695Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 962,
    "costUsd": 0.023326100000000002,
    "calls": 3,
    "cacheReadTokens": 2301,
    "cacheCreationTokens": 3366,
    "latencyMs": 13453,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "239b6464a1a0dd6b",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.9742857142857142,
    "reasons": [
      "Maple Row Apartments sits comfortably inside appetite: Ohio is an allowed state, 24 units is well under the 60-unit cap, and $4.2M TIV is mid-band. Joisted masonry built in 1998 is preferred construction, the $38K GWP target falls inside the premium band, and five clean loss years support a bind. Loss runs are referenced as attached to the prior carrier's renewal, so confirm them before binding."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.97,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs referenced as attached to the prior carrier's renewal.",
        "confidence": 0.9,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs referenced as attached to the prior carrier's renewal.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 2301,
    "cacheCreationTokens": 3366,
    "outputTokens": 962,
    "costUsd": 0.023326100000000002,
    "latencyMs": 13453,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}

v6

result: ok
prompt tokens: 5,700
output tokens: 925
cost: $0.0189
latency: 13,858 ms · 3 calls
at: 2026-10-21 01:00
stages: intake extraction grounding appetite
decision: IN APPETITE
fitScore: 90
retries: 0
fieldsWrong: 0
modelErrors

check	verdict
extraction_schema	pass
fields_correct	pass
construction_canonical	pass
nulls_stay_null	not applicable
decision_correct	pass
attribution_jev	unanswered
attribution_claude	pass

{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 90,
 "confidence": 0.9728571428571428,
 "reasons": [
  "Maple Row Apartments sits comfortably inside appetite: Ohio is an approved state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, Franklin County has no coastal restriction, the $38,000 GWP target is inside the premium band, and five clean loss years support a bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Maple Row Apartments LLC",
   "confidence": 0.98,
   "source": "email"
  },
  "propertyAddress": {
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "confidence": 0.97,
   "source": "email"
  },
  "state": {
   "value": "OH",
   "confidence": 0.98,
   "source": "email"
  },
  "county": {
   "value": "Franklin",
   "confidence": 0.97,
   "source": "email"
  },
  "units": {
   "value": 24,
   "confidence": 0.98,
   "source": "email"
  },
  "tiv": {
   "value": 4200000,
   "confidence": 0.97,
   "source": "email"
  },
  "constructionType": {
   "value": "Joisted Masonry",
   "confidence": 0.96,
   "source": "email"
  },
  "yearBuilt": {
   "value": 1998,
   "confidence": 0.97,
   "source": "email"
  },
  "targetPremium": {
   "value": 38000,
   "confidence": 0.85,
   "source": "email"
  },
  "subclass": {
   "value": "Garden apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "confidence": 0.93,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Maple Row Apartments LLC",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "4410 Kenway Blvd, Columbus, OH 43220",
   "source": "email"
  },
  {
   "field": "state",
   "value": "OH",
   "source": "email"
  },
  {
   "field": "county",
   "value": "Franklin",
   "source": "email"
  },
  {
   "field": "units",
   "value": 24,
   "source": "email"
  },
  {
   "field": "tiv",
   "value": 4200000,
   "source": "email"
  },
  {
   "field": "constructionType",
   "value": "Joisted Masonry",
   "source": "email"
  },
  {
   "field": "yearBuilt",
   "value": 1998,
   "source": "email"
  },
  {
   "field": "targetPremium",
   "value": 38000,
   "source": "email"
  },
  {
   "field": "subclass",
   "value": "Garden apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Maple Row Apartments LLC",
   "got": "Maple Row Apartments LLC",
   "correct": true
  },
  {
   "field": "state",
   "expected": "OH",
   "got": "OH",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Franklin",
   "got": "Franklin",
   "correct": true
  },
  {
   "field": "units",
   "expected": 24,
   "got": 24,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 4200000,
   "got": 4200000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "joisted masonry",
   "got": "Joisted Masonry",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 1998,
   "got": 1998,
   "correct": true
  },
  {
   "field": "targetPremium",
   "expected": 38000,
   "got": 38000,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Garden apartments",
   "got": "Garden apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

Trace line (JSON)

{
  "run_id": "2026-10-20-v6",
  "suite": "extraction-prompts",
  "case_id": "GOLD-01",
  "variant": "v6",
  "at": "2026-10-21T01:00:29.091Z",
  "ok": true,
  "usage": {
    "inputTokens": 6,
    "outputTokens": 925,
    "costUsd": 0.0189418,
    "calls": 3,
    "cacheReadTokens": 3358,
    "cacheCreationTokens": 2336,
    "latencyMs": 13858,
    "metered": true,
    "provider": "claude-cli"
  },
  "checks": {
    "extraction_schema": true,
    "fields_correct": true,
    "construction_canonical": true,
    "decision_correct": true,
    "attribution_claude": true
  },
  "output_hash": "395f703e4e8139e0",
  "unanswered": [
    "attribution_jev"
  ],
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ],
  "cached": false
}

Full output record (JSON)

{
  "output": {
    "decision": "IN APPETITE",
    "expectedDecision": "IN APPETITE",
    "decisionCorrect": true,
    "fitScore": 90,
    "confidence": 0.9728571428571428,
    "reasons": [
      "Maple Row Apartments sits comfortably inside appetite: Ohio is an approved state, 24 units is well under the 60-unit cap, and $4.2M TIV falls mid-band. Joisted masonry built in 1998 is preferred construction, Franklin County has no coastal restriction, the $38,000 GWP target is inside the premium band, and five clean loss years support a bind."
    ],
    "extraction": {
      "insuredName": {
        "value": "Maple Row Apartments LLC",
        "confidence": 0.98,
        "source": "email"
      },
      "propertyAddress": {
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "confidence": 0.97,
        "source": "email"
      },
      "state": {
        "value": "OH",
        "confidence": 0.98,
        "source": "email"
      },
      "county": {
        "value": "Franklin",
        "confidence": 0.97,
        "source": "email"
      },
      "units": {
        "value": 24,
        "confidence": 0.98,
        "source": "email"
      },
      "tiv": {
        "value": 4200000,
        "confidence": 0.97,
        "source": "email"
      },
      "constructionType": {
        "value": "Joisted Masonry",
        "confidence": 0.96,
        "source": "email"
      },
      "yearBuilt": {
        "value": 1998,
        "confidence": 0.97,
        "source": "email"
      },
      "targetPremium": {
        "value": 38000,
        "confidence": 0.85,
        "source": "email"
      },
      "subclass": {
        "value": "Garden apartments",
        "confidence": 0.95,
        "source": "email"
      },
      "priorLossSummary": {
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "confidence": 0.93,
        "source": "email"
      }
    },
    "extracted": [
      {
        "field": "insuredName",
        "value": "Maple Row Apartments LLC",
        "source": "email"
      },
      {
        "field": "propertyAddress",
        "value": "4410 Kenway Blvd, Columbus, OH 43220",
        "source": "email"
      },
      {
        "field": "state",
        "value": "OH",
        "source": "email"
      },
      {
        "field": "county",
        "value": "Franklin",
        "source": "email"
      },
      {
        "field": "units",
        "value": 24,
        "source": "email"
      },
      {
        "field": "tiv",
        "value": 4200000,
        "source": "email"
      },
      {
        "field": "constructionType",
        "value": "Joisted Masonry",
        "source": "email"
      },
      {
        "field": "yearBuilt",
        "value": 1998,
        "source": "email"
      },
      {
        "field": "targetPremium",
        "value": 38000,
        "source": "email"
      },
      {
        "field": "subclass",
        "value": "Garden apartments",
        "source": "email"
      },
      {
        "field": "priorLossSummary",
        "value": "No losses in the past five years; clean loss runs referenced from prior carrier's renewal.",
        "source": "email"
      }
    ],
    "fields": [
      {
        "field": "insuredName",
        "expected": "Maple Row Apartments LLC",
        "got": "Maple Row Apartments LLC",
        "correct": true
      },
      {
        "field": "state",
        "expected": "OH",
        "got": "OH",
        "correct": true
      },
      {
        "field": "county",
        "expected": "Franklin",
        "got": "Franklin",
        "correct": true
      },
      {
        "field": "units",
        "expected": 24,
        "got": 24,
        "correct": true
      },
      {
        "field": "tiv",
        "expected": 4200000,
        "got": 4200000,
        "correct": true
      },
      {
        "field": "constructionType",
        "expected": "joisted masonry",
        "got": "Joisted Masonry",
        "correct": true
      },
      {
        "field": "yearBuilt",
        "expected": 1998,
        "got": 1998,
        "correct": true
      },
      {
        "field": "targetPremium",
        "expected": 38000,
        "got": 38000,
        "correct": true
      },
      {
        "field": "subclass",
        "expected": "Garden apartments",
        "got": "Garden apartments",
        "correct": true
      }
    ],
    "retries": 0,
    "guardrails": [
      {
        "node": "extraction",
        "guardrail": "schema",
        "status": "pass"
      },
      {
        "node": "grounding",
        "guardrail": "grounding",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "missing_fields",
        "status": "pass"
      },
      {
        "node": "appetite",
        "guardrail": "confidence",
        "status": "pass"
      }
    ],
    "flags": []
  },
  "usage": {
    "inputTokens": 6,
    "cacheReadTokens": 3358,
    "cacheCreationTokens": 2336,
    "outputTokens": 925,
    "costUsd": 0.0189418,
    "latencyMs": 13858,
    "calls": 3,
    "metered": true,
    "provider": "claude-cli"
  },
  "extra": {
    "decision": "IN APPETITE",
    "fitScore": 90,
    "retries": 0,
    "fieldsWrong": 0,
    "modelErrors": ""
  },
  "stages": [
    {
      "name": "intake",
      "ok": true
    },
    {
      "name": "extraction",
      "ok": true
    },
    {
      "name": "grounding",
      "ok": true
    },
    {
      "name": "appetite",
      "ok": true
    }
  ]
}