Weigh evals you can watch
2026-10-20 22:34 UTC

GOLD-02

exchange-triage · run 2026-10-19-prompts

Input

What every variant was given, as the suite chose to show it.

Broker: Marcus Bell, Bell Risk Partners

Good morning,

Submitting Cumberland Flats LP for the Landlord Property Package. Risk is a 16-unit mid-rise apartment building at 212 Fesslers Ln, Nashville, TN 37210 (Davidson County). Masonry non-combustible, year built 2006, central station fire alarm.

Total insured value $2,850,000. Looking for a premium in the $24,000–$28,000 range. One small water-damage claim in 2023, $8,400 paid, pipe since replaced.

Occupancy is 100% long-term residential leases, professionally managed. Statement of values attached.

Regards,
Marcus Bell

ATTACHMENT:
location,address,state,county,units,construction,year_built,tiv
1,212 Fesslers Ln Nashville TN 37210,TN,Davidson,16,Masonry non-combustible,2006,2850000

Outputs

One column per variant. Checks are the suite's binary checks on this output; a judge that gave no verdict is unanswered and not counted.

v1

result
ok
prompt tokens
4,588
output tokens
946
cost
$0.0258
latency
261,473 ms · 3 calls
at
2026-10-19 21:58
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalpass
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevpass
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9728571428571426,
 "reasons": [
  "Cumberland Flats LP sits comfortably inside appetite: TN is an allowed state, 16 units is well under the 60-unit cap, and $2.85M TIV falls in the mid-band of the $250K-$15M range. Masonry non-combustible construction from 2006 is preferred, and Davidson County carries no coastal restriction. A single $8,400 water claim in 2023, with the pipe replaced, is the only friction and does not hinder bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Cumberland Flats LP",
   "confidence": 0.95,
   "source": "email"
  },
  "propertyAddress": {
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "confidence": 0.97,
   "source": "both"
  },
  "state": {
   "value": "TN",
   "confidence": 0.98,
   "source": "both"
  },
  "county": {
   "value": "Davidson",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 16,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 2850000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Masonry non-combustible",
   "confidence": 0.97,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2006,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": "Mid-rise apartments",
   "confidence": 0.85,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Cumberland Flats LP",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "source": "both"
  },
  {
   "field": "state",
   "value": "TN",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Davidson",
   "source": "both"
  },
  {
   "field": "units",
   "value": 16,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 2850000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Masonry non-combustible",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2006,
   "source": "both"
  },
  {
   "field": "subclass",
   "value": "Mid-rise apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Cumberland Flats LP",
   "got": "Cumberland Flats LP",
   "correct": true
  },
  {
   "field": "state",
   "expected": "TN",
   "got": "TN",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Davidson",
   "got": "Davidson",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2850000,
   "got": 2850000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "masonry non-combustible",
   "got": "Masonry non-combustible",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2006,
   "got": 2006,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Mid-rise apartments",
   "got": "Mid-rise apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

v2

result
ok
prompt tokens
5,028
output tokens
955
cost
$0.0173
latency
119,892 ms · 3 calls
at
2026-10-19 21:54
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalpass
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevpass
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9771428571428571,
 "reasons": [
  "Cumberland Flats LP sits comfortably inside appetite: TN is an allowed state, 16 units is well under the 60-unit cap, and $2.85M TIV falls in the mid-band of the $250K–$15M range. Masonry non-combustible construction from 2006 is preferred, and Davidson County carries no coastal restriction. The single 2023 water claim ($8,400, pipe replaced) is minor and remediated, so it trims the score slightly but should not block bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Cumberland Flats LP",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "confidence": 0.97,
   "source": "both"
  },
  "state": {
   "value": "TN",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Davidson",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 16,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 2850000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Masonry Non-Combustible",
   "confidence": 0.97,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2006,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": "Mid-rise apartments",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Cumberland Flats LP",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "source": "both"
  },
  {
   "field": "state",
   "value": "TN",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Davidson",
   "source": "both"
  },
  {
   "field": "units",
   "value": 16,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 2850000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Masonry Non-Combustible",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2006,
   "source": "both"
  },
  {
   "field": "subclass",
   "value": "Mid-rise apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Cumberland Flats LP",
   "got": "Cumberland Flats LP",
   "correct": true
  },
  {
   "field": "state",
   "expected": "TN",
   "got": "TN",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Davidson",
   "got": "Davidson",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2850000,
   "got": 2850000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "masonry non-combustible",
   "got": "Masonry Non-Combustible",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2006,
   "got": 2006,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Mid-rise apartments",
   "got": "Mid-rise apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

v2-repeat

result
ok
prompt tokens
5,028
output tokens
955
cost
$0.0276
latency
105,063 ms · 3 calls
at
2026-10-19 21:54
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalpass
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevpass
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9771428571428571,
 "reasons": [
  "Cumberland Flats LP sits comfortably inside appetite: TN is an allowed state, 16 units is well under the 60-unit cap, and $2.85M TIV is mid-band with preferred masonry non-combustible construction built in 2006. The single 2023 water-damage claim ($8,400, pipe replaced) is minor and remediated, which is the only friction. All five rule checks passed, so this is a strong candidate to bind."
 ],
 "extraction": {
  "insuredName": {
   "value": "Cumberland Flats LP",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "confidence": 0.97,
   "source": "both"
  },
  "state": {
   "value": "TN",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Davidson",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 16,
   "confidence": 0.98,
   "source": "both"
  },
  "tiv": {
   "value": 2850000,
   "confidence": 0.98,
   "source": "both"
  },
  "constructionType": {
   "value": "Masonry Non-Combustible",
   "confidence": 0.97,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2006,
   "confidence": 0.98,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.6,
   "source": "email"
  },
  "subclass": {
   "value": "Mid-rise apartments",
   "confidence": 0.9,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Cumberland Flats LP",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "source": "both"
  },
  {
   "field": "state",
   "value": "TN",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Davidson",
   "source": "both"
  },
  {
   "field": "units",
   "value": 16,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 2850000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Masonry Non-Combustible",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2006,
   "source": "both"
  },
  {
   "field": "subclass",
   "value": "Mid-rise apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Cumberland Flats LP",
   "got": "Cumberland Flats LP",
   "correct": true
  },
  {
   "field": "state",
   "expected": "TN",
   "got": "TN",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Davidson",
   "got": "Davidson",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2850000,
   "got": 2850000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "masonry non-combustible",
   "got": "Masonry Non-Combustible",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2006,
   "got": 2006,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Mid-rise apartments",
   "got": "Mid-rise apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}

v3

result
ok
prompt tokens
5,342
output tokens
943
cost
$0.0138
latency
252,502 ms · 3 calls
at
2026-10-19 21:58
stages
intake extraction grounding appetite
decision
IN APPETITE
fitScore
88
retries
0
fieldsWrong
0
checkverdict
extraction_schemapass
fields_correctpass
construction_canonicalpass
nulls_stay_nullnot applicable
decision_correctpass
attribution_jevpass
attribution_claudepass
{
 "decision": "IN APPETITE",
 "expectedDecision": "IN APPETITE",
 "decisionCorrect": true,
 "fitScore": 88,
 "confidence": 0.9814285714285714,
 "reasons": [
  "Cumberland Flats LP sits comfortably inside appetite: TN is an allowed state, 16 units is well under the 60-unit cap, and $2.85M TIV falls in the mid-band of the $250K–$15M range. Masonry non-combustible construction from 2006 is preferred, and the single 2023 water claim ($8,400) was remediated with the pipe replaced, so it adds only minor friction. Bind-ready on appetite."
 ],
 "extraction": {
  "insuredName": {
   "value": "Cumberland Flats LP",
   "confidence": 0.97,
   "source": "email"
  },
  "propertyAddress": {
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "confidence": 0.97,
   "source": "both"
  },
  "state": {
   "value": "TN",
   "confidence": 0.99,
   "source": "both"
  },
  "county": {
   "value": "Davidson",
   "confidence": 0.98,
   "source": "both"
  },
  "units": {
   "value": 16,
   "confidence": 0.99,
   "source": "both"
  },
  "tiv": {
   "value": 2850000,
   "confidence": 0.99,
   "source": "both"
  },
  "constructionType": {
   "value": "Masonry Non-Combustible",
   "confidence": 0.97,
   "source": "both"
  },
  "yearBuilt": {
   "value": 2006,
   "confidence": 0.99,
   "source": "both"
  },
  "targetPremium": {
   "value": null,
   "confidence": 0.4,
   "source": null
  },
  "subclass": {
   "value": "Mid-rise apartments",
   "confidence": 0.95,
   "source": "email"
  },
  "priorLossSummary": {
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "confidence": 0.95,
   "source": "email"
  }
 },
 "extracted": [
  {
   "field": "insuredName",
   "value": "Cumberland Flats LP",
   "source": "email"
  },
  {
   "field": "propertyAddress",
   "value": "212 Fesslers Ln, Nashville, TN 37210",
   "source": "both"
  },
  {
   "field": "state",
   "value": "TN",
   "source": "both"
  },
  {
   "field": "county",
   "value": "Davidson",
   "source": "both"
  },
  {
   "field": "units",
   "value": 16,
   "source": "both"
  },
  {
   "field": "tiv",
   "value": 2850000,
   "source": "both"
  },
  {
   "field": "constructionType",
   "value": "Masonry Non-Combustible",
   "source": "both"
  },
  {
   "field": "yearBuilt",
   "value": 2006,
   "source": "both"
  },
  {
   "field": "subclass",
   "value": "Mid-rise apartments",
   "source": "email"
  },
  {
   "field": "priorLossSummary",
   "value": "One water-damage claim in 2023, $8,400 paid; pipe since replaced.",
   "source": "email"
  }
 ],
 "fields": [
  {
   "field": "insuredName",
   "expected": "Cumberland Flats LP",
   "got": "Cumberland Flats LP",
   "correct": true
  },
  {
   "field": "state",
   "expected": "TN",
   "got": "TN",
   "correct": true
  },
  {
   "field": "county",
   "expected": "Davidson",
   "got": "Davidson",
   "correct": true
  },
  {
   "field": "units",
   "expected": 16,
   "got": 16,
   "correct": true
  },
  {
   "field": "tiv",
   "expected": 2850000,
   "got": 2850000,
   "correct": true
  },
  {
   "field": "constructionType",
   "expected": "masonry non-combustible",
   "got": "Masonry Non-Combustible",
   "correct": true
  },
  {
   "field": "yearBuilt",
   "expected": 2006,
   "got": 2006,
   "correct": true
  },
  {
   "field": "subclass",
   "expected": "Mid-rise apartments",
   "got": "Mid-rise apartments",
   "correct": true
  }
 ],
 "retries": 0,
 "guardrails": [
  {
   "node": "extraction",
   "guardrail": "schema",
   "status": "pass"
  },
  {
   "node": "grounding",
   "guardrail": "grounding",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "missing_fields",
   "status": "pass"
  },
  {
   "node": "appetite",
   "guardrail": "confidence",
   "status": "pass"
  }
 ],
 "flags": []
}