criterion.parent_id — a score commits at any criterion with NO WEIGHTED CHILDREN. Derived from the rubric, never configured, and neither corpus document is special-cased: Tarrant's five flat criteria are all leaves; Friendship's 'Method of Approach' 30 is not scoreable while its 15/10/5 children are. A criterion whose sub-items carry no points stays scoreable at its own level, because those are requirements mapped through criterion_requirement rather than children. requirement.determinable_from_response — false where satisfaction cannot be established from the response document at all. Gate evaluation excludes these rather than failing them; treating Friendship's 'two bid copies' as not_answered disqualifies two of three bidders over a packaging detail. The scoring rule is mirrored in corpus/validate-truth.py so the corpus and the code cannot silently disagree. Against Friendship it yields 10 scoreable criteria of 12, summing to exactly 100. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
34 lines
664 B
JSON
34 lines
664 B
JSON
{
|
|
"version": "7",
|
|
"dialect": "postgresql",
|
|
"entries": [
|
|
{
|
|
"idx": 0,
|
|
"version": "7",
|
|
"when": 1785791975838,
|
|
"tag": "0000_release_level_functions",
|
|
"breakpoints": true
|
|
},
|
|
{
|
|
"idx": 1,
|
|
"version": "7",
|
|
"when": 1785792002292,
|
|
"tag": "0001_initial",
|
|
"breakpoints": true
|
|
},
|
|
{
|
|
"idx": 2,
|
|
"version": "7",
|
|
"when": 1785792003081,
|
|
"tag": "0002_seed_release_matrix",
|
|
"breakpoints": true
|
|
},
|
|
{
|
|
"idx": 3,
|
|
"version": "7",
|
|
"when": 1785797388491,
|
|
"tag": "0003_criterion_nesting_and_determinability",
|
|
"breakpoints": true
|
|
}
|
|
]
|
|
} |