- T13 (OV4, P1): 新建 src/genesis/eval/ 包
- golden_set.py: GoldenCase/GoldenSet(YAML 加载,samples/ 真实脱敏样本作 input_ref)
- scorer.py: ChapterScorer 按 §7.2 指标体系打分
- 确定性维度: traceability(resolver 验证 source_uri 可解析率)/
placeholder_residue(无 {{...}} 残留)/chapter_completeness(章节覆盖)
- LLM 语义维度: llm_evaluators 钩子(默认中性分,待 Phase5)
- tests/fixtures/eval/golden_set.yaml 示例黄金集
- 新增 test_eval_scorer.py(9 用例)
- 同步 design.md §7.5 黄金集与评分器(定位 CI 质量门禁)
- TDD: RED(模块缺失)→ GREEN(聚焦 8 passed)→ 全量 240 passed / 100.00%(1279 stmts/308 br)
10 lines
302 B
YAML
10 lines
302 B
YAML
cases:
|
|
- id: g1
|
|
input_ref: samples/要件定義.xlsx
|
|
expected_min_score: 0.7
|
|
note: 脱敏真实样本回归基线(Phase5 Writer 实现后填充实际评分)
|
|
- id: g2
|
|
input_ref: samples/概要設計書_template.docx
|
|
expected_min_score: 0.7
|
|
note: 模板结构合规基线
|