T1-SD0102-01/2026Technology-Competition
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
80daadcd3100b198308a28e2aef4460d16842e6b
2026Technology-Competition/tests/coverage/z_375b1f32d1fd47dc_scorer_py.html
T
lhl a1fefd43eb docs(deliverables): 参赛成果物补齐（README 五项 + 范式图/架构图 + coverage 报告） 
按《参赛成果物提交规范·赛道一》§8：
- README：新增项目性质：新规声明、项目概述、整体功能说明、效果总结
  （431 测试/99.15% 覆盖/双语试运行/影响调查基线）、团队分工、规模与难度自评
- design.md：开发范式流程图（mermaid，6 步与 AI 日志步骤列一致）+ §2.1
  Agent 架构图（感知-规划-行动-记忆映射）
- _AI_USAGE_LOG.md：回填「待补充」→架构设计、「整体迭代」→反馈迭代
- tests/coverage/ 覆盖率 HTML 报告（99.15%）+ tests/test-execution-log.txt 执行日志
- docs/参赛成果物提交规范-赛道一.md → docs/submission-spec-track1.md（ASCII 化）
- pyproject: pytest norecursedirs 排除 test-execution-log.txt
全量 pytest 431 passed / 99.15%
2026-08-26 14:24:02 +08:00

322 lines
79 KiB
HTML
Raw Blame History

<!DOCTYPE html>
<html lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>Coverage for src\genesis\eval\scorer.py: 100%</title>
<link rel="icon" sizes="32x32" href="favicon_32_cb_c827f16f.png">
<link rel="stylesheet" href="style_cb_0853b3de.css" type="text/css">
<script src="coverage_html_cb_188fc9a4.js" defer></script>
</head>
<body class="pyfile">
<header>
<div class="content">
<h1>
<span class="text">Coverage for </span><b>src<span class="sep">\</span>genesis<span class="sep">\</span>eval<span class="sep">\</span>scorer.py</b>:
<span class="pc_cov">100%</span>
</h1>
<aside id="help_panel_wrapper">
<input id="help_panel_state" type="checkbox">
<label for="help_panel_state">
<img id="keyboard_icon" src="keybd_closed_cb_900cfef5.png" alt="Show/hide keyboard shortcuts">
</label>
<div id="help_panel">
<p class="legend">Shortcuts on this page</p>
<div class="keyhelp">
<p>
<kbd>r</kbd>
<kbd>m</kbd>
<kbd>x</kbd>
<kbd>p</kbd>
&nbsp; toggle line displays
</p>
<p>
<kbd>j</kbd>
<kbd>k</kbd>
&nbsp; next/prev highlighted chunk
</p>
<p>
<kbd>0</kbd> &nbsp; (zero) top of page
</p>
<p>
<kbd>1</kbd> &nbsp; (one) first highlighted chunk
</p>
<p>
<kbd>[</kbd>
<kbd>]</kbd>
&nbsp; prev/next file
</p>
<p>
<kbd>u</kbd> &nbsp; up to the index
</p>
<p>
<kbd>?</kbd> &nbsp; show/hide this help
</p>
</div>
</div>
</aside>
<h2>
<span class="text">108 statements &nbsp;</span>
<button type="button" class="run button_toggle_run" value="run" data-shortcut="r" title="Toggle lines run">108<span class="text"> run</span></button>
<button type="button" class="mis show_mis button_toggle_mis" value="mis" data-shortcut="m" title="Toggle lines missing">0<span class="text"> missing</span></button>
<button type="button" class="exc show_exc button_toggle_exc" value="exc" data-shortcut="x" title="Toggle lines excluded">0<span class="text"> excluded</span></button>
<button type="button" class="par run show_par button_toggle_par" value="par" data-shortcut="p" title="Toggle lines partially run">0<span class="text"> partial</span></button>
</h2>
<p class="text">
<a id="prevFileLink" class="nav" href="z_375b1f32d1fd47dc_golden_set_py.html">&#xab; prev</a> &nbsp; &nbsp;
<a id="indexLink" class="nav" href="index.html">&Hat; index</a> &nbsp; &nbsp;
<a id="nextFileLink" class="nav" href="z_911165347f2fdbf7_code_parser_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.15.4">coverage.py v7.15.4</a>,
created at 2026-08-26 14:20 +0800
</p>
<aside class="hidden">
<button type="button" class="button_next_chunk" data-shortcut="j"></button>
<button type="button" class="button_prev_chunk" data-shortcut="k"></button>
<button type="button" class="button_top_of_page" data-shortcut="0"></button>
<button type="button" class="button_first_chunk" data-shortcut="1"></button>
<button type="button" class="button_prev_file" data-shortcut="["></button>
<button type="button" class="button_next_file" data-shortcut="]"></button>
<button type="button" class="button_to_index" data-shortcut="u"></button>
<button type="button" class="button_show_hide_help" data-shortcut="?"></button>
</aside>
</div>
</header>
<main id="source">
<p class="pln"><span class="n"><a id="t1" href="#t1">1</a></span><span class="t"><span class="str">&quot;&quot;&quot;&#35780;&#20998;&#22120;&#65288;T13&#65292;OV4&#65289;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t2" href="#t2">2</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t3" href="#t3">3</a></span><span class="t"><span class="str">&#23545;&#29983;&#25104;&#31456;&#33410;&#25353; &#167;7.2 &#25351;&#26631;&#20307;&#31995;&#35780;&#20998;&#12290;&#30830;&#23450;&#24615;&#32500;&#24230;&#65306;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t4" href="#t4">4</a></span><span class="t"><span class="str"> - traceability&#65288;&#21487;&#36861;&#28335;&#24615;&#65289;&#65306;source_uri &#20840;&#37096;&#33021;&#22312;&#28304;&#20013;&#23450;&#20301; &#8594; 1.0&#65292;&#21542;&#21017;&#25353;&#21487;&#35299;&#26512;&#27604;&#20363;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t5" href="#t5">5</a></span><span class="t"><span class="str"> - placeholder_residue&#65288;&#21344;&#20301;&#31526;&#27531;&#30041;&#65289;&#65306;&#25991;&#26412;&#26080; {{...}} &#8594; 1.0&#65292;&#21542;&#21017; 0.0</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t6" href="#t6">6</a></span><span class="t"><span class="str"> - chapter_completeness&#65288;&#31456;&#33410;&#23436;&#25972;&#24615;&#65289;&#65306;&#29983;&#25104;&#31456;&#33410;&#35206;&#30422;&#26399;&#26395;&#38598;&#21512; &#8594; &#35206;&#30422;&#29575;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t7" href="#t7">7</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t8" href="#t8">8</a></span><span class="t"><span class="str">LLM &#35821;&#20041;&#32500;&#24230;&#65288;&#20869;&#23481;&#20934;&#30830;&#24615;/&#24187;&#35273;/&#35268;&#21017;&#36981;&#23432;&#65289;&#36890;&#36807; llm_evaluators &#38057;&#23376;&#27880;&#20837;&#65292;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t9" href="#t9">9</a></span><span class="t"><span class="str">&#40664;&#35748;&#36820;&#22238;&#20013;&#24615;&#20998; 0.5&#65288;&#26631;&#35760;&#26410;&#21551;&#29992;&#65289;&#65292;&#24453; Phase5 &#25509;&#20837;&#30495;&#23454; LLM &#26657;&#39564;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t10" href="#t10">10</a></span><span class="t"><span class="str">&quot;&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t11" href="#t11">11</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t12" href="#t12">12</a></span><span class="t"><span class="key">from</span> <span class="nam">__future__</span> <span class="key">import</span> <span class="nam">annotations</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t13" href="#t13">13</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t14" href="#t14">14</a></span><span class="t"><span class="key">import</span> <span class="nam">re</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t15" href="#t15">15</a></span><span class="t"><span class="key">from</span> <span class="nam">dataclasses</span> <span class="key">import</span> <span class="nam">dataclass</span><span class="op">,</span> <span class="nam">field</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t16" href="#t16">16</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t17" href="#t17">17</a></span><span class="t"><span class="key">from</span> <span class="nam">genesis</span><span class="op">.</span><span class="nam">data_models</span> <span class="key">import</span> <span class="nam">StructuredSource</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t18" href="#t18">18</a></span><span class="t"><span class="key">from</span> <span class="nam">genesis</span><span class="op">.</span><span class="nam">parsers</span><span class="op">.</span><span class="nam">resolver</span> <span class="key">import</span> <span class="nam">validate_source_uris</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t19" href="#t19">19</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t20" href="#t20">20</a></span><span class="t"><span class="nam">_PLACEHOLDER_RE</span> <span class="op">=</span> <span class="nam">re</span><span class="op">.</span><span class="nam">compile</span><span class="op">(</span><span class="str">r&quot;\{\{.*?\}\}&quot;</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t21" href="#t21">21</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t22" href="#t22">22</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t23" href="#t23">23</a></span><span class="t"><span class="op">@</span><span class="nam">dataclass</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t24" href="#t24">24</a></span><span class="t"><span class="key">class</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t25" href="#t25">25</a></span><span class="t"> <span class="nam">name</span><span class="op">:</span> <span class="nam">str</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t26" href="#t26">26</a></span><span class="t"> <span class="nam">score</span><span class="op">:</span> <span class="nam">float</span> <span class="com"># 0.0 ~ 1.0</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t27" href="#t27">27</a></span><span class="t"> <span class="nam">passed</span><span class="op">:</span> <span class="nam">bool</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t28" href="#t28">28</a></span><span class="t"> <span class="nam">detail</span><span class="op">:</span> <span class="nam">str</span> <span class="op">=</span> <span class="str">&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t29" href="#t29">29</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t30" href="#t30">30</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t31" href="#t31">31</a></span><span class="t"><span class="op">@</span><span class="nam">dataclass</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t32" href="#t32">32</a></span><span class="t"><span class="key">class</span> <span class="nam">ChapterArtifact</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t33" href="#t33">33</a></span><span class="t"> <span class="nam">chapter_id</span><span class="op">:</span> <span class="nam">str</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t34" href="#t34">34</a></span><span class="t"> <span class="nam">text</span><span class="op">:</span> <span class="nam">str</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t35" href="#t35">35</a></span><span class="t"> <span class="nam">source_uris</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">str</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t36" href="#t36">36</a></span><span class="t"> <span class="nam">template_sections_expected</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">str</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t37" href="#t37">37</a></span><span class="t"> <span class="nam">expected_language</span><span class="op">:</span> <span class="nam">str</span> <span class="op">=</span> <span class="str">&quot;&quot;</span> <span class="com"># &#26399;&#26395;&#36755;&#20986;&#35821;&#35328;&#65288;&quot;zh&quot;/&quot;ja&quot;&#65307;&#31354;=&#19981;&#21487;&#39564;&#35777;&#65292;&#32500;&#24230;&#35760;&#28385;&#20998;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t38" href="#t38">38</a></span><span class="t"> <span class="com"># &#22359;&#32423; (type, text, caption) &#21015;&#34920;&#65306;&#20379;&#35821;&#35328;&#19968;&#33268;&#24615;&#32500;&#24230;&#25490;&#38500; heading / table.rows&#65288;&#29031;&#25220;&#28304;/&#36319;&#38543;&#27169;&#26495;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t39" href="#t39">39</a></span><span class="t"> <span class="nam">blocks</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">tuple</span><span class="op">[</span><span class="nam">str</span><span class="op">,</span> <span class="nam">str</span><span class="op">,</span> <span class="nam">str</span><span class="op">]</span><span class="op">]</span> <span class="op">=</span> <span class="nam">field</span><span class="op">(</span><span class="nam">default_factory</span><span class="op">=</span><span class="nam">list</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t40" href="#t40">40</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t41" href="#t41">41</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t42" href="#t42">42</a></span><span class="t"><span class="com"># &#36880;&#31456;&#35780;&#20272;&#36890;&#36807;&#38408;&#20540;&#65288;&#22522;&#20110;&#36880;&#31456;&#24635;&#20998;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t43" href="#t43">43</a></span><span class="t"><span class="nam">PASS_THRESHOLD</span><span class="op">:</span> <span class="nam">float</span> <span class="op">=</span> <span class="num">0.6</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t44" href="#t44">44</a></span><span class="t"><span class="com"># &#20869;&#23481;&#20805;&#20998;&#24615;&#32500;&#24230;&#65306;&#25991;&#26412;&#38271;&#24230;&#36798;&#21040;&#35813;&#20540;&#21363;&#35270;&#20026;&#20805;&#20998;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t45" href="#t45">45</a></span><span class="t"><span class="nam">ADEQUACY_MIN_LEN</span><span class="op">:</span> <span class="nam">int</span> <span class="op">=</span> <span class="num">15</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t46" href="#t46">46</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t47" href="#t47">47</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t48" href="#t48">48</a></span><span class="t"><span class="op">@</span><span class="nam">dataclass</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t49" href="#t49">49</a></span><span class="t"><span class="key">class</span> <span class="nam">EvalReport</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t50" href="#t50">50</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">DimensionScore</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t51" href="#t51">51</a></span><span class="t"> <span class="nam">total_score</span><span class="op">:</span> <span class="nam">float</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t52" href="#t52">52</a></span><span class="t"> <span class="nam">passed</span><span class="op">:</span> <span class="nam">bool</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t53" href="#t53">53</a></span><span class="t"> <span class="nam">failed_chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">str</span><span class="op">]</span> <span class="op">=</span> <span class="nam">field</span><span class="op">(</span><span class="nam">default_factory</span><span class="op">=</span><span class="nam">list</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t54" href="#t54">54</a></span><span class="t"> <span class="nam">per_chapter</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="str">&quot;EvalReport&quot;</span><span class="op">]</span> <span class="op">=</span> <span class="nam">field</span><span class="op">(</span><span class="nam">default_factory</span><span class="op">=</span><span class="nam">list</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t55" href="#t55">55</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t56" href="#t56">56</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t57" href="#t57">57</a></span><span class="t"><span class="com"># &#32500;&#24230;&#40664;&#35748;&#36890;&#36807;&#38408;&#20540;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t58" href="#t58">58</a></span><span class="t"><span class="nam">DEFAULT_THRESHOLDS</span><span class="op">:</span> <span class="nam">dict</span><span class="op">[</span><span class="nam">str</span><span class="op">,</span> <span class="nam">float</span><span class="op">]</span> <span class="op">=</span> <span class="op">{</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t59" href="#t59">59</a></span><span class="t"> <span class="str">&quot;traceability&quot;</span><span class="op">:</span> <span class="num">1.0</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t60" href="#t60">60</a></span><span class="t"> <span class="str">&quot;placeholder_residue&quot;</span><span class="op">:</span> <span class="num">1.0</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t61" href="#t61">61</a></span><span class="t"> <span class="str">&quot;chapter_completeness&quot;</span><span class="op">:</span> <span class="num">1.0</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t62" href="#t62">62</a></span><span class="t"> <span class="str">&quot;language_consistency&quot;</span><span class="op">:</span> <span class="num">1.0</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t63" href="#t63">63</a></span><span class="t"><span class="op">}</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t64" href="#t64">64</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t65" href="#t65">65</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t66" href="#t66">66</a></span><span class="t"><span class="key">class</span> <span class="nam">ChapterScorer</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t67" href="#t67">67</a></span><span class="t"> <span class="str">&quot;&quot;&quot;&#31456;&#33410;&#29983;&#25104;&#36136;&#37327;&#35780;&#20998;&#22120;&#65288;&#30830;&#23450;&#24615;&#32500;&#24230; + LLM &#38057;&#23376;&#65289;&#12290;&quot;&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t68" href="#t68">68</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t69" href="#t69">69</a></span><span class="t"> <span class="key">def</span> <span class="nam">__init__</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t70" href="#t70">70</a></span><span class="t"> <span class="nam">self</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t71" href="#t71">71</a></span><span class="t"> <span class="nam">thresholds</span><span class="op">:</span> <span class="nam">dict</span><span class="op">[</span><span class="nam">str</span><span class="op">,</span> <span class="nam">float</span><span class="op">]</span> <span class="op">|</span> <span class="key">None</span> <span class="op">=</span> <span class="key">None</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t72" href="#t72">72</a></span><span class="t"> <span class="nam">llm_evaluators</span><span class="op">:</span> <span class="nam">dict</span><span class="op">[</span><span class="nam">str</span><span class="op">,</span> <span class="str">&quot;callable&quot;</span><span class="op">]</span> <span class="op">|</span> <span class="key">None</span> <span class="op">=</span> <span class="key">None</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t73" href="#t73">73</a></span><span class="t"> <span class="op">)</span> <span class="op">-&gt;</span> <span class="key">None</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t74" href="#t74">74</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">thresholds</span> <span class="op">=</span> <span class="op">{</span><span class="op">**</span><span class="nam">DEFAULT_THRESHOLDS</span><span class="op">,</span> <span class="op">**</span><span class="op">(</span><span class="nam">thresholds</span> <span class="key">or</span> <span class="op">{</span><span class="op">}</span><span class="op">)</span><span class="op">}</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t75" href="#t75">75</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">llm_evaluators</span> <span class="op">=</span> <span class="nam">llm_evaluators</span> <span class="key">or</span> <span class="op">{</span><span class="op">}</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t76" href="#t76">76</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t77" href="#t77">77</a></span><span class="t"> <span class="key">def</span> <span class="nam">score</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">,</span> <span class="nam">source</span><span class="op">:</span> <span class="nam">StructuredSource</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">EvalReport</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t78" href="#t78">78</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">DimensionScore</span><span class="op">]</span> <span class="op">=</span> <span class="op">[</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t79" href="#t79">79</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">self</span><span class="op">.</span><span class="nam">_traceability</span><span class="op">(</span><span class="nam">chapters</span><span class="op">,</span> <span class="nam">source</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t80" href="#t80">80</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">self</span><span class="op">.</span><span class="nam">_placeholder_residue</span><span class="op">(</span><span class="nam">chapters</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t81" href="#t81">81</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">self</span><span class="op">.</span><span class="nam">_completeness</span><span class="op">(</span><span class="nam">chapters</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t82" href="#t82">82</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">self</span><span class="op">.</span><span class="nam">_language_consistency</span><span class="op">(</span><span class="nam">chapters</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t83" href="#t83">83</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t84" href="#t84">84</a></span><span class="t"> <span class="com"># LLM &#35821;&#20041;&#32500;&#24230;&#38057;&#23376;&#65288;&#27599;&#20010;&#31456;&#33410;&#29420;&#31435;&#35780;&#65292;&#21462;&#35813;&#32500;&#24230;&#24179;&#22343;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t85" href="#t85">85</a></span><span class="t"> <span class="key">for</span> <span class="nam">name</span><span class="op">,</span> <span class="nam">fn</span> <span class="key">in</span> <span class="nam">self</span><span class="op">.</span><span class="nam">llm_evaluators</span><span class="op">.</span><span class="nam">items</span><span class="op">(</span><span class="op">)</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t86" href="#t86">86</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">self</span><span class="op">.</span><span class="nam">_run_llm_dimension</span><span class="op">(</span><span class="nam">name</span><span class="op">,</span> <span class="nam">fn</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t87" href="#t87">87</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t88" href="#t88">88</a></span><span class="t"> <span class="nam">total</span> <span class="op">=</span> <span class="nam">sum</span><span class="op">(</span><span class="nam">d</span><span class="op">.</span><span class="nam">score</span> <span class="key">for</span> <span class="nam">d</span> <span class="key">in</span> <span class="nam">dimensions</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">dimensions</span><span class="op">)</span> <span class="key">if</span> <span class="nam">dimensions</span> <span class="key">else</span> <span class="num">0.0</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t89" href="#t89">89</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">all</span><span class="op">(</span><span class="nam">d</span><span class="op">.</span><span class="nam">passed</span> <span class="key">for</span> <span class="nam">d</span> <span class="key">in</span> <span class="nam">dimensions</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t90" href="#t90">90</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t91" href="#t91">91</a></span><span class="t"> <span class="com"># &#36880;&#31456;&#35780;&#20272;&#65306;&#23545;&#27599;&#19968;&#31456;&#33410;&#29420;&#31435;&#35780;&#20998;&#65292;&#25910;&#38598; per_chapter&#65292;&#24182;&#26631;&#35760;&#26410;&#36798;&#26631;&#31456;&#33410;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t92" href="#t92">92</a></span><span class="t"> <span class="nam">per_chapter</span> <span class="op">=</span> <span class="op">[</span><span class="nam">self</span><span class="op">.</span><span class="nam">_score_chapter</span><span class="op">(</span><span class="nam">ch</span><span class="op">,</span> <span class="nam">source</span><span class="op">)</span> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t93" href="#t93">93</a></span><span class="t"> <span class="nam">failed_chapters</span> <span class="op">=</span> <span class="op">[</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t94" href="#t94">94</a></span><span class="t"> <span class="nam">ch</span><span class="op">.</span><span class="nam">chapter_id</span> <span class="key">for</span> <span class="nam">ch</span><span class="op">,</span> <span class="nam">r</span> <span class="key">in</span> <span class="nam">zip</span><span class="op">(</span><span class="nam">chapters</span><span class="op">,</span> <span class="nam">per_chapter</span><span class="op">)</span> <span class="key">if</span> <span class="nam">r</span><span class="op">.</span><span class="nam">failed_chapters</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t95" href="#t95">95</a></span><span class="t"> <span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t96" href="#t96">96</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t97" href="#t97">97</a></span><span class="t"> <span class="key">return</span> <span class="nam">EvalReport</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t98" href="#t98">98</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">=</span><span class="nam">dimensions</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t99" href="#t99">99</a></span><span class="t"> <span class="nam">total_score</span><span class="op">=</span><span class="nam">round</span><span class="op">(</span><span class="nam">total</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t100" href="#t100">100</a></span><span class="t"> <span class="nam">passed</span><span class="op">=</span><span class="nam">passed</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t101" href="#t101">101</a></span><span class="t"> <span class="nam">failed_chapters</span><span class="op">=</span><span class="nam">failed_chapters</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t102" href="#t102">102</a></span><span class="t"> <span class="nam">per_chapter</span><span class="op">=</span><span class="nam">per_chapter</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t103" href="#t103">103</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t104" href="#t104">104</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t105" href="#t105">105</a></span><span class="t"> <span class="com"># ---------- &#30830;&#23450;&#24615;&#32500;&#24230; ----------</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t106" href="#t106">106</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t107" href="#t107">107</a></span><span class="t"> <span class="key">def</span> <span class="nam">_traceability</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">,</span> <span class="nam">source</span><span class="op">:</span> <span class="nam">StructuredSource</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t108" href="#t108">108</a></span><span class="t"> <span class="nam">all_uris</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">str</span><span class="op">]</span> <span class="op">=</span> <span class="op">[</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t109" href="#t109">109</a></span><span class="t"> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t110" href="#t110">110</a></span><span class="t"> <span class="nam">all_uris</span><span class="op">.</span><span class="nam">extend</span><span class="op">(</span><span class="nam">ch</span><span class="op">.</span><span class="nam">source_uris</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t111" href="#t111">111</a></span><span class="t"> <span class="key">if</span> <span class="key">not</span> <span class="nam">all_uris</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t112" href="#t112">112</a></span><span class="t"> <span class="com"># &#26080;&#24341;&#29992;&#21017;&#35270;&#20026;&#28385;&#20998;&#65288;&#19981;&#25187;&#20998;&#65307;&#21487;&#36861;&#28335;&#24615;&#20165;&#32422;&#26463;&#12300;&#26377;&#24341;&#29992;&#26102;&#39035;&#21487;&#35299;&#26512;&#12301;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t113" href="#t113">113</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span><span class="str">&quot;traceability&quot;</span><span class="op">,</span> <span class="num">1.0</span><span class="op">,</span> <span class="key">True</span><span class="op">,</span> <span class="str">&quot;&#26080; source_uri &#24341;&#29992;&quot;</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t114" href="#t114">114</a></span><span class="t"> <span class="nam">result</span> <span class="op">=</span> <span class="nam">validate_source_uris</span><span class="op">(</span><span class="nam">all_uris</span><span class="op">,</span> <span class="nam">source</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t115" href="#t115">115</a></span><span class="t"> <span class="nam">ratio</span> <span class="op">=</span> <span class="nam">len</span><span class="op">(</span><span class="nam">result</span><span class="op">.</span><span class="nam">resolved</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">all_uris</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t116" href="#t116">116</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">ratio</span> <span class="op">&gt;=</span> <span class="nam">self</span><span class="op">.</span><span class="nam">thresholds</span><span class="op">[</span><span class="str">&quot;traceability&quot;</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t117" href="#t117">117</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t118" href="#t118">118</a></span><span class="t"> <span class="str">&quot;traceability&quot;</span><span class="op">,</span> <span class="nam">round</span><span class="op">(</span><span class="nam">ratio</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span> <span class="nam">passed</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t119" href="#t119">119</a></span><span class="t"> <span class="fst">f&quot;</span><span class="fst">resolved </span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">result</span><span class="op">.</span><span class="nam">resolved</span><span class="op">)</span><span class="op">}</span><span class="fst">/</span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">all_uris</span><span class="op">)</span><span class="op">}</span><span class="fst">&#65288;unresolved: </span><span class="op">{</span><span class="nam">result</span><span class="op">.</span><span class="nam">unresolved</span><span class="op">}</span><span class="fst">&#65289;</span><span class="fst">&quot;</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t120" href="#t120">120</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t121" href="#t121">121</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t122" href="#t122">122</a></span><span class="t"> <span class="key">def</span> <span class="nam">_placeholder_residue</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t123" href="#t123">123</a></span><span class="t"> <span class="nam">bad</span> <span class="op">=</span> <span class="op">[</span><span class="nam">ch</span><span class="op">.</span><span class="nam">chapter_id</span> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span> <span class="key">if</span> <span class="nam">_PLACEHOLDER_RE</span><span class="op">.</span><span class="nam">search</span><span class="op">(</span><span class="nam">ch</span><span class="op">.</span><span class="nam">text</span><span class="op">)</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t124" href="#t124">124</a></span><span class="t"> <span class="nam">score</span> <span class="op">=</span> <span class="num">0.0</span> <span class="key">if</span> <span class="nam">bad</span> <span class="key">else</span> <span class="num">1.0</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t125" href="#t125">125</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t126" href="#t126">126</a></span><span class="t"> <span class="str">&quot;placeholder_residue&quot;</span><span class="op">,</span> <span class="nam">score</span><span class="op">,</span> <span class="key">not</span> <span class="nam">bad</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t127" href="#t127">127</a></span><span class="t"> <span class="str">&quot;&#27531;&#30041;&#21344;&#20301;&#31526;: &quot;</span> <span class="op">+</span> <span class="op">(</span><span class="str">&quot;, &quot;</span><span class="op">.</span><span class="nam">join</span><span class="op">(</span><span class="nam">bad</span><span class="op">)</span> <span class="key">if</span> <span class="nam">bad</span> <span class="key">else</span> <span class="str">&quot;&#26080;&quot;</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t128" href="#t128">128</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t129" href="#t129">129</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t130" href="#t130">130</a></span><span class="t"> <span class="key">def</span> <span class="nam">_completeness</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t131" href="#t131">131</a></span><span class="t"> <span class="nam">expected</span> <span class="op">=</span> <span class="nam">set</span><span class="op">(</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t132" href="#t132">132</a></span><span class="t"> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t133" href="#t133">133</a></span><span class="t"> <span class="nam">expected</span><span class="op">.</span><span class="nam">update</span><span class="op">(</span><span class="nam">ch</span><span class="op">.</span><span class="nam">template_sections_expected</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t134" href="#t134">134</a></span><span class="t"> <span class="key">if</span> <span class="key">not</span> <span class="nam">expected</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t135" href="#t135">135</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span><span class="str">&quot;chapter_completeness&quot;</span><span class="op">,</span> <span class="num">1.0</span><span class="op">,</span> <span class="key">True</span><span class="op">,</span> <span class="str">&quot;&#26080;&#31456;&#33410;&#26399;&#26395;&#32422;&#26463;&quot;</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t136" href="#t136">136</a></span><span class="t"> <span class="nam">got</span> <span class="op">=</span> <span class="op">{</span><span class="nam">ch</span><span class="op">.</span><span class="nam">chapter_id</span> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">}</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t137" href="#t137">137</a></span><span class="t"> <span class="nam">coverage</span> <span class="op">=</span> <span class="nam">len</span><span class="op">(</span><span class="nam">got</span> <span class="op">&amp;</span> <span class="nam">expected</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">expected</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t138" href="#t138">138</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">coverage</span> <span class="op">&gt;=</span> <span class="nam">self</span><span class="op">.</span><span class="nam">thresholds</span><span class="op">[</span><span class="str">&quot;chapter_completeness&quot;</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t139" href="#t139">139</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t140" href="#t140">140</a></span><span class="t"> <span class="str">&quot;chapter_completeness&quot;</span><span class="op">,</span> <span class="nam">round</span><span class="op">(</span><span class="nam">coverage</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span> <span class="nam">passed</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t141" href="#t141">141</a></span><span class="t"> <span class="fst">f&quot;</span><span class="fst">&#35206;&#30422;&#29575; </span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">got</span> <span class="op">&amp;</span> <span class="nam">expected</span><span class="op">)</span><span class="op">}</span><span class="fst">/</span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">expected</span><span class="op">)</span><span class="op">}</span><span class="fst">&quot;</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t142" href="#t142">142</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t143" href="#t143">143</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t144" href="#t144">144</a></span><span class="t"> <span class="com"># ---------- LLM &#32500;&#24230; ----------</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t145" href="#t145">145</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t146" href="#t146">146</a></span><span class="t"> <span class="key">def</span> <span class="nam">_run_llm_dimension</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">name</span><span class="op">:</span> <span class="nam">str</span><span class="op">,</span> <span class="nam">fn</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t147" href="#t147">147</a></span><span class="t"> <span class="nam">scores</span> <span class="op">=</span> <span class="op">[</span><span class="nam">fn</span><span class="op">(</span><span class="nam">ch</span><span class="op">)</span> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t148" href="#t148">148</a></span><span class="t"> <span class="nam">avg</span> <span class="op">=</span> <span class="nam">sum</span><span class="op">(</span><span class="nam">s</span><span class="op">.</span><span class="nam">score</span> <span class="key">for</span> <span class="nam">s</span> <span class="key">in</span> <span class="nam">scores</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">scores</span><span class="op">)</span> <span class="key">if</span> <span class="nam">scores</span> <span class="key">else</span> <span class="num">0.5</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t149" href="#t149">149</a></span><span class="t"> <span class="nam">detail</span> <span class="op">=</span> <span class="str">&quot; | &quot;</span><span class="op">.</span><span class="nam">join</span><span class="op">(</span><span class="nam">s</span><span class="op">.</span><span class="nam">detail</span> <span class="key">for</span> <span class="nam">s</span> <span class="key">in</span> <span class="nam">scores</span><span class="op">)</span> <span class="key">if</span> <span class="nam">scores</span> <span class="key">else</span> <span class="str">&quot;no chapters&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t150" href="#t150">150</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span><span class="nam">name</span><span class="op">,</span> <span class="nam">round</span><span class="op">(</span><span class="nam">avg</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span> <span class="nam">all</span><span class="op">(</span><span class="nam">s</span><span class="op">.</span><span class="nam">passed</span> <span class="key">for</span> <span class="nam">s</span> <span class="key">in</span> <span class="nam">scores</span><span class="op">)</span><span class="op">,</span> <span class="nam">detail</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t151" href="#t151">151</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t152" href="#t152">152</a></span><span class="t"> <span class="com"># ---------- &#35821;&#35328;&#19968;&#33268;&#24615;&#32500;&#24230;&#65288;&#27493;&#39588; C&#65292;&#30830;&#23450;&#24615;&#65289;----------</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t153" href="#t153">153</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t154" href="#t154">154</a></span><span class="t"> <span class="key">def</span> <span class="nam">_language_consistency</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapters</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">ChapterArtifact</span><span class="op">]</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t155" href="#t155">155</a></span><span class="t"> <span class="str">&quot;&quot;&quot;&#31532; 11 &#32500;&#24230;&#65306;&#36755;&#20986;&#35821;&#35328;&#19982;&#26399;&#26395;&#35821;&#35328;&#19968;&#33268;&#65288;&#30830;&#23450;&#24615;&#65292;&#33050;&#26412;&#21487;&#39564;&#35777;&#65289;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t156" href="#t156">156</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t157" href="#t157">157</a></span><span class="t"><span class="str"> &#19982; writer.language &#20849;&#29992;&#21333;&#19968;&#26816;&#27979;&#20107;&#23454;&#26469;&#28304;&#12290;&#26399;&#26395;&#35821;&#35328;&#20026;&#31354;&#65288;auto/&#19981;&#21487;&#39564;&#35777;&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t158" href="#t158">158</a></span><span class="t"><span class="str"> &#8594; &#35760;&#28385;&#20998; 1.0 &#36890;&#36807;&#65288;&#35780;&#23457; R1&#65306;&#19981;&#25289;&#20302;&#24635;&#20998;&#65292;&#36991;&#20813;&#35823;&#20260;&#26082;&#26377;&#26029;&#35328;&#65289;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t159" href="#t159">159</a></span><span class="t"><span class="str"> &#20165;&#26816;&#27491;&#25991;&#22359;&#65288;heading/table &#19981;&#26816;&#65292;&#34920;&#26684;&#29031;&#25220;&#28304;&#12289;&#26631;&#39064;&#36319;&#38543;&#27169;&#26495;&#65289;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t160" href="#t160">160</a></span><span class="t"><span class="str"> &quot;&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t161" href="#t161">161</a></span><span class="t"> <span class="key">from</span> <span class="nam">genesis</span><span class="op">.</span><span class="nam">writer</span><span class="op">.</span><span class="nam">language</span> <span class="key">import</span> <span class="nam">find_language_violations</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t162" href="#t162">162</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t163" href="#t163">163</a></span><span class="t"> <span class="key">if</span> <span class="key">not</span> <span class="nam">chapters</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t164" href="#t164">164</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span><span class="str">&quot;language_consistency&quot;</span><span class="op">,</span> <span class="num">1.0</span><span class="op">,</span> <span class="key">True</span><span class="op">,</span> <span class="str">&quot;no chapters&quot;</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t165" href="#t165">165</a></span><span class="t"> <span class="nam">per</span><span class="op">:</span> <span class="nam">list</span><span class="op">[</span><span class="nam">DimensionScore</span><span class="op">]</span> <span class="op">=</span> <span class="op">[</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t166" href="#t166">166</a></span><span class="t"> <span class="key">for</span> <span class="nam">ch</span> <span class="key">in</span> <span class="nam">chapters</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t167" href="#t167">167</a></span><span class="t"> <span class="nam">expected</span> <span class="op">=</span> <span class="nam">ch</span><span class="op">.</span><span class="nam">expected_language</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t168" href="#t168">168</a></span><span class="t"> <span class="key">if</span> <span class="key">not</span> <span class="nam">expected</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t169" href="#t169">169</a></span><span class="t"> <span class="nam">per</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t170" href="#t170">170</a></span><span class="t"> <span class="str">&quot;language_consistency&quot;</span><span class="op">,</span> <span class="num">1.0</span><span class="op">,</span> <span class="key">True</span><span class="op">,</span> <span class="str">&quot;unverifiable (no expected language)&quot;</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t171" href="#t171">171</a></span><span class="t"> <span class="key">continue</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t172" href="#t172">172</a></span><span class="t"> <span class="key">from</span> <span class="nam">genesis</span><span class="op">.</span><span class="nam">writer</span><span class="op">.</span><span class="nam">models</span> <span class="key">import</span> <span class="nam">ContentBlock</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t173" href="#t173">173</a></span><span class="t"> <span class="key">if</span> <span class="nam">ch</span><span class="op">.</span><span class="nam">blocks</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t174" href="#t174">174</a></span><span class="t"> <span class="com"># &#20248;&#20808;&#29992;&#22359;&#32423;&#20449;&#24687;&#65288;type, text, caption&#65307;&#21487;&#25490;&#38500; heading/table.rows&#65289;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t175" href="#t175">175</a></span><span class="t"> <span class="nam">blocks</span> <span class="op">=</span> <span class="op">[</span><span class="nam">ContentBlock</span><span class="op">(</span><span class="nam">block_id</span><span class="op">=</span><span class="nam">str</span><span class="op">(</span><span class="nam">i</span><span class="op">)</span><span class="op">,</span> <span class="nam">type</span><span class="op">=</span><span class="nam">t</span><span class="op">,</span> <span class="nam">text</span><span class="op">=</span><span class="nam">tx</span><span class="op">,</span> <span class="nam">caption</span><span class="op">=</span><span class="nam">cap</span> <span class="key">or</span> <span class="key">None</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t176" href="#t176">176</a></span><span class="t"> <span class="key">for</span> <span class="nam">i</span><span class="op">,</span> <span class="op">(</span><span class="nam">t</span><span class="op">,</span> <span class="nam">tx</span><span class="op">,</span> <span class="nam">cap</span><span class="op">)</span> <span class="key">in</span> <span class="nam">enumerate</span><span class="op">(</span><span class="nam">ch</span><span class="op">.</span><span class="nam">blocks</span><span class="op">)</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t177" href="#t177">177</a></span><span class="t"> <span class="key">else</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t178" href="#t178">178</a></span><span class="t"> <span class="com"># &#22238;&#36864;&#65306;&#25972;&#27573;&#27491;&#25991;&#20316;&#20026;&#21333;&#20010; paragraph &#22359;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t179" href="#t179">179</a></span><span class="t"> <span class="nam">blocks</span> <span class="op">=</span> <span class="op">[</span><span class="nam">ContentBlock</span><span class="op">(</span><span class="nam">block_id</span><span class="op">=</span><span class="str">&quot;0&quot;</span><span class="op">,</span> <span class="nam">type</span><span class="op">=</span><span class="str">&quot;paragraph&quot;</span><span class="op">,</span> <span class="nam">text</span><span class="op">=</span><span class="nam">ch</span><span class="op">.</span><span class="nam">text</span> <span class="key">or</span> <span class="str">&quot;&quot;</span><span class="op">)</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t180" href="#t180">180</a></span><span class="t"> <span class="nam">viol</span> <span class="op">=</span> <span class="nam">find_language_violations</span><span class="op">(</span><span class="nam">blocks</span><span class="op">,</span> <span class="nam">expected</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t181" href="#t181">181</a></span><span class="t"> <span class="nam">score</span> <span class="op">=</span> <span class="num">0.0</span> <span class="key">if</span> <span class="nam">viol</span> <span class="key">else</span> <span class="num">1.0</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t182" href="#t182">182</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">score</span> <span class="op">&gt;=</span> <span class="nam">self</span><span class="op">.</span><span class="nam">thresholds</span><span class="op">[</span><span class="str">&quot;language_consistency&quot;</span><span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t183" href="#t183">183</a></span><span class="t"> <span class="nam">per</span><span class="op">.</span><span class="nam">append</span><span class="op">(</span><span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t184" href="#t184">184</a></span><span class="t"> <span class="str">&quot;language_consistency&quot;</span><span class="op">,</span> <span class="nam">score</span><span class="op">,</span> <span class="nam">passed</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t185" href="#t185">185</a></span><span class="t"> <span class="fst">f&quot;</span><span class="fst">&#26399;&#26395; </span><span class="op">{</span><span class="nam">expected</span><span class="op">}</span><span class="fst">&#65292;&#36829;&#35268; </span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">viol</span><span class="op">)</span><span class="op">}</span><span class="fst"> &#22788;</span><span class="fst">&quot;</span> <span class="key">if</span> <span class="nam">viol</span> <span class="key">else</span> <span class="fst">f&quot;</span><span class="fst">&#26399;&#26395; </span><span class="op">{</span><span class="nam">expected</span><span class="op">}</span><span class="fst">&#65292;&#19968;&#33268;</span><span class="fst">&quot;</span><span class="op">)</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t186" href="#t186">186</a></span><span class="t"> <span class="nam">avg</span> <span class="op">=</span> <span class="nam">sum</span><span class="op">(</span><span class="nam">p</span><span class="op">.</span><span class="nam">score</span> <span class="key">for</span> <span class="nam">p</span> <span class="key">in</span> <span class="nam">per</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">per</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t187" href="#t187">187</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">all</span><span class="op">(</span><span class="nam">p</span><span class="op">.</span><span class="nam">passed</span> <span class="key">for</span> <span class="nam">p</span> <span class="key">in</span> <span class="nam">per</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t188" href="#t188">188</a></span><span class="t"> <span class="nam">detail</span> <span class="op">=</span> <span class="str">&quot; | &quot;</span><span class="op">.</span><span class="nam">join</span><span class="op">(</span><span class="nam">p</span><span class="op">.</span><span class="nam">detail</span> <span class="key">for</span> <span class="nam">p</span> <span class="key">in</span> <span class="nam">per</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t189" href="#t189">189</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span><span class="str">&quot;language_consistency&quot;</span><span class="op">,</span> <span class="nam">round</span><span class="op">(</span><span class="nam">avg</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span> <span class="nam">passed</span><span class="op">,</span> <span class="nam">detail</span><span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t190" href="#t190">190</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t191" href="#t191">191</a></span><span class="t"> <span class="com"># ---------- &#36880;&#31456;&#35780;&#20272; ----------</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t192" href="#t192">192</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t193" href="#t193">193</a></span><span class="t"> <span class="key">def</span> <span class="nam">_score_chapter</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapter</span><span class="op">:</span> <span class="nam">ChapterArtifact</span><span class="op">,</span> <span class="nam">source</span><span class="op">:</span> <span class="nam">StructuredSource</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">EvalReport</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t194" href="#t194">194</a></span><span class="t"> <span class="str">&quot;&quot;&quot;&#23545;&#21333;&#20010;&#31456;&#33410;&#29420;&#31435;&#35780;&#20998;&#65292;&#36820;&#22238;&#35813;&#31456;&#33410;&#30340; EvalReport&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t195" href="#t195">195</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t196" href="#t196">196</a></span><span class="t"><span class="str"> &#22797;&#29992;&#30830;&#23450;&#24615;&#32500;&#24230;&#36923;&#36753;&#65288;&#21487;&#36861;&#28335;&#24615;/&#21344;&#20301;&#31526;&#27531;&#30041;&#65289;&#24182;&#35745;&#31639;&#20869;&#23481;&#20805;&#20998;&#24615;&#65292;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t197" href="#t197">197</a></span><span class="t"><span class="str"> &#24635;&#20998;&#20302;&#20110; PASS_THRESHOLD &#21363;&#21028;&#35813;&#31456;&#33410;&#22833;&#36133;&#12290;</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t198" href="#t198">198</a></span><span class="t"><span class="str"> &quot;&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t199" href="#t199">199</a></span><span class="t"> <span class="nam">dims</span> <span class="op">=</span> <span class="op">[</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t200" href="#t200">200</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">_traceability</span><span class="op">(</span><span class="op">[</span><span class="nam">chapter</span><span class="op">]</span><span class="op">,</span> <span class="nam">source</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t201" href="#t201">201</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">_placeholder_residue</span><span class="op">(</span><span class="op">[</span><span class="nam">chapter</span><span class="op">]</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t202" href="#t202">202</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">_adequacy</span><span class="op">(</span><span class="nam">chapter</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t203" href="#t203">203</a></span><span class="t"> <span class="nam">self</span><span class="op">.</span><span class="nam">_language_consistency</span><span class="op">(</span><span class="op">[</span><span class="nam">chapter</span><span class="op">]</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t204" href="#t204">204</a></span><span class="t"> <span class="op">]</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t205" href="#t205">205</a></span><span class="t"> <span class="nam">total</span> <span class="op">=</span> <span class="nam">sum</span><span class="op">(</span><span class="nam">d</span><span class="op">.</span><span class="nam">score</span> <span class="key">for</span> <span class="nam">d</span> <span class="key">in</span> <span class="nam">dims</span><span class="op">)</span> <span class="op">/</span> <span class="nam">len</span><span class="op">(</span><span class="nam">dims</span><span class="op">)</span> <span class="key">if</span> <span class="nam">dims</span> <span class="key">else</span> <span class="num">0.0</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t206" href="#t206">206</a></span><span class="t"> <span class="nam">failed</span> <span class="op">=</span> <span class="op">(</span><span class="key">not</span> <span class="nam">all</span><span class="op">(</span><span class="nam">d</span><span class="op">.</span><span class="nam">passed</span> <span class="key">for</span> <span class="nam">d</span> <span class="key">in</span> <span class="nam">dims</span><span class="op">)</span><span class="op">)</span> <span class="key">or</span> <span class="nam">total</span> <span class="op">&lt;</span> <span class="nam">PASS_THRESHOLD</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t207" href="#t207">207</a></span><span class="t"> <span class="key">return</span> <span class="nam">EvalReport</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t208" href="#t208">208</a></span><span class="t"> <span class="nam">dimensions</span><span class="op">=</span><span class="nam">dims</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t209" href="#t209">209</a></span><span class="t"> <span class="nam">total_score</span><span class="op">=</span><span class="nam">round</span><span class="op">(</span><span class="nam">total</span><span class="op">,</span> <span class="num">4</span><span class="op">)</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t210" href="#t210">210</a></span><span class="t"> <span class="nam">passed</span><span class="op">=</span><span class="key">not</span> <span class="nam">failed</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t211" href="#t211">211</a></span><span class="t"> <span class="nam">failed_chapters</span><span class="op">=</span><span class="op">[</span><span class="nam">chapter</span><span class="op">.</span><span class="nam">chapter_id</span><span class="op">]</span> <span class="key">if</span> <span class="nam">failed</span> <span class="key">else</span> <span class="op">[</span><span class="op">]</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t212" href="#t212">212</a></span><span class="t"> <span class="nam">per_chapter</span><span class="op">=</span><span class="op">[</span><span class="op">]</span><span class="op">,</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t213" href="#t213">213</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t214" href="#t214">214</a></span><span class="t">&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t215" href="#t215">215</a></span><span class="t"> <span class="key">def</span> <span class="nam">_adequacy</span><span class="op">(</span><span class="nam">self</span><span class="op">,</span> <span class="nam">chapter</span><span class="op">:</span> <span class="nam">ChapterArtifact</span><span class="op">)</span> <span class="op">-&gt;</span> <span class="nam">DimensionScore</span><span class="op">:</span>&nbsp;</span><span class="r"></span></p>
<p class="pln"><span class="n"><a id="t216" href="#t216">216</a></span><span class="t"> <span class="str">&quot;&quot;&quot;&#20869;&#23481;&#20805;&#20998;&#24615;&#65306;&#22522;&#20110;&#27491;&#25991;&#23383;&#26412;&#38271;&#24230;&#21551;&#21457;&#24335;&#21028;&#23450;&#31456;&#33410;&#26159;&#21542;&#20805;&#20998;&#12290;&quot;&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t217" href="#t217">217</a></span><span class="t"> <span class="nam">text</span> <span class="op">=</span> <span class="nam">chapter</span><span class="op">.</span><span class="nam">text</span> <span class="key">or</span> <span class="str">&quot;&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t218" href="#t218">218</a></span><span class="t"> <span class="nam">score</span> <span class="op">=</span> <span class="num">1.0</span> <span class="key">if</span> <span class="nam">len</span><span class="op">(</span><span class="nam">text</span><span class="op">)</span> <span class="op">&gt;=</span> <span class="nam">ADEQUACY_MIN_LEN</span> <span class="key">else</span> <span class="num">0.3</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t219" href="#t219">219</a></span><span class="t"> <span class="nam">passed</span> <span class="op">=</span> <span class="nam">score</span> <span class="op">&gt;=</span> <span class="nam">PASS_THRESHOLD</span>&nbsp;</span><span class="r"></span></p>
<p class="run"><span class="n"><a id="t220" href="#t220">220</a></span><span class="t"> <span class="key">return</span> <span class="nam">DimensionScore</span><span class="op">(</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t221" href="#t221">221</a></span><span class="t"> <span class="str">&quot;adequacy&quot;</span><span class="op">,</span> <span class="nam">score</span><span class="op">,</span> <span class="nam">passed</span><span class="op">,</span> <span class="fst">f&quot;</span><span class="fst">&#20869;&#23481;&#38271;&#24230; </span><span class="op">{</span><span class="nam">len</span><span class="op">(</span><span class="nam">text</span><span class="op">)</span><span class="op">}</span><span class="fst">&#65288;&#20805;&#20998;&#38408;&#20540; </span><span class="op">{</span><span class="nam">ADEQUACY_MIN_LEN</span><span class="op">}</span><span class="fst">&#65289;</span><span class="fst">&quot;</span>&nbsp;</span><span class="r"></span></p>
<p class="run run2"><span class="n"><a id="t222" href="#t222">222</a></span><span class="t"> <span class="op">)</span>&nbsp;</span><span class="r"></span></p>
</main>
<footer>
<div class="content">
<p>
<a class="nav" href="z_375b1f32d1fd47dc_golden_set_py.html">&#xab; prev</a> &nbsp; &nbsp;
<a class="nav" href="index.html">&Hat; index</a> &nbsp; &nbsp;
<a class="nav" href="z_911165347f2fdbf7_code_parser_py.html">&#xbb; next</a>
&nbsp; &nbsp; &nbsp;
<a class="nav" href="https://coverage.readthedocs.io/en/7.15.4">coverage.py v7.15.4</a>,
created at 2026-08-26 14:20 +0800
</p>
</div>
</footer>
</body>
</html>
Reference in New Issue View Git Blame Copy Permalink