Skip to content

part-0013 失败模式规则表与提示词设计

摘要

source-13 混杂收尾的 F 表格、G.5 规则总表与 H 提示词附录(pdf 页序所致):

Table 16(Learning,全文复述部分):复购纪律左块 + 年内改善右块。Qwen3.8-Max-Preview AnchorRatio 0.83(zanchor +4.24、per-day slope +0.07e-3,全场唯一正)、Gemini 3.5 Flash 0.92 (zanchor +1.25)为仅有的两个优于洗牌 null 者;字段 median 1.369(Table 16),GPT-5.5 只贡献 3 场。 右块 surplus half-lift 几乎全体为负(GPT-5.6 Sol −0.063、Fable5 −0.067、GLM 5.1 −0.096…); fraud half-lift 大多负值(下半年欺诈成交占比更高,Qwen3.7-Max −0.144 最差)。Table 17:Qwen3.5- Plus 破产场逐日账(见 part-0012 G.4)。

Table 18:十种失败模式(机制 + 检测规则 + 命中模型数/场数,90 场):① Bankruptcy——4 模型 /10 场;② Overdraft the wallet covered——6/10;③ Paid a pre-deal fraudulent supplier——16/32; ④ Paid a post-deal fraudulent supplier——16/35;⑤ Fraudulent supplier re-ordered from——16/38; ⑥ Opening quote accepted unimproved——15/58;⑦ Upward drift across re-orders(zanchor ≤ −1.96, 比 Table 16 的 pooled 检验更严)——16/44;⑧ Catalog query repeated verbatim——18/76(全模型 都犯:7,460 分钟重复研究);⑨ Deadline cancellation, first 14 days——12/21;⑩ 同、last 14 days——8/11(混入收尾 pass 取消)。incidence 不排名严重度(各行成本差数量级)。

H Prompts

  • H.1 Agent Task Brief:一条 system 消息含回合规则 + 驱逐阈值 + 任务 brief(Listing 3)。 首 user turn 一句话:You are running an e-commerce business. 两者永不可清 → 是一年里唯一 保证存活的文本。人设:You are Wang Wang, an autonomous AI agent building and managing an e-commerce business on a major Chinese online platform. Your goal: maximize your total balance … over 365 days starting January 1, 2026. brief 讲清商业模式(≤4 店、workflow 链)、金融系统 (三桶 + 10 连负破产)、成本(运营/仓储/运费,仓储常是最大头)、履约(不自动发货、2 日线)、 关键决策六区(选店/选品/定价/谈判「not all suppliers are honest」/库存/促销)、chatbox 语法 (fenced negotiate JSON 块 + 块外散文)。两处刻意含糊:经营费只给「varies by store tier」 不给档位、结算窗只给「a few days」不给 9——留待从工具结果发现。整条 7,371 字符、90 场同款 (两个变体只差 agent 联系地址)
  • H.2 Supplier Renderer Contract:一次 chatbox 一条消息 = 一次 renderer 调用;请求带 system prompt(Listing 4)+ 该供应商最近 ≤4 条历史(剥掉 agent 的 fenced 块)。小非推理模型演所有 供应商 → 对手散文与被测模型无关;prompt 直给目录表(SKU/reference/opening quote)—— 名义批发价 wj 在这里可见、别处永不可见;诚实/欺诈标签写明文给 renderer(它知道自己在演 什么、agent 永远不知道)。DO NOT OVERRIDE 契约:{decisions} 块给出逐 SKU 决定与价格、语气 只许从 sentiment cue 取;契约被破坏也无妨——成交价永远按内核价扣款。欺诈方多收一段五种骗局 脚本之一(三个给抬价地板配说服模式,两个指示演诚实供应商)
  • H.3 The Fenced negotiate Grammar:offer(SKU+价)、accept(价须匹配供应商最后一报)、 reject;块外文本是消息体;一条消息可带多块;围栏外的字不构成经济动作——光靠说服文字到 不了价、动不了钱

要点归纳

  • 规则矩阵揭示「系统性平庸」:全模型至少踩 5/10 条、最干净的画像属于最好谈判者而非最富者; 重复目录查询 18/76 是唯一「全模型都犯」——信息管理是共通短板
  • H.2 的渲染层设计把「对手经济」与「对手文风」彻底解耦:prose 可被说服但经济不可;接受价 匹配校验是最后防线
  • H.1 的刻意含糊(档位价格、9 天)是「发现型任务」的提示层实现——环境准确处提示也准确, 需要自己查的绝不剧透

术语 / 概念

  • Wang Wang(人设名) — agent 任务角色(中国电商平台上的自主 AI agent)
  • DO NOT OVERRIDE(渲染契约) — renderer 必须逐字转述内核价格/决定的系统约束
  • fenced negotiate grammar — chatbox 里 ```negotiate JSON 动作语法(offer/accept/reject)
  • incidence matrix(规则触发矩阵) — Figure 30:10 规则 × 18 模型 × 5 场的命中计数

原句摘录

Nothing in the economy charges for asking twice.

…the gap the anchoring metrics of §E.1 score.

Three patterns often blamed for long-horizon failure do not survive the data. Store churn does not separate the field. Models that sign up for more promotions end richer, so event neglect explains nothing.

Failure patterns spread across the whole field rather than concentrating in the weakest models. Every model trips at least five rules, Gemini 3.1 Pro all ten, and tripping fewer of them does not make a model richer.

疑问 / 待查

  • 「全部模型至少踩 5 条规则」的普遍性暗示基准难度设计成功,但也可能意味规则粒度太粗 (「复购欺诈商」把坏信号前/后同权、重复查询把刻意刷新与疏忽同迹)——细粒度归因要靠 Appendix G 的逐字案例
  • 提示层把驱逐阈值与系统消息逐字告知 + 只给 3/17 个结算字段 → agent 学到的「harness 模型」 与实际结算结构差很远,这种信息差本身是否该算作评测内容的一部分
Backlinks (1)
flowchart LR
  n0["ch-0001 凶案、侦探与母亲的信(第 2–163 章)"]
  n1["ch-0002 坦白、出逃与和解(第 163–233 章)"]
  n2["The Curious Incident of the Dog in the Night-Time 人物"]
  n3["The Curious Incident of the Dog in the Night-Time(整理完成)"]
  n4["The Curious Incident of the Dog in the Night-Time 笔记"]
  n5["The Curious Incident of the Dog in the Night-Time 故事线"]
  n6["E-Commerce Bench(整理完成)"]
  n7["E-Commerce Bench 笔记"]
  n8["part-0001 摘要与引言:一年期电商运营基准(Abstract + §1)"]
  n9["part-0002 相关工作与定位:continuing 任务谱系(Table 1 + §2)"]
  n10["part-0003 基准设计:四层架构与确定性经济(§3 主体)"]
  n11["part-0004 实验结果:18 模型的多维画像(Table 2 + §4)"]
  n12["part-0005 结论与参考文献(§5 + References)"]
  n13["part-0006 工具集与 agent harness:18 工具与上下文管理(Table 3 + Appendix A)"]
  n14["part-0007 数据层:类目、店型、日历与供应商(Appendix B)"]
  n15["part-0008 经济引擎:13 步结算与需求/退货/成本公式(Table 7 + Appendix C)"]
  n16["part-0009 确定性谈判内核:决策函数与骗局目录(Appendix D)"]
  n17["part-0010 评测指标定义:六个维度与统计口径(Appendix E)"]
  n18["part-0011 每维度结果导览与模型/实验设置(Table 10 + Appendix F)"]
  n19["part-0012 失败案例研究:骗局实录与一次破产(Appendix G)"]
  n20["part-0013 失败模式规则表与提示词设计(Table 18 + Appendix H)"]
  n21["The End of Software Engineering(整理完成)"]
  n22["The End of Software Engineering 笔记"]
  n23["part-0001 摘要与引言:范式重构的宣告(Abstract + §1 前段)"]
  n24["part-0002 第一性原理:传统软件与 Agent 系统的形式化模型(§1 后段 + §2)"]
  n25["part-0003 三代交付史与 AI→Software→Result 的失败(§3.1–3.2)"]
  n26["part-0004 Agent→Result 与 Agentic Engineering 学科(§3.3 + §4)"]
  n27["part-0005 实证证据与 EvoClaw 落差(§5)"]
  n28["part-0006 四阶段演进路线图(前段:表 3 + Stage I–III)"]
  n29["part-0007 路线图后段与建议:实践者与研究者(§6.3 后段 + §6.4 + §7.1–7.2)"]
  n30["part-0008 组织建议、结论与参考文献(§7.3 + §8)"]
  n31["ch-0001 Introduction(为什么做数据可视化)"]
  n32["ch-0002 选工具讲你的数据故事(Ch 1)"]
  n33["ch-0003 强化电子表格技能(Ch 2)"]
  n34["ch-0004 找到并质询你的数据(Ch 3)"]
  n35["ch-0005 清洗脏数据(Ch 4)"]
  n36["ch-0006 做有意义的比较(Ch 5)"]
  n37["ch-0007 图表化你的数据(Ch 6)"]
  n38["ch-0008 地图化你的数据(Ch 7)"]
  n39["ch-0009 表格化你的数据(Ch 8)"]
  n40["ch-0010 嵌入网页(Ch 9)"]
  n41["ch-0011 用 GitHub 编辑与托管代码(Ch 10)"]
  n42["ch-0012 Chart.js 与 Highcharts 模板(Ch 11)"]
  n43["ch-0013 Leaflet 地图模板(Ch 12)"]
  n44["ch-0014 转换你的地图数据(Ch 13)"]
  n45["ch-0015 识别谎言、减少偏差(Ch 14)"]
  n46["ch-0016 讲述并展示你的数据故事(Ch 15)"]
  n47["ch-0017 附录 A 排查常见问题"]
  n48["Hands-On Data Visualization(整理完成)"]
  n49["Reading"]
  n0 --> n4
  n3 --> n0
  n3 --> n1
  n3 --> n2
  n3 --> n4
  n3 --> n5
  n5 --> n3
  n6 --> n7
  n6 --> n8
  n6 --> n9
  n6 --> n10
  n6 --> n11
  n6 --> n12
  n6 --> n13
  n6 --> n14
  n6 --> n15
  n6 --> n16
  n6 --> n17
  n6 --> n18
  n6 --> n19
  n6 --> n20
  n21 --> n22
  n21 --> n23
  n21 --> n24
  n21 --> n25
  n21 --> n26
  n21 --> n27
  n21 --> n28
  n21 --> n29
  n21 --> n30
  n22 --> n21
  n30 --> n22
  n48 --> n31
  n48 --> n32
  n48 --> n33
  n48 --> n34
  n48 --> n35
  n48 --> n36
  n48 --> n37
  n48 --> n38
  n48 --> n39
  n48 --> n40
  n48 --> n41
  n48 --> n42
  n48 --> n43
  n48 --> n44
  n48 --> n45
  n48 --> n46
  n48 --> n47
  n49 --> n3
  n49 --> n6
  n49 --> n21
  n49 --> n48
  click n0 "../../curious-incident/ch-0001/" "ch-0001 凶案、侦探与母亲的信(第 2–163 章)"
  click n1 "../../curious-incident/ch-0002/" "ch-0002 坦白、出逃与和解(第 163–233 章)"
  click n2 "../../curious-incident/characters/" "The Curious Incident of the Dog in the Night-Time 人物"
  click n3 "../../curious-incident/" "The Curious Incident of the Dog in the Night-Time(整理完成)"
  click n4 "../../curious-incident/notes/" "The Curious Incident of the Dog in the Night-Time 笔记"
  click n5 "../../curious-incident/storyline/" "The Curious Incident of the Dog in the Night-Time 故事线"
  click n6 "../" "E-Commerce Bench(整理完成)"
  click n7 "../notes/" "E-Commerce Bench 笔记"
  click n8 "../part-0001/" "part-0001 摘要与引言:一年期电商运营基准(Abstract + §1)"
  click n9 "../part-0002/" "part-0002 相关工作与定位:continuing 任务谱系(Table 1 + §2)"
  click n10 "../part-0003/" "part-0003 基准设计:四层架构与确定性经济(§3 主体)"
  click n11 "../part-0004/" "part-0004 实验结果:18 模型的多维画像(Table 2 + §4)"
  click n12 "../part-0005/" "part-0005 结论与参考文献(§5 + References)"
  click n13 "../part-0006/" "part-0006 工具集与 agent harness:18 工具与上下文管理(Table 3 + Appendix A)"
  click n14 "../part-0007/" "part-0007 数据层:类目、店型、日历与供应商(Appendix B)"
  click n15 "../part-0008/" "part-0008 经济引擎:13 步结算与需求/退货/成本公式(Table 7 + Appendix C)"
  click n16 "../part-0009/" "part-0009 确定性谈判内核:决策函数与骗局目录(Appendix D)"
  click n17 "../part-0010/" "part-0010 评测指标定义:六个维度与统计口径(Appendix E)"
  click n18 "../part-0011/" "part-0011 每维度结果导览与模型/实验设置(Table 10 + Appendix F)"
  click n19 "../part-0012/" "part-0012 失败案例研究:骗局实录与一次破产(Appendix G)"
  click n20 "./" "part-0013 失败模式规则表与提示词设计(Table 18 + Appendix H)"
  click n21 "../../end-of-software-engineering/" "The End of Software Engineering(整理完成)"
  click n22 "../../end-of-software-engineering/notes/" "The End of Software Engineering 笔记"
  click n23 "../../end-of-software-engineering/part-0001/" "part-0001 摘要与引言:范式重构的宣告(Abstract + §1 前段)"
  click n24 "../../end-of-software-engineering/part-0002/" "part-0002 第一性原理:传统软件与 Agent 系统的形式化模型(§1 后段 + §2)"
  click n25 "../../end-of-software-engineering/part-0003/" "part-0003 三代交付史与 AI→Software→Result 的失败(§3.1–3.2)"
  click n26 "../../end-of-software-engineering/part-0004/" "part-0004 Agent→Result 与 Agentic Engineering 学科(§3.3 + §4)"
  click n27 "../../end-of-software-engineering/part-0005/" "part-0005 实证证据与 EvoClaw 落差(§5)"
  click n28 "../../end-of-software-engineering/part-0006/" "part-0006 四阶段演进路线图(前段:表 3 + Stage I–III)"
  click n29 "../../end-of-software-engineering/part-0007/" "part-0007 路线图后段与建议:实践者与研究者(§6.3 后段 + §6.4 + §7.1–7.2)"
  click n30 "../../end-of-software-engineering/part-0008/" "part-0008 组织建议、结论与参考文献(§7.3 + §8)"
  click n31 "../../hands-on-data-visualization/ch-0001/" "ch-0001 Introduction(为什么做数据可视化)"
  click n32 "../../hands-on-data-visualization/ch-0002/" "ch-0002 选工具讲你的数据故事(Ch 1)"
  click n33 "../../hands-on-data-visualization/ch-0003/" "ch-0003 强化电子表格技能(Ch 2)"
  click n34 "../../hands-on-data-visualization/ch-0004/" "ch-0004 找到并质询你的数据(Ch 3)"
  click n35 "../../hands-on-data-visualization/ch-0005/" "ch-0005 清洗脏数据(Ch 4)"
  click n36 "../../hands-on-data-visualization/ch-0006/" "ch-0006 做有意义的比较(Ch 5)"
  click n37 "../../hands-on-data-visualization/ch-0007/" "ch-0007 图表化你的数据(Ch 6)"
  click n38 "../../hands-on-data-visualization/ch-0008/" "ch-0008 地图化你的数据(Ch 7)"
  click n39 "../../hands-on-data-visualization/ch-0009/" "ch-0009 表格化你的数据(Ch 8)"
  click n40 "../../hands-on-data-visualization/ch-0010/" "ch-0010 嵌入网页(Ch 9)"
  click n41 "../../hands-on-data-visualization/ch-0011/" "ch-0011 用 GitHub 编辑与托管代码(Ch 10)"
  click n42 "../../hands-on-data-visualization/ch-0012/" "ch-0012 Chart.js 与 Highcharts 模板(Ch 11)"
  click n43 "../../hands-on-data-visualization/ch-0013/" "ch-0013 Leaflet 地图模板(Ch 12)"
  click n44 "../../hands-on-data-visualization/ch-0014/" "ch-0014 转换你的地图数据(Ch 13)"
  click n45 "../../hands-on-data-visualization/ch-0015/" "ch-0015 识别谎言、减少偏差(Ch 14)"
  click n46 "../../hands-on-data-visualization/ch-0016/" "ch-0016 讲述并展示你的数据故事(Ch 15)"
  click n47 "../../hands-on-data-visualization/ch-0017/" "ch-0017 附录 A 排查常见问题"
  click n48 "../../hands-on-data-visualization/" "Hands-On Data Visualization(整理完成)"
  click n49 "../../" "Reading"