ch-0015 Chapter 14: Detect Lies and Reduce Bias
- 原书章节: Chapter 14 Detect Lies and Reduce Bias(pp. 393–418)
- 输入来源: 本地 pdf(HandsOnDataViz.pdf)
摘要
回扣开篇的收入不平等案例,给出判定可视化真伪的三分法:
- wrong(错误):歪曲证据或违反硬性设计规则——如柱状图基线不从零开始、饼图扇区 加起来超过 100%
- misleading(误导):技术上合规、但有意引导误读——如对数刻度、截断基线、拉宽 纵横比、加双纵轴
- truthful(真实):数据准确且遵守规则;两个"同样真实"的画法可能并存(如 ch-0001 两张世界地图)
How to Lie with Charts(引用 Mark Monmonier《How to Lie with Maps》的启发):
- 截断基线夸大变化(把纵轴起点裁掉一大截,经济数据常见)
- 拉宽/压扁图表改变 aspect ratio 淡化或夸大趋势(引 Alberto Cairo 的建议:斜率约 45° 时最利于诚实读图,但非普适)
- 加更多数据序列 + 双纵轴制造虚假关联
How to Lie with Maps:分类分桶(class intervals)的切法、投影方式、颜色选择都会 改变叙事。
偏差(bias):定义为"不公平地偏向某一观点"。四类数据偏差:
- sampling biases(采样偏差):selection / non-response / self-selection(ch-0006 已预警)
- cognitive biases(认知偏差):confirmation(只信符合先见的)、pattern(把随机数 看成规律)、framing(同一事实换个说法:5% 死亡率 vs 95% 存活率)
- algorithmic biases(算法偏差):系统放大既有特权,如司法再犯预测软件(Northpointe/ Equivant)的种族偏差
- intergroup biases(群体间偏差):群体刻板印象影响数据呈现与解读
四类空间偏差(spatial bias):map area(眼球被大区域吸引——怀俄明 vs 罗德岛选举人票 案例)、projection(投影扭曲)、disputed territory(争议领土的呈现立场)、exclusion (数据缺失区域的隐形)。
要点归纳
- 判定三步:wrong(违规)→ misleading(合规但误导)→ truthful(准确+合规)
- 图表说谎常用四招:截断基线、对数刻度、拉宽纵横比、双纵轴
- 地图说谎靠"分类/投影/配色"的选择——与 ch-0001 两张都"真实"的地图呼应
- 四类数据偏差 + 四类空间偏差,识别是减少的第一步
- framing bias 的经典例子:5% 死亡率与 95% 存活率是同一事实
- 反制手段:标注来源与不确定性(见 ch-0016)、不做选择性呈现、主动寻找反例
术语 / 概念
- wrong / misleading / truthful — 可视化真伪三分法(本书核心判定框架)
- truncated baseline(截断基线) — 纵轴不从零开始,夸大/掩盖差异
- aspect ratio(纵横比) — 图的宽高比;Cairo 建议接近 45° 斜率(非硬规则)
- dual vertical axis(双纵轴) — 两条量纲不同的曲线共轴,易制造假关联
- confirmation / pattern / framing bias — 确认偏差 / 模式偏差 / 框架偏差
- algorithmic bias(算法偏差) — 算法系统性偏袒某些群体(如司法预测)
- intergroup bias(群体间偏差) — 群体刻板印象造成的不公
- map area / projection / disputed territory / exclusion bias — 四类空间偏差
原句摘录
...if a bar or column chart begins at a number other than zero, it's wrong because those types of charts represent values through length or height, which readers cannot determine if the baseline has been truncated.
The first map sorts nations in three categories... while the second map displays the entire range in a green-blue color gradient... Yet both maps are equally valid, because neither violates a definitive rule in map design nor intentionally disguises data.
We define bias as unfairly favoring one view over another.
疑问 / 待查
- Monmonier《How to Lie with Maps》与 Cairo《How Charts Lie》作为延伸阅读(见 notes.md 重要参考)
- 算法偏差(COMPAS 再犯预测)是数据伦理的重要议题,可单列深入研究
Backlinks (1)
flowchart LR
n0["ch-0001 凶案、侦探与母亲的信(第 2–163 章)"]
n1["ch-0002 坦白、出逃与和解(第 163–233 章)"]
n2["The Curious Incident of the Dog in the Night-Time 人物"]
n3["The Curious Incident of the Dog in the Night-Time(整理完成)"]
n4["The Curious Incident of the Dog in the Night-Time 笔记"]
n5["The Curious Incident of the Dog in the Night-Time 故事线"]
n6["E-Commerce Bench(整理完成)"]
n7["E-Commerce Bench 笔记"]
n8["part-0001 摘要与引言:一年期电商运营基准(Abstract + §1)"]
n9["part-0002 相关工作与定位:continuing 任务谱系(Table 1 + §2)"]
n10["part-0003 基准设计:四层架构与确定性经济(§3 主体)"]
n11["part-0004 实验结果:18 模型的多维画像(Table 2 + §4)"]
n12["part-0005 结论与参考文献(§5 + References)"]
n13["part-0006 工具集与 agent harness:18 工具与上下文管理(Table 3 + Appendix A)"]
n14["part-0007 数据层:类目、店型、日历与供应商(Appendix B)"]
n15["part-0008 经济引擎:13 步结算与需求/退货/成本公式(Table 7 + Appendix C)"]
n16["part-0009 确定性谈判内核:决策函数与骗局目录(Appendix D)"]
n17["part-0010 评测指标定义:六个维度与统计口径(Appendix E)"]
n18["part-0011 每维度结果导览与模型/实验设置(Table 10 + Appendix F)"]
n19["part-0012 失败案例研究:骗局实录与一次破产(Appendix G)"]
n20["part-0013 失败模式规则表与提示词设计(Table 18 + Appendix H)"]
n21["The End of Software Engineering(整理完成)"]
n22["The End of Software Engineering 笔记"]
n23["part-0001 摘要与引言:范式重构的宣告(Abstract + §1 前段)"]
n24["part-0002 第一性原理:传统软件与 Agent 系统的形式化模型(§1 后段 + §2)"]
n25["part-0003 三代交付史与 AI→Software→Result 的失败(§3.1–3.2)"]
n26["part-0004 Agent→Result 与 Agentic Engineering 学科(§3.3 + §4)"]
n27["part-0005 实证证据与 EvoClaw 落差(§5)"]
n28["part-0006 四阶段演进路线图(前段:表 3 + Stage I–III)"]
n29["part-0007 路线图后段与建议:实践者与研究者(§6.3 后段 + §6.4 + §7.1–7.2)"]
n30["ch-0001 Introduction(为什么做数据可视化)"]
n31["ch-0002 选工具讲你的数据故事(Ch 1)"]
n32["ch-0003 强化电子表格技能(Ch 2)"]
n33["ch-0004 找到并质询你的数据(Ch 3)"]
n34["ch-0005 清洗脏数据(Ch 4)"]
n35["ch-0006 做有意义的比较(Ch 5)"]
n36["ch-0007 图表化你的数据(Ch 6)"]
n37["ch-0008 地图化你的数据(Ch 7)"]
n38["ch-0009 表格化你的数据(Ch 8)"]
n39["ch-0010 嵌入网页(Ch 9)"]
n40["ch-0011 用 GitHub 编辑与托管代码(Ch 10)"]
n41["ch-0012 Chart.js 与 Highcharts 模板(Ch 11)"]
n42["ch-0013 Leaflet 地图模板(Ch 12)"]
n43["ch-0014 转换你的地图数据(Ch 13)"]
n44["ch-0015 识别谎言、减少偏差(Ch 14)"]
n45["ch-0016 讲述并展示你的数据故事(Ch 15)"]
n46["ch-0017 附录 A 排查常见问题"]
n47["Hands-On Data Visualization(整理完成)"]
n48["Hands-On Data Visualization 笔记"]
n49["Reading"]
n0 --> n4
n3 --> n0
n3 --> n1
n3 --> n2
n3 --> n4
n3 --> n5
n5 --> n3
n6 --> n7
n6 --> n8
n6 --> n9
n6 --> n10
n6 --> n11
n6 --> n12
n6 --> n13
n6 --> n14
n6 --> n15
n6 --> n16
n6 --> n17
n6 --> n18
n6 --> n19
n6 --> n20
n21 --> n22
n21 --> n23
n21 --> n24
n21 --> n25
n21 --> n26
n21 --> n27
n21 --> n28
n21 --> n29
n22 --> n21
n47 --> n30
n47 --> n31
n47 --> n32
n47 --> n33
n47 --> n34
n47 --> n35
n47 --> n36
n47 --> n37
n47 --> n38
n47 --> n39
n47 --> n40
n47 --> n41
n47 --> n42
n47 --> n43
n47 --> n44
n47 --> n45
n47 --> n46
n47 --> n48
n49 --> n3
n49 --> n6
n49 --> n21
n49 --> n47
click n0 "../../curious-incident/ch-0001/" "ch-0001 凶案、侦探与母亲的信(第 2–163 章)"
click n1 "../../curious-incident/ch-0002/" "ch-0002 坦白、出逃与和解(第 163–233 章)"
click n2 "../../curious-incident/characters/" "The Curious Incident of the Dog in the Night-Time 人物"
click n3 "../../curious-incident/" "The Curious Incident of the Dog in the Night-Time(整理完成)"
click n4 "../../curious-incident/notes/" "The Curious Incident of the Dog in the Night-Time 笔记"
click n5 "../../curious-incident/storyline/" "The Curious Incident of the Dog in the Night-Time 故事线"
click n6 "../../e-commerce-bench/" "E-Commerce Bench(整理完成)"
click n7 "../../e-commerce-bench/notes/" "E-Commerce Bench 笔记"
click n8 "../../e-commerce-bench/part-0001/" "part-0001 摘要与引言:一年期电商运营基准(Abstract + §1)"
click n9 "../../e-commerce-bench/part-0002/" "part-0002 相关工作与定位:continuing 任务谱系(Table 1 + §2)"
click n10 "../../e-commerce-bench/part-0003/" "part-0003 基准设计:四层架构与确定性经济(§3 主体)"
click n11 "../../e-commerce-bench/part-0004/" "part-0004 实验结果:18 模型的多维画像(Table 2 + §4)"
click n12 "../../e-commerce-bench/part-0005/" "part-0005 结论与参考文献(§5 + References)"
click n13 "../../e-commerce-bench/part-0006/" "part-0006 工具集与 agent harness:18 工具与上下文管理(Table 3 + Appendix A)"
click n14 "../../e-commerce-bench/part-0007/" "part-0007 数据层:类目、店型、日历与供应商(Appendix B)"
click n15 "../../e-commerce-bench/part-0008/" "part-0008 经济引擎:13 步结算与需求/退货/成本公式(Table 7 + Appendix C)"
click n16 "../../e-commerce-bench/part-0009/" "part-0009 确定性谈判内核:决策函数与骗局目录(Appendix D)"
click n17 "../../e-commerce-bench/part-0010/" "part-0010 评测指标定义:六个维度与统计口径(Appendix E)"
click n18 "../../e-commerce-bench/part-0011/" "part-0011 每维度结果导览与模型/实验设置(Table 10 + Appendix F)"
click n19 "../../e-commerce-bench/part-0012/" "part-0012 失败案例研究:骗局实录与一次破产(Appendix G)"
click n20 "../../e-commerce-bench/part-0013/" "part-0013 失败模式规则表与提示词设计(Table 18 + Appendix H)"
click n21 "../../end-of-software-engineering/" "The End of Software Engineering(整理完成)"
click n22 "../../end-of-software-engineering/notes/" "The End of Software Engineering 笔记"
click n23 "../../end-of-software-engineering/part-0001/" "part-0001 摘要与引言:范式重构的宣告(Abstract + §1 前段)"
click n24 "../../end-of-software-engineering/part-0002/" "part-0002 第一性原理:传统软件与 Agent 系统的形式化模型(§1 后段 + §2)"
click n25 "../../end-of-software-engineering/part-0003/" "part-0003 三代交付史与 AI→Software→Result 的失败(§3.1–3.2)"
click n26 "../../end-of-software-engineering/part-0004/" "part-0004 Agent→Result 与 Agentic Engineering 学科(§3.3 + §4)"
click n27 "../../end-of-software-engineering/part-0005/" "part-0005 实证证据与 EvoClaw 落差(§5)"
click n28 "../../end-of-software-engineering/part-0006/" "part-0006 四阶段演进路线图(前段:表 3 + Stage I–III)"
click n29 "../../end-of-software-engineering/part-0007/" "part-0007 路线图后段与建议:实践者与研究者(§6.3 后段 + §6.4 + §7.1–7.2)"
click n30 "../ch-0001/" "ch-0001 Introduction(为什么做数据可视化)"
click n31 "../ch-0002/" "ch-0002 选工具讲你的数据故事(Ch 1)"
click n32 "../ch-0003/" "ch-0003 强化电子表格技能(Ch 2)"
click n33 "../ch-0004/" "ch-0004 找到并质询你的数据(Ch 3)"
click n34 "../ch-0005/" "ch-0005 清洗脏数据(Ch 4)"
click n35 "../ch-0006/" "ch-0006 做有意义的比较(Ch 5)"
click n36 "../ch-0007/" "ch-0007 图表化你的数据(Ch 6)"
click n37 "../ch-0008/" "ch-0008 地图化你的数据(Ch 7)"
click n38 "../ch-0009/" "ch-0009 表格化你的数据(Ch 8)"
click n39 "../ch-0010/" "ch-0010 嵌入网页(Ch 9)"
click n40 "../ch-0011/" "ch-0011 用 GitHub 编辑与托管代码(Ch 10)"
click n41 "../ch-0012/" "ch-0012 Chart.js 与 Highcharts 模板(Ch 11)"
click n42 "../ch-0013/" "ch-0013 Leaflet 地图模板(Ch 12)"
click n43 "../ch-0014/" "ch-0014 转换你的地图数据(Ch 13)"
click n44 "./" "ch-0015 识别谎言、减少偏差(Ch 14)"
click n45 "../ch-0016/" "ch-0016 讲述并展示你的数据故事(Ch 15)"
click n46 "../ch-0017/" "ch-0017 附录 A 排查常见问题"
click n47 "../" "Hands-On Data Visualization(整理完成)"
click n48 "../notes/" "Hands-On Data Visualization 笔记"
click n49 "../../" "Reading"