Skip to content

DuckDB

DuckDB 实战研究 —— 环境与基本使用、模拟数据构造、以及原始数据在 PostgreSQL 时如何用 DuckDB 加速分析查询。

Sub Topics

阅读顺序 主题 描述
1 环境与基本使用 CLI / Python API 安装与上手、常用 SQL、CSV 导出、扩展机制(parquet / json / httpfs / postgres)
2 模拟数据 内置生成器、迷你电商数仓(10 万客户 / 100 万订单)、TPC-H dbgen、导出 Parquet
3 PostgreSQL 加速查询 pg_duckdb / 阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比

推荐阅读顺序

  1. 环境与基本使用环境与基本使用:装好 CLI 与 Python API, 跑通第一个查询,学会把表导出成 CSV,了解扩展机制
  2. 构造模拟数据模拟数据:用 SQL 生成贴近真实的分析数据集, 导出 Parquet(后续 PG 加速实验的载体)
  3. PG 加速实战PostgreSQL 加速查询:数据在 PG 时, pg_duckdb + force_execution、阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比

DuckDB 内部原理(向量化执行、列式存储等「为什么快」的进阶内容) 暂未收录,后续按需补充。

相关笔记

Backlinks (3)
flowchart LR
  n0["AI"]
  n1["Database"]
  n2["Dev Tools"]
  n3["Emoji"]
  n4["Frontend"]
  n5["Game Dev"]
  n6["Collection"]
  n7["Languages"]
  n8["Maps"]
  n9["Media"]
  n10["Monitor"]
  n11["Study Materials"]
  n12["Plans"]
  n13["Storage"]
  n14["对象存储基本用法(Bucket / Object / 常用操作)"]
  n15["挂载 Bucket 为本地文件系统(FUSE Mount)"]
  n16["对象存储签名 URL(Signed URL)原理与实战"]
  n17["对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"]
  n18["Prototypes"]
  n19["Research"]
  n20["Better Auth 源码阅读指南"]
  n21["DuckDB 环境与基本使用"]
  n22["DuckDB 实战研究"]
  n23["DuckDB 模拟数据"]
  n24["PostgreSQL 数据用 DuckDB 加速查询"]
  n25["HK 角色阅读"]
  n26["HK 台词阅读"]
  n27["Hollow Knight 英语主题"]
  n28["HK 物品阅读"]
  n29["HK 地点阅读"]
  n30["HK 世界观 / Lore 阅读"]
  n31["英语学习 Dashboard"]
  n32["English Scraps Archive"]
  n33["English Scraps 使用指南"]
  n34["Jellyfin 源码阅读指南"]
  n35["Lux 资料整理"]
  n36["Nest Commander 学习资料"]
  n37["NestJS 源码阅读指南"]
  n38["Protomaps 自建底图研究"]
  n39["自制 PMTiles 地图(最简单例子)"]
  n40["MapLibre 集成 Protomaps"]
  n41["PMTiles 格式与工具链"]
  n42["上海地区底图项目"]
  n43["Redash 源码阅读指南"]
  n44["Rust 学习计划"]
  n45["shadcn/ui 进阶使用"]
  n46["shadcn/ui 组件添加与基本使用"]
  n47["shadcn/ui 实用研究(从环境到基本使用)"]
  n48["shadcn/ui 环境与初始化"]
  n49["TRIP 项目核心原理与代码阅读指南"]
  n1 --> n22
  n1 --> n24
  n4 --> n47
  n6 --> n0
  n6 --> n1
  n6 --> n2
  n6 --> n3
  n6 --> n4
  n6 --> n5
  n6 --> n7
  n6 --> n8
  n6 --> n9
  n6 --> n10
  n6 --> n11
  n6 --> n12
  n6 --> n13
  n6 --> n19
  n14 --> n16
  n14 --> n17
  n14 --> n18
  n15 --> n14
  n15 --> n16
  n15 --> n17
  n16 --> n18
  n17 --> n14
  n17 --> n16
  n17 --> n18
  n18 --> n14
  n18 --> n15
  n18 --> n16
  n18 --> n17
  n18 --> n38
  n19 --> n20
  n19 --> n22
  n19 --> n31
  n19 --> n34
  n19 --> n35
  n19 --> n36
  n19 --> n37
  n19 --> n38
  n19 --> n43
  n19 --> n44
  n19 --> n47
  n19 --> n49
  n21 --> n23
  n22 --> n1
  n22 --> n19
  n22 --> n21
  n22 --> n23
  n22 --> n24
  n23 --> n21
  n23 --> n24
  n24 --> n22
  n24 --> n23
  n27 --> n25
  n27 --> n26
  n27 --> n28
  n27 --> n29
  n27 --> n30
  n27 --> n33
  n31 --> n27
  n31 --> n32
  n31 --> n33
  n33 --> n31
  n33 --> n32
  n38 --> n8
  n38 --> n39
  n38 --> n40
  n38 --> n41
  n38 --> n42
  n39 --> n41
  n40 --> n18
  n40 --> n42
  n41 --> n39
  n41 --> n42
  n42 --> n40
  n42 --> n41
  n45 --> n46
  n46 --> n45
  n46 --> n48
  n47 --> n4
  n47 --> n19
  n47 --> n45
  n47 --> n46
  n47 --> n48
  n48 --> n46
  click n0 "../../../collection/ai/" "AI"
  click n1 "../../../collection/database/" "Database"
  click n2 "../../../collection/dev-tools/" "Dev Tools"
  click n3 "../../../collection/emoji/" "Emoji"
  click n4 "../../../collection/frontend/" "Frontend"
  click n5 "../../../collection/game-dev/" "Game Dev"
  click n6 "../../../collection/" "Collection"
  click n7 "../../../collection/languages/" "Languages"
  click n8 "../../../collection/maps/" "Maps"
  click n9 "../../../collection/media/" "Media"
  click n10 "../../../collection/monitor/" "Monitor"
  click n11 "../../../collection/reading/" "Study Materials"
  click n12 "../../../collection/scraps/plans/" "Plans"
  click n13 "../../../collection/storage/" "Storage"
  click n14 "../../../knowledge/infrastructure/cloud/object-storage/basic-usage/" "对象存储基本用法(Bucket / Object / 常用操作)"
  click n15 "../../../knowledge/infrastructure/cloud/object-storage/mount-bucket/" "挂载 Bucket 为本地文件系统(FUSE Mount)"
  click n16 "../../../knowledge/infrastructure/cloud/object-storage/signed-url/" "对象存储签名 URL(Signed URL)原理与实战"
  click n17 "../../../knowledge/infrastructure/cloud/object-storage/vendors-comparison/" "对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"
  click n18 "../../../prototypes/" "Prototypes"
  click n19 "../../" "Research"
  click n20 "../better-auth/" "Better Auth 源码阅读指南"
  click n21 "basic-usage/" "DuckDB 环境与基本使用"
  click n22 "./" "DuckDB 实战研究"
  click n23 "mock-data/" "DuckDB 模拟数据"
  click n24 "postgresql-acceleration/" "PostgreSQL 数据用 DuckDB 加速查询"
  click n25 "../english/hollow-knight/characters/" "HK 角色阅读"
  click n26 "../english/hollow-knight/dialogues/" "HK 台词阅读"
  click n27 "../english/hollow-knight/" "Hollow Knight 英语主题"
  click n28 "../english/hollow-knight/items/" "HK 物品阅读"
  click n29 "../english/hollow-knight/locations/" "HK 地点阅读"
  click n30 "../english/hollow-knight/lore/" "HK 世界观 / Lore 阅读"
  click n31 "../english/" "英语学习 Dashboard"
  click n32 "../english/scraps/archive/" "English Scraps Archive"
  click n33 "../english/scraps/" "English Scraps 使用指南"
  click n34 "../jellyfin/" "Jellyfin 源码阅读指南"
  click n35 "../lux/" "Lux 资料整理"
  click n36 "../nest-commander/" "Nest Commander 学习资料"
  click n37 "../nestjs/" "NestJS 源码阅读指南"
  click n38 "../protomaps/" "Protomaps 自建底图研究"
  click n39 "../protomaps/make-own-map/" "自制 PMTiles 地图(最简单例子)"
  click n40 "../protomaps/maplibre/" "MapLibre 集成 Protomaps"
  click n41 "../protomaps/pmtiles/" "PMTiles 格式与工具链"
  click n42 "../protomaps/shanghai-map/" "上海地区底图项目"
  click n43 "../redash/" "Redash 源码阅读指南"
  click n44 "../rust/" "Rust 学习计划"
  click n45 "../shadcn-ui/advanced/" "shadcn/ui 进阶使用"
  click n46 "../shadcn-ui/components/" "shadcn/ui 组件添加与基本使用"
  click n47 "../shadcn-ui/" "shadcn/ui 实用研究(从环境到基本使用)"
  click n48 "../shadcn-ui/setup/" "shadcn/ui 环境与初始化"
  click n49 "../trip/" "TRIP 项目核心原理与代码阅读指南"
Links (5)