DuckDB
DuckDB 实战研究 —— 环境与基本使用、模拟数据构造、以及原始数据在 PostgreSQL 时如何用 DuckDB 加速分析查询。
Sub Topics
| 阅读顺序 | 主题 | 描述 |
|---|---|---|
| 1 | 环境与基本使用 | CLI / Python API 安装与上手、常用 SQL、CSV 导出、扩展机制(parquet / json / httpfs / postgres) |
| 2 | 模拟数据 | 内置生成器、迷你电商数仓(10 万客户 / 100 万订单)、TPC-H dbgen、导出 Parquet |
| 3 | PostgreSQL 加速查询 | pg_duckdb / 阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比 |
推荐阅读顺序
- 环境与基本使用 → 环境与基本使用:装好 CLI 与 Python API, 跑通第一个查询,学会把表导出成 CSV,了解扩展机制
- 构造模拟数据 → 模拟数据:用 SQL 生成贴近真实的分析数据集, 导出 Parquet(后续 PG 加速实验的载体)
- PG 加速实战 → PostgreSQL 加速查询:数据在 PG 时, pg_duckdb + force_execution、阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比
DuckDB 内部原理(向量化执行、列式存储等「为什么快」的进阶内容) 暂未收录,后续按需补充。
相关笔记
- Collection Database:数据库相关资源收藏
- Research 索引:研究笔记总目录
Backlinks (3)
flowchart LR
n0["AI"]
n1["Database"]
n2["Dev Tools"]
n3["Emoji"]
n4["Frontend"]
n5["Game Dev"]
n6["Collection"]
n7["Languages"]
n8["Maps"]
n9["Media"]
n10["Monitor"]
n11["Study Materials"]
n12["Plans"]
n13["Storage"]
n14["对象存储基本用法(Bucket / Object / 常用操作)"]
n15["挂载 Bucket 为本地文件系统(FUSE Mount)"]
n16["对象存储签名 URL(Signed URL)原理与实战"]
n17["对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"]
n18["Prototypes"]
n19["Research"]
n20["Better Auth 源码阅读指南"]
n21["DuckDB 环境与基本使用"]
n22["DuckDB 实战研究"]
n23["DuckDB 模拟数据"]
n24["PostgreSQL 数据用 DuckDB 加速查询"]
n25["HK 角色阅读"]
n26["HK 台词阅读"]
n27["Hollow Knight 英语主题"]
n28["HK 物品阅读"]
n29["HK 地点阅读"]
n30["HK 世界观 / Lore 阅读"]
n31["英语学习 Dashboard"]
n32["English Scraps Archive"]
n33["English Scraps 使用指南"]
n34["Jellyfin 源码阅读指南"]
n35["Lux 资料整理"]
n36["Nest Commander 学习资料"]
n37["NestJS 源码阅读指南"]
n38["Protomaps 自建底图研究"]
n39["自制 PMTiles 地图(最简单例子)"]
n40["MapLibre 集成 Protomaps"]
n41["PMTiles 格式与工具链"]
n42["上海地区底图项目"]
n43["Redash 源码阅读指南"]
n44["Rust 学习计划"]
n45["shadcn/ui 进阶使用"]
n46["shadcn/ui 组件添加与基本使用"]
n47["shadcn/ui 实用研究(从环境到基本使用)"]
n48["shadcn/ui 环境与初始化"]
n49["TRIP 项目核心原理与代码阅读指南"]
n1 --> n22
n1 --> n24
n4 --> n47
n6 --> n0
n6 --> n1
n6 --> n2
n6 --> n3
n6 --> n4
n6 --> n5
n6 --> n7
n6 --> n8
n6 --> n9
n6 --> n10
n6 --> n11
n6 --> n12
n6 --> n13
n6 --> n19
n14 --> n16
n14 --> n17
n14 --> n18
n15 --> n14
n15 --> n16
n15 --> n17
n16 --> n18
n17 --> n14
n17 --> n16
n17 --> n18
n18 --> n14
n18 --> n15
n18 --> n16
n18 --> n17
n18 --> n38
n19 --> n20
n19 --> n22
n19 --> n31
n19 --> n34
n19 --> n35
n19 --> n36
n19 --> n37
n19 --> n38
n19 --> n43
n19 --> n44
n19 --> n47
n19 --> n49
n21 --> n23
n22 --> n1
n22 --> n19
n22 --> n21
n22 --> n23
n22 --> n24
n23 --> n21
n23 --> n24
n24 --> n22
n24 --> n23
n27 --> n25
n27 --> n26
n27 --> n28
n27 --> n29
n27 --> n30
n27 --> n33
n31 --> n27
n31 --> n32
n31 --> n33
n33 --> n31
n33 --> n32
n38 --> n8
n38 --> n39
n38 --> n40
n38 --> n41
n38 --> n42
n39 --> n41
n40 --> n18
n40 --> n42
n41 --> n39
n41 --> n42
n42 --> n40
n42 --> n41
n45 --> n46
n46 --> n45
n46 --> n48
n47 --> n4
n47 --> n19
n47 --> n45
n47 --> n46
n47 --> n48
n48 --> n46
click n0 "../../../collection/ai/" "AI"
click n1 "../../../collection/database/" "Database"
click n2 "../../../collection/dev-tools/" "Dev Tools"
click n3 "../../../collection/emoji/" "Emoji"
click n4 "../../../collection/frontend/" "Frontend"
click n5 "../../../collection/game-dev/" "Game Dev"
click n6 "../../../collection/" "Collection"
click n7 "../../../collection/languages/" "Languages"
click n8 "../../../collection/maps/" "Maps"
click n9 "../../../collection/media/" "Media"
click n10 "../../../collection/monitor/" "Monitor"
click n11 "../../../collection/reading/" "Study Materials"
click n12 "../../../collection/scraps/plans/" "Plans"
click n13 "../../../collection/storage/" "Storage"
click n14 "../../../knowledge/infrastructure/cloud/object-storage/basic-usage/" "对象存储基本用法(Bucket / Object / 常用操作)"
click n15 "../../../knowledge/infrastructure/cloud/object-storage/mount-bucket/" "挂载 Bucket 为本地文件系统(FUSE Mount)"
click n16 "../../../knowledge/infrastructure/cloud/object-storage/signed-url/" "对象存储签名 URL(Signed URL)原理与实战"
click n17 "../../../knowledge/infrastructure/cloud/object-storage/vendors-comparison/" "对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"
click n18 "../../../prototypes/" "Prototypes"
click n19 "../../" "Research"
click n20 "../better-auth/" "Better Auth 源码阅读指南"
click n21 "basic-usage/" "DuckDB 环境与基本使用"
click n22 "./" "DuckDB 实战研究"
click n23 "mock-data/" "DuckDB 模拟数据"
click n24 "postgresql-acceleration/" "PostgreSQL 数据用 DuckDB 加速查询"
click n25 "../english/hollow-knight/characters/" "HK 角色阅读"
click n26 "../english/hollow-knight/dialogues/" "HK 台词阅读"
click n27 "../english/hollow-knight/" "Hollow Knight 英语主题"
click n28 "../english/hollow-knight/items/" "HK 物品阅读"
click n29 "../english/hollow-knight/locations/" "HK 地点阅读"
click n30 "../english/hollow-knight/lore/" "HK 世界观 / Lore 阅读"
click n31 "../english/" "英语学习 Dashboard"
click n32 "../english/scraps/archive/" "English Scraps Archive"
click n33 "../english/scraps/" "English Scraps 使用指南"
click n34 "../jellyfin/" "Jellyfin 源码阅读指南"
click n35 "../lux/" "Lux 资料整理"
click n36 "../nest-commander/" "Nest Commander 学习资料"
click n37 "../nestjs/" "NestJS 源码阅读指南"
click n38 "../protomaps/" "Protomaps 自建底图研究"
click n39 "../protomaps/make-own-map/" "自制 PMTiles 地图(最简单例子)"
click n40 "../protomaps/maplibre/" "MapLibre 集成 Protomaps"
click n41 "../protomaps/pmtiles/" "PMTiles 格式与工具链"
click n42 "../protomaps/shanghai-map/" "上海地区底图项目"
click n43 "../redash/" "Redash 源码阅读指南"
click n44 "../rust/" "Rust 学习计划"
click n45 "../shadcn-ui/advanced/" "shadcn/ui 进阶使用"
click n46 "../shadcn-ui/components/" "shadcn/ui 组件添加与基本使用"
click n47 "../shadcn-ui/" "shadcn/ui 实用研究(从环境到基本使用)"
click n48 "../shadcn-ui/setup/" "shadcn/ui 环境与初始化"
click n49 "../trip/" "TRIP 项目核心原理与代码阅读指南"