DuckDB
DuckDB 实战研究 —— 环境与基本使用、模拟数据构造、以及原始数据在 PostgreSQL 时如何用 DuckDB 加速分析查询。
Sub Topics
| 阅读顺序 | 主题 | 描述 |
|---|---|---|
| 1 | 环境与基本使用 | CLI / Python API 安装与上手、常用 SQL、CSV 导出、扩展机制(parquet / json / httpfs / postgres) |
| 2 | 模拟数据 | 内置生成器、迷你电商数仓(10 万客户 / 100 万订单)、TPC-H dbgen、导出 Parquet |
| 3 | PostgreSQL 加速查询 | pg_duckdb / 阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比 |
推荐阅读顺序
- 环境与基本使用 → 环境与基本使用:装好 CLI 与 Python API, 跑通第一个查询,学会把表导出成 CSV,了解扩展机制
- 构造模拟数据 → 模拟数据:用 SQL 生成贴近真实的分析数据集, 导出 Parquet(后续 PG 加速实验的载体)
- PG 加速实战 → PostgreSQL 加速查询:数据在 PG 时, pg_duckdb + force_execution、阿里云 rds_duckdb、postgres_scanner、Parquet 导出、基准对比
DuckDB 内部原理(向量化执行、列式存储等「为什么快」的进阶内容) 暂未收录,后续按需补充。
相关笔记
- Collection Database:数据库相关资源收藏
- Research 索引:研究笔记总目录
Backlinks (3)
flowchart LR
n0["AI"]
n1["Database"]
n2["Dev Tools"]
n3["Emoji"]
n4["Frontend"]
n5["Game Dev"]
n6["Collection"]
n7["Languages"]
n8["Maps"]
n9["Media"]
n10["Monitor"]
n11["Study Materials"]
n12["Plans"]
n13["Storage"]
n14["Film & TV"]
n15["Bitcask 存储模型(日志结构哈希表)"]
n16["对象存储基本用法(Bucket / Object / 常用操作)"]
n17["挂载 Bucket 为本地文件系统(FUSE Mount)"]
n18["对象存储签名 URL(Signed URL)原理与实战"]
n19["对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"]
n20["Prototypes"]
n21["Research"]
n22["Better Auth 源码阅读指南"]
n23["DuckDB 环境与基本使用"]
n24["DuckDB 实战研究"]
n25["DuckDB 模拟数据"]
n26["PostgreSQL 数据用 DuckDB 加速查询"]
n27["HK 角色阅读"]
n28["HK 台词阅读"]
n29["Hollow Knight 英语主题"]
n30["HK 物品阅读"]
n31["HK 地点阅读"]
n32["英语学习 Dashboard"]
n33["English Scraps Archive"]
n34["English Scraps 使用指南"]
n35["Jellyfin 源码阅读指南"]
n36["Lux 资料整理"]
n37["Nest Commander 学习资料"]
n38["NestJS 源码阅读指南"]
n39["Protomaps 自建底图研究"]
n40["自制 PMTiles 地图(最简单例子)"]
n41["MapLibre 集成 Protomaps"]
n42["PMTiles 格式与工具链"]
n43["上海地区底图项目"]
n44["Redash 源码阅读指南"]
n45["shadcn/ui 进阶使用"]
n46["shadcn/ui 组件添加与基本使用"]
n47["shadcn/ui 实用研究(从环境到基本使用)"]
n48["shadcn/ui 环境与初始化"]
n49["TRIP 项目核心原理与代码阅读指南"]
n1 --> n24
n1 --> n26
n4 --> n47
n6 --> n0
n6 --> n1
n6 --> n2
n6 --> n3
n6 --> n4
n6 --> n5
n6 --> n7
n6 --> n8
n6 --> n9
n6 --> n10
n6 --> n11
n6 --> n12
n6 --> n13
n6 --> n21
n9 --> n14
n16 --> n18
n16 --> n19
n16 --> n20
n17 --> n16
n17 --> n18
n17 --> n19
n18 --> n20
n19 --> n16
n19 --> n18
n19 --> n20
n20 --> n15
n20 --> n16
n20 --> n17
n20 --> n18
n20 --> n19
n20 --> n39
n21 --> n22
n21 --> n24
n21 --> n32
n21 --> n35
n21 --> n36
n21 --> n37
n21 --> n38
n21 --> n39
n21 --> n44
n21 --> n47
n21 --> n49
n23 --> n25
n24 --> n1
n24 --> n21
n24 --> n23
n24 --> n25
n24 --> n26
n25 --> n23
n25 --> n26
n26 --> n24
n26 --> n25
n29 --> n27
n29 --> n28
n29 --> n30
n29 --> n31
n29 --> n34
n32 --> n29
n32 --> n33
n32 --> n34
n34 --> n32
n34 --> n33
n39 --> n8
n39 --> n40
n39 --> n41
n39 --> n42
n39 --> n43
n40 --> n42
n41 --> n20
n41 --> n43
n42 --> n40
n42 --> n43
n43 --> n41
n43 --> n42
n45 --> n46
n46 --> n45
n46 --> n48
n47 --> n4
n47 --> n21
n47 --> n45
n47 --> n46
n47 --> n48
n48 --> n46
click n0 "../../../collection/ai/" "AI"
click n1 "../../../collection/database/" "Database"
click n2 "../../../collection/dev-tools/" "Dev Tools"
click n3 "../../../collection/emoji/" "Emoji"
click n4 "../../../collection/frontend/" "Frontend"
click n5 "../../../collection/game-dev/" "Game Dev"
click n6 "../../../collection/" "Collection"
click n7 "../../../collection/languages/" "Languages"
click n8 "../../../collection/maps/" "Maps"
click n9 "../../../collection/media/" "Media"
click n10 "../../../collection/monitor/" "Monitor"
click n11 "../../../collection/reading/" "Study Materials"
click n12 "../../../collection/scraps/plans/" "Plans"
click n13 "../../../collection/storage/" "Storage"
click n14 "../../../film-tv/" "Film & TV"
click n15 "../../../knowledge/database/kv/bitcask/" "Bitcask 存储模型(日志结构哈希表)"
click n16 "../../../knowledge/infrastructure/cloud/object-storage/basic-usage/" "对象存储基本用法(Bucket / Object / 常用操作)"
click n17 "../../../knowledge/infrastructure/cloud/object-storage/mount-bucket/" "挂载 Bucket 为本地文件系统(FUSE Mount)"
click n18 "../../../knowledge/infrastructure/cloud/object-storage/signed-url/" "对象存储签名 URL(Signed URL)原理与实战"
click n19 "../../../knowledge/infrastructure/cloud/object-storage/vendors-comparison/" "对象存储供应商对比(S3 / R2 / OSS / Supabase / MinIO)"
click n20 "../../../prototypes/" "Prototypes"
click n21 "../../" "Research"
click n22 "../better-auth/" "Better Auth 源码阅读指南"
click n23 "basic-usage/" "DuckDB 环境与基本使用"
click n24 "./" "DuckDB 实战研究"
click n25 "mock-data/" "DuckDB 模拟数据"
click n26 "postgresql-acceleration/" "PostgreSQL 数据用 DuckDB 加速查询"
click n27 "../english/hollow-knight/characters/" "HK 角色阅读"
click n28 "../english/hollow-knight/dialogues/" "HK 台词阅读"
click n29 "../english/hollow-knight/" "Hollow Knight 英语主题"
click n30 "../english/hollow-knight/items/" "HK 物品阅读"
click n31 "../english/hollow-knight/locations/" "HK 地点阅读"
click n32 "../english/" "英语学习 Dashboard"
click n33 "../english/scraps/archive/" "English Scraps Archive"
click n34 "../english/scraps/" "English Scraps 使用指南"
click n35 "../jellyfin/" "Jellyfin 源码阅读指南"
click n36 "../lux/" "Lux 资料整理"
click n37 "../nest-commander/" "Nest Commander 学习资料"
click n38 "../nestjs/" "NestJS 源码阅读指南"
click n39 "../protomaps/" "Protomaps 自建底图研究"
click n40 "../protomaps/make-own-map/" "自制 PMTiles 地图(最简单例子)"
click n41 "../protomaps/maplibre/" "MapLibre 集成 Protomaps"
click n42 "../protomaps/pmtiles/" "PMTiles 格式与工具链"
click n43 "../protomaps/shanghai-map/" "上海地区底图项目"
click n44 "../redash/" "Redash 源码阅读指南"
click n45 "../shadcn-ui/advanced/" "shadcn/ui 进阶使用"
click n46 "../shadcn-ui/components/" "shadcn/ui 组件添加与基本使用"
click n47 "../shadcn-ui/" "shadcn/ui 实用研究(从环境到基本使用)"
click n48 "../shadcn-ui/setup/" "shadcn/ui 环境与初始化"
click n49 "../trip/" "TRIP 项目核心原理与代码阅读指南"