How They dbt

A curated collection of publicly available resources on how data-driven organizations around the world utilize dbt

Introduction

Inspired by howtheytest and howtheysre, How They dbt is a curated knowledge repository of dbt best practices adopted by data-driven organizations around the world.

Many companies regularly come forward and share their best practices and techniques various public platforms like blogs, conferences & other events. These dispersed resources are gathered and curated in this repository.

Topics

• Model organization
• Testing
• Continuous integration & running dbt in production

Organizations & how they use dbt

Dagster

Resources

• Dagster and dbt: Better Together
• dbt Examples
• Identifying model deprecation and optimization candidates + exposure updates: Good Data at Good Eggs: Using Dagster to manage the data platform
• Orchestrating dbt with Dagster (video)

dbt Labs

Resources

• dbt Best practices
• How we structure our dbt projects
• Auditing model layers and modularity with your DAG (Coalesce 2020)
• dbt coding conventions
• Your Essential dbt Project Checklist
• Representing non-SQL models in a dbt DAG
• dbt example projects
• Running dbt in Production
• Enabling CI in dbt Cloud

GitLab

Resources

• GitLab dbt docs
• GitLab Data Team Handbook - dbt Guide

Snaptravel

Resources

• How to structure a data team (Coalesce 2020)

---

Blog posts

• Practical tips to get the best out of Data Build Tool (dbt) — Part 1
• Practical tips to get the best out of Data Build Tool (dbt) — Part 2
• One analyst's guide for going from good to great

---

Ecosystem

dbt packages make up a significant portion of the dbt ecosystem and there's an existing list of packages in the dbt hub. This section focuses on adapters and other tools, such as CLIs and linters, related to dbt development.

dbt adapters

Adapters that are not listed in the list of Fishtown and community supported adapters:

• dbt-athena - AWS Athena adapter

dbt tools

• dbt-helper - A helper tool for dbt development and data warehouse management
• pre-commit-dbt - Pre-commit hooks to ensure the quality of your dbt projects
• dbt-sugar - A tool for measuring test and documentation coverage of your dbt projects
• dbt-container-skeleton - Easily set up a containerized dbt developer environment
• dbt-ipy - Run dbt commands inside a IPython session (Jupyter notebook)
• dbt-profiler - A tool for profiling dbt relations
• dbt-datamocktool - A simple package for unit testing dbt projects
• olivertwist - A dag auditing tool that audits the dbt dag and generates a summary report
• fal - A tool for running Python inside your dbt project

Related tools

• SQLFluff - A SQL linter and auto-formatter
• dtspec - Run unit-test style tests for data transformations, includes dbt-specific CLI

Other curated dbt collections

There are plenty of other dbt collections out there. Here's a few:

• awesome-dbt - A curated list of awesome dbt resources
• dbt-tips - A collection of dbt Tips and Tricks

Contributors

Contribution

Contributions welcome! Read the contribution guidelines first.