data engineering
4 posts tagged “data engineering”.
dbx workflow
dbx workflow for etl job on data lake
The one habit that saved my weekends — idempotent pipelines
Why a pipeline you can safely re-run is worth more than a clever one, and how to build it.
My first dbt project, and what I'd do differently
Models, tests, and the folder structure I wish I'd started with.
Batch vs. streaming, explained with a real pipeline
When "just make it real-time" actually costs you, and when it pays off.