Notes on data engineering, AI engineering, and building data products — pipelines, models, and the messy bits in between.
Recent posts
dbx workflow
dbx workflow for etl job on data lake
The one habit that saved my weekends — idempotent pipelines
Why a pipeline you can safely re-run is worth more than a clever one, and how to build it.
Shipping an LLM feature that doesn't fall over in prod
Evals, guardrails, and treating prompts like code.
My first dbt project, and what I'd do differently
Models, tests, and the folder structure I wish I'd started with.
Batch vs. streaming, explained with a real pipeline
When "just make it real-time" actually costs you, and when it pays off.