- The Finish Slime
- Posts
- Finish Slime #31
Finish Slime #31
Lea a minimal dbt, coalesce 2023, and Airflow
Data Engineering, Analytics. No ML, no AI. The weekly dose of the data content you actually want to read!
Want to share anything with me? Hit me up on Twitter @sbalnojan or LinkedIn.
Great Recent Stuff
Lea is a minimalist alternative to dbt or SQLMesh. If you want to see it in action, look at their ports of the usual Jaffleshop project from dbt.
Dbt Labs unveiled new dbt Cloud tools at Coalesce 2023 to simplify data project management, maintain consistent metrics across multiple tools, and much more.
Working with Airflow locally for 3-4 DAGs is easy; the hard stuff starts when you take it to production for a couple hundred DAGs.
Microsoft Fabric, Azures data analytics solution, is a thing, and central to it is OneLake; read this to understand how these things work and tie together.
The semantic layer still hasn’t crystalized, not in a standardized form. And that’s the whole point. This article is a call for an open standard for just that.
The big picture is simple: Enterprise AI requires iterations upon iterations of transformation. The better question: what steps do you need to take then?
The goal is increasingly to release data into production reliably. Lu makes a good case using concepts from software engineering on how this should be done.