Falling Leftwards
-
A tech blog written by a former Statistician turned Data platform engineer
Categories/filters
Blog
AWS Conformed to Enriched confusion
Exploring the AWS modern data architecture, we uncover differing views on the relationship between conformed and enriched data states. This article examines the potential confusion caused by mixed terminologies and offers clarity on how these concepts interact within distributed and centralized models.
Comparative analysis of Data state architectures
Curious about how today’s top data architectures compare to each other? This article breaks down the leading data state architectures—including Data Lake, Medallion, and AWS Modern Data Architecture—highlighting how each organizes and optimizes data for modern needs. I look at the similarities and differences of them all and try to understand what makes them distinct.
The Case for the Data Development enviroment
Often when discussing the different kinds of enviroment for development; dev, test, and prod. I often end up in the same discussion around why data developers cannot use the regular Dev enviroment as the application developers. Here is my answer to that question
The Zoo and their new price animal
A fairytale of what happens when people from different worlds meet to discuss requirements for a new endeavour. When uncertainty and hubris mix with pride and the fear of appearing stupid.
Buy vs. Build: Navigating Architectural Decisions
As I explore the Buy vs. Build dilemma, I dissect metrics like risk, skills, and cost. Emphasizing the pivotal role of upskilling, I see it as a leading indicator for successful system changes, challenging traditional perspectives.
Why the Germans Do it Better (Review)
A political commentary on a tech blog, why? Find out why I think that this book deserves to be read by anyone involved in software or data moderation.
All the enterprise customers
A musing on the nature of the enterprise endorsements on software vendor websites, and the incentives behind them
Middle-child MAD company
Where are the articles and tutorials for the Modern data stack at scale? In this post, I muse on the challenges of finding good resources on how to build a data platform for its scaling period
Mapped Data
A Conversation about presenting data on a map, led to a ramble on why maps make such a difference to data visualisation and the weakness of presenting data on them.
The Mythical man-month (Review)
The Mythical Man-Month is a book that has held dominance in the software idea space for 50 years. Why is this book so important and so controversial at the same time? This is my review of the book and why I think it holds (and deserves) its place in history.
Data tool investment inertia
Ben Stencils a prominent name in the modern data stack discourse commented on the lack of investment in data tools, as a comment on the state of the MAD landscape. Here I share my thoughts after reading the post and providing my viewpoint on the question.
Modern Software Engineering (review)
Modern Software Engineering is a book on how the rigours and discipline of engineering applied to software development can supercharge your skills. This is my review of the book after reading it as a Data Engineer researching how to improve Date engineering practices.
Work about Work Stagnation
Most teams and project experience a level of stagnation in their progress. Often what they turn to is work about work to alleviate the feeling of not getting enough done. Here are my thoughts on why that happens, and what to look for when that happens.
Data Engineering Fundamentals (review)
This is my review of the book fundamentals of data engineering. I have read it as a person who has been through the same journey as the authors. and now find myself talking with new colleagues embarking on the data engineer path
Rule of thumb for AI usage
My Hot-take on a Rule of thumb for when to use AI and when it might be a better Idea to hold of on using AI
Kill it with fire (review)
Kill it with fire is a book about dealing with modernizing software systems that have been left to the tooth of times, and prepare what you build for the future. This post is a review of the book after reading it, as another engineer that tends to deal with modernising systems.