Building trustworthy data pipelines because AI cannot learn from dirty data
Data engineers are data librarians or how to upgrade your data lake to 2500 BCE technology.
What can data engineers learn from (ancient) librarians?
11 Mar 2022
The problem with software testing in data engineering
What if we found a bug in our data pipelines? What if that bug were easy to fix, but it would require a lot of...
15 Jun 2020
Data flow - what functional programming and Unix philosophy can teach us about data streaming
What does stream processing have in common with functional programming and Unix?
04 May 2020
Four books to boost your programmer career
I quit my dream job because of a book
06 Jan 2020
How to write technical documentation
How to document a software project?
20 Jun 2022
ETL vs ELT - what's the difference? Which one should you choose?
Should you use a data warehouse or build a data lake? When is a data warehouse a better choice? When is it better to build a data lake?
10 Jun 2022
Selecting rows in Pandas
How to use loc, iloc, slice, and row filtering in Pandas
27 May 2022
Python decorators explained
How can we define a Python decorator, and when should we use Python decorators.
25 May 2022
What is shuffling in Apache Spark, and when does it happen?
When does an Apache Spark cluster perform the shuffle operation?
20 May 2022
What is the root cause of problems in software engineering?
What is the primary, unrepairable cause of almost all bugs, data leaks, human problems, etc.?
13 May 2022
How to become a better programmer
What's stopping us from getting better at coding
06 May 2022
How to teach programming workshops to adults
How to prepare an enjoyable programming workshop that teaches people the skills they need without overwhelming them with new knowledge.
15 Apr 2022
How does a bad interview look like in data engineering
What you should avoid when you interview programmers for a data engineer positition
08 Apr 2022
How to throw useful exceptions
How to make debugging easier by paying attention to the errors you report
01 Apr 2022
Why are programmers slow, and what to do about it?
The one practice that makes every team faster (in the long run)
25 Mar 2022
How to advertise to software engineers, or how do we make terrible tech choices
Why do programmers make wrong decisions when they choose the tools they use?
18 Mar 2022