Flask website template that includes a spot for blogs, dash applications, and Jupyter notebooks — I wanted to create my own website that would allow me to create a blog, showcase my dashboards, and allow me to run jupyter notebooks. I found out how to create the Dash application itself, but I was unable to find one that describes all three. …

Want consistent, reliable data? Hire more data engineers and implement data observation. I took a deep breath as I had to fix one more report on a Friday afternoon. Again. The sole data engineer at a small start-up, I supported the company and fixed its data problems. We often forget…

Platforms, databases, and languages you will most likely see in the future according to data developers Introduction Stack Overflow is an awesome developer community. There is no denying it. And the best part is that that we all use it one way or another. I was able to find some of…

Make your data pipeline orchestration future-proof with Prefect. — I just started a new position at a great company and we are re-evaluating our options. To provide some context, we are in Azure and are using Azure Data Factory. We are not too happy with this setup as we do not have extensive historical data and the monitoring has…

A guide on how you can solve your data quality problem using Python. — Bad data quality sucks. It causes our reports to be inaccurate and drives our data scientists and engineers to pull their hair out. But most importantly, it causes the trust between the data providers and consumers to deteriorate. When we finally get around to fixing at least some of the…

Creating cleaner and simpler SQL code — A common table expression (CTE) is a temporary result set that stores intermediate results. They are an incredibly powerful tool that SQL developers can use to solve complex problems and simplify complicated queries. These queries make it possible for developers to work with data more efficiently and effectively. …

Strengthening the data relationship one step at a time Building a relationship is complicated. Wait, what? Why are we talking about relationships in this article? Hang in there with me! How long did it take for you to build up your relationship with your friends? How about trust? It usually…

An alternative data orchestrator to Airflow and Prefect — I was a one-stop-shop in many of my previous positions, so I know how problematic bad data can be. I have seen how it affects the entire business — reports show different results, strategy changes, and customers start to doubt the data and product. Experiencing these changes highlights the importance…

Change one line of code to make your Spark jobs work again — After more than a decade of creating and testing industry-leading chips for the iPhone, iPad, and Apple Watch, Apple introduced the Apple M1 chip for the Macbooks.¹ The M1 chip processors feature “the world’s fastest CPU core in low-power silicon, the world’s best CPU performance per watt, the world’s fastest…