Data governance is a strategy for handling data within an organization. It is a set of rules, policies, standards, practices, etc. whose main purpose is to ensure data has high …

What is AirFlow? Apache Airflow is an open-source workflow management platform for data engineering pipelines. Airflow is written in Python, and workflows are created via Python scripts. Airflow is designed …

Last week, we published a blog post on how to write a Scala UDF for Snowflake. This week? We've taken our talents to Python. We'll take the same function (IS_PALINDROME) …

Whenever you migrate SQL Server IF statements that are found within scalar functions using BlackDiamond Studio, you will soon find out that they require special handling to make them work …

Write a Snowflake UDF in Scala with BlackDiamond Studio Snowflake provides a set of built-in functions which can be used to manipulate your data. (In Snowflake's documentation, you can find …

Code migration always presents unique and interest challenges. As the longtime leaders in migration tooling, we’ve seen a lot of those challenges. When we find one that’s interesting, we like …

Decisions. Whether it's paper or plastic, coffee or tea, gas or electric... there's always another decision waiting around the corner. And if you landed on this page, your next decision …

It's always helpful to get advice from someone who has been where you're trying to go. When Snowflake needed to build automated migration tools for converting SQL, sprocs, and scripts …

Snowpipe is a powerful tool for automating your data loading process. However, it's not always easy to setup all the transformations you may need in the COPY statement. You might …

The ability to pivot has been key to moving couches and manipulating dataframes for more than 30 years. But not all pivots and unpivots are created equal. Let's take a …