Migrate Spark Scala to Snowflake with SnowConvert

• Tables and views (DDL and DML) are migrated to Snowflake SQL
• Procedures, functions, and other T-SQL are migrated to your choice of:
  • JavaScript embedded in Snowflake SQL
  • Snowflake Scripting

SnowConvert for Spark Scala is delivered as a part of BlackDiamond Studio. You can learn more about accessing SnowConvert, and see how it runs inside of BlackDiamond Studio by visiting our BlackDiamond Studio page.

To learn more about SnowConvert, you can visit our webpage on SnowConvert or fill out the form above to get started with the tool. 

Migration Plus Assessment

The first step in any successful migration is getting a plan in place, but the next step would be to get an assessment of the current platform. While SnowConvert for Spark-Scala automates the code migration, it's also a code understanding tool. SnowConvert builds an abstract syntax tree and a complete symbol table that together create a semantic model of the source when you point it at any source codebase to perform the conversion. Out of those two artifacts, SnowConvert can provide you a level of detail on the code that is present that you can only get with Mobilize.Net.

Here's a quick look at the kind of assessment information that is provided:

• Complete Assessment Report: This report gives you a summary of the Spark Scala functions found in your code, an estimate of the level of conversion you can expect for that code, and a summary of the estimated issues, warnings, and errors identified by the conversion process. This summary gives you a view into the level of work remaining to complete a migration after the automated code conversion. 
  
  
  
  
• Migration Readiness Assessment: As well as the conversion summary, the tool also generates a migration readiness report that lets you know not only the level of automated conversion you can expect, but an honest report letting you know if Snowpark is a better option for you than Spark. Some workloads may be utilizing features in Spark that are not yet ready in Snowpark. SnowConvert will tell you if your workload is a prime candidate not just for migration, but for running using the Snowpark API.
  
  
• Errors, Warnings, and Issues Inventory: No migration can be 100% automated. There are always corner cases. Luckily for you, our assessment tool will report all of the pieces of code that could not be converted. The tool will give you a description on why it could not be converted, a severity/effort level for each error, and the exact location in the source code of the code segment that could not be converted.
  
  

This assessment is specifically designed to give you all the information you need to understand the migration ahead of you, get a sense of how much can be automatically converted using SnowConvert for Spark-Scala, and give you an idea of how ready your workload is to run in Snowpark. 

Additional Resources 

Once you fill out the form above, you will receive an email from Mobilize.Net Studio with information on how to get started using Mobilize.Net SnowConvert for Spark-Scala. The email will also contain more instructions on how to use the tool, but you can always learn more about installation and setup as well as some valuable troubleshooting tips on our documentation page. 

Types of migrations

• Spark Scala (*.scala) to Snowpark Scala (*.scala):
  • Scala functions in Spark (org.apache.spark.sql) are converted to a Scala equivalent in Snowflake supported by the Snowpark API (com.snowflake.snowpark)
  • Spark SQL functions converted to UDF's in Snowflake SQL as either:
    
    • JavaScript embedded in Snowflake SQL
    • Snowflake Scripting