Advancing Spark - Databricks SQL Variables & Dynamic WHERE
Whenever someone comes from a heavy SQL background, they find some of their favourite toys missing from the Spark SQL world - but there have been huge investments from Databricks to catch up here over the past few months. We thought it was time to talk SQL Variables, Parameterised Tables and even the WHERE (*) functionality!
So if you've been sitting in the pyspark wastelands dreaming of the good old days of SQL Variables, this is the video you've been waiting for! In this video, Simon runs through how Spark SQL parameters work, some of the neat tricks you can do using them, and has finally thought of a use case for "any column filtering"!
For more info on Variables in Spark SQL, check out the docs here: https://learn.microsoft.com/en-us/azu...
Watch video Advancing Spark - Databricks SQL Variables & Dynamic WHERE online without registration, duration hours minute second in high quality. This video was added by user Advancing Analytics 01 May 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 4,72 once and liked it 13 people.