Exciting Snowflake Updates in February: Enhancements for Data Pros
Written on
Chapter 1: Introduction to New Features
In February, Snowflake unveiled several noteworthy features that are set to benefit data engineers and scientists alike. Below, we explore three key updates that stand out.
Section 1.1: Enhanced Access History Tracking
One significant enhancement is the introduction of Access History that incorporates Track Masking and Row Access Policy References. Snowflake now tracks the enforcement of masking and row access policies for queries on tables or views protected by these policies. This information is accessible through the Account Usage ACCESS_HISTORY view.
The newly added column, POLICIES_REFERENCED, provides support for intermediate objects and columns that are protected by policies. This feature is instrumental in bolstering security and addressing data governance challenges.
Section 1.2: Error Notifications for Snowpipe and Tasks
Another useful update involves error notifications for Snowpipe and Tasks. These tools facilitate modern data integration, utilizing both ETL and ELT methodologies.
Now, when errors occur, Snowpipe and Snowflake Tasks can send notifications to cloud messaging services. For instance, Snowpipe notifications specify the errors found in each file during the loading process, enabling deeper analysis. Similarly, task notifications outline errors encountered during task execution or in dependent tasks.
This upgrade significantly aids data engineers in monitoring and ensuring the smooth operation of data streams, as it helps quickly identify and address issues. Previously, this functionality was exclusive to AWS, but it is now accessible to users on Google Cloud and Microsoft Azure as well.
Section 1.3: Introduction to Snowflake Alerts
Lastly, the introduction of Snowflake Alerts allows users to create schema-level objects that trigger notifications or actions based on specific data conditions. Examples include:
- Notifications if credit usage exceeds a defined percentage of the current quota.
- Alerts when resources required for pipelines, tasks, or materialized views exceed certain thresholds.
- Notifications for unauthorized data access requests.
- Alerts for data that fails to adhere to established business rules.
Chapter 2: Summary of Key Features
Overall, these updates from Snowflake are not only intriguing but also highly practical. They significantly enhance data integration and transformation capabilities while improving security across the platform.
The first video titled "Inundated with clouds. A snowflake has fallen. Big Bear is bracing February 21, 2023. Stay safe." explores the impact of recent weather conditions and offers safety advice.
The second video, "Snowflake Product Updates Sep 2022 - Jan 2023 | BUMPER Edition Round-up," provides a comprehensive overview of the latest product updates in Snowflake.