All Course Slides

Snowflake MasterClass
What will you learn?

Getting Started Load from AWS Table Types Streams
Architecture Load from Azure Zero-Copy Cloning Materialized views
Loading Data Load from GCP Data Sharing Data Masking
Copy Options Snowpipe Data Sampling Access Management
Unstructured Data Time Travel Scheduling Tasks Partner Connect
Performance Fail Safe Visualizations Best practices

Contents
Getting Started 4 Loading Data 44 Data Sampling 117
Snowflake Architecture 7 Performance Optimization 60 Tasks & Streams 124
Multi-Clustering 11 Snowpipe 88 Materialized Views 142
Data Warehousing 17 Fail Safe and Time Travel 92 Data Masking 155
Cloud Computing 26 Table Types 97 Access Control 159
Snowflake Editions 31 Zero Copy Cloning 101 Snowflake & Other 182
Tools
Snowflake Pricing 34 Swapping 104 Best Practices 186
Snowflake Roles 41 Data Sharing 109

Getting Started
How you can get the
most out of this course?
Make use of the

Own pace
udemy tools
Resources, quizzes &

Practice
assignements
Ask questions Help others
Enjoy learning!
Best practices
✓ Pay only for what you use
Make use of the

Own pace
udemy tools
Resources, quizzes &

Practice
assignements
Ask questions Help others
Enjoy learning!
Snowflake Architecture
CLOUD SERVICES
Virtual Virtual Virtual

Warehouse Warehouse Warehouse
QUERY PROCESSING
STORAGE
- Brain of the system -
Managing infrastructure, Access control, security,
Optimizier, Metadata etc.
- Muscle of the system -

Performs MMP (Massive Parallel Processing)
- Hybrid Columnar Storage -

Saved in blobs
Virtual Warehouse Sizes
XS 1 L 8
S 2
XL 16
M 4
4XL 128
Multi-Clustering
Multi-Clustering
… More queries …
S
S
Multi-Clustering
… More queries …
S
> Auto-Scaling
S
Multi-Clustering
Queue
Auto-Scaling: When to start an additional cluster?

Scaling policy
Standard Economy
Favors starting Favors conserving
additional credits rather than
warehouses starting additional
warehouses
Scaling policy
Policy Description Cluster Starts… Cluster Shuts Down…
Immediately when either a query After 2 to 3 consecutive

Prevents/minimizes queuing by is queued or the system detects successful checks
(performed at 1 minute intervals),
Standard (default) favoring starting additional that there are more queries than
which determine whether the load on
clusters over conserving credits. can be executed by the currently the least-loaded cluster could be
available clusters. redistributed to the other clusters
Conserves credits by favoring

keeping running clusters fully-
loaded rather than starting Only if the system estimates
additional clusters, there’s enough query load to keep After 5 to 6 consecutive
Economy the cluster busy for at least 6 successful checks …
Result: May result in queries minutes.
being queued and taking longer
to complete.
Data Warehousing
What is a data warehouse?
Skip the lecture if you are already familiar

with data warehouses
What is the purpose of a data warehouse?

= Database that is used for reporting and

data analysis
Different layers
HR data
Staging Data Production

sales data
area Transformation
HR data
ETL
sales data
data warehouse
ETL = Extract, Transform & Load
Different layers
Reporting
Data Science
Raw Data
Access layer
data integration
Data scources Other Apps

Different layers
Staging Data
area Transformation
Cloud Computing
Cloud Computing
Why Cloud Computing?

Cloud Computing
MANAGED
• Infrastucture
• Security
• Electricity
Data Center • Software/Hardware upgrades
Software-as-a-Service
Cloud Computing
Application Databases, tables etc.
Software
Snowflake
Data Managing data storage,
Virtual warehouses,
Software-as-a-service Upgrades/Metadata etc.
Operating System
Physical servers
Virtual machines Cloud provider

AWS, Azure, GCP
Physical storage
Cloud Computing
Customer
Application
Creating tables etc.
Software
Snowflake
Data Managing data storage,
Virtual warehouses,
Software-as-a-service Upgrades/Metadata etc.
Operating System
Physical servers
Virtual machines Cloud provider

AWS, Azure, GCP
Physical storage
Snowflake Editions
Snowflake Editions
Enterprise
additional features
for the needs of
large-scale
Standard enterprises Business
introductory level Critical
even higher levels of data
protection for
organizations with
extremely
sensitive data
Virtual Private
highest level of
security
Snowflake Editions
Standard Enterprise Business Virtual Private

Critical
✓ Complete DWH ✓ All Standard features ✓ All Enterprise features ✓ All Business Ciritcal
✓ Automatic data ✓ Multi-cluster warehouse ✓ Additional security features
encryption Time travel up to 90 features such as Data
✓ ✓ Dedicated virtual
✓ Time travel up to 1 day
days encryption everywhere servers and completely
✓ Disaster recovery for 7
✓ Materialized views ✓ Extended support seperate Snowflake
days beyond time travel
✓ Search Optimization ✓ Database failover and environment
✓ Secure data share
✓ Column-level security disaster recovery
✓ Premier support 24/7
Snowflake Pricing
Snowflake Pricing
Compute Storage
✓ Charged for active warehouses per hour ✓ Monthly storage fees

✓ Depending on the size of the warehouse ✓ Based on average storage used per month
✓ Billed by second (minimum of 1min) ✓ Cost calculated after compression
✓ Charged in Snowflake credits ✓ Cloud Providers
Snowflake Pricing
Compute Storage
$/€ Credits
Consumed
Snowflake Pricing

Critical
✓ $2.70 / Credit ✓ $4 / Credit ✓ $5.40 / Credit ✓ Contact Snowflake
Region: EU (Frankfurt)
Platform: AWS
Virtual Warehouse Sizes
XS 1 L 8
S 2
XL 16
M 4
4XL 128
Snowflake Pricing
On Demand Capacity
Storage ✓ We think we need 1 TB of storage Storage
❖ Scenario 1: 100GB of storage used ❖ Scenario 1: 100GB of storage used

0.1 TB x $40 = $4 1 TB x $23 = $23
❖ Scenario 2: 800GB of storage used ❖ Scenario 2: 800GB of storage used

0.8 TB x $40 = $32 0.8 TB x $40 = $23
Region: US East (Northern Virginia)

Platform: AWS
Snowflake Pricing
On Demand Capacity
Storage Storage
✓ Start with On Demand

✓ Once you are sure about your usage use
Capacity storage
Snowflake Roles
Snowflake Roles
ACCOUNTADMIN
SECURITYADMIN SYSADMIN
USERADMIN Custom Role 1 Custom Role 2
Custom Role 3
PUBLIC
Snowflake Roles
ACCOUNTADMIN SECURITYADMIN SYSADMIN USERADMIN PUBLIC
✓ SYSADMIN and ✓ USERADMIN role is ✓ Create warehouses ✓ Dedicated to user ✓ Automatically

SECURITYADMIN granted to and databases (and and role granted to every
✓ top-level role in the SECURITYADMIN more objects) management only user
system ✓ Can manage users ✓ Recommended that ✓ Can create users and ✓ Can create own
✓ should be granted only and roles all custom roles are roles objects like every
to a limited number of ✓ Can manage any assigned other role (available
users object grant globally to every other
user/role
Loading Data
Loading Data
BULK CONTINUOUS
LOADING LOADING
✓ Most frequent method ✓ Designed to load small volumes of data

✓ Uses warehouses ✓ Automatically once they are added to stages
✓ Loading from stages ✓ Lates results for analysis
✓ COPY command ✓ Snowpipe (Serverless feature)
✓ Transformations possible
Understanding Stages
✓ Not to be confused with dataware house
✓ stages
Location of data files where data can be loaded from
External Internal
Stage Stage
Understanding Stages
External Internal
Stage Stage
✓ External cloud provider ✓ Local storage maintained

▪ S3 by Snowflake
▪ Google Cloud Plattform
▪ Microsoft Azure
✓ Database object created in Schema

✓ CREATE STAGE (URL, access settings)
Note: Additional costs may apply
if region/platform differs
Copy Options
COPY INTO <table_name>

FROM externalStage
FILES = ( '<file_name>' ,'<file_name2>')
FILE_FORMAT = <file_format_name>
copyOptions
Copy Options

FROM externalStage
ON_ERROR = CONTINUE
Copy Options

FROM externalStage
VALIDATION_MODE = RETURN_n_ROWS | RETURN_ERRORS
✓ Validate the data files instead of loading them

Copy Options

FROM externalStage
VALIDATION_MODE = RETURN_n_ROWS | RETURN_ERRORS
RETURN_n_ROWS (e.g. RETURN_10_ROWS) Validates & returns the specified number of rows;
fails at the first error encountered
RETURN_ERRORS Returns all errors in Copy Command
✓ Validate the data files instead of loading them

Copy Options

FROM externalStage
SIZE_LIMIT = num
✓ Specify maximum size (in bytes) of data loaded in that command (at least one file)
✓ When the threshold is exceeded, the COPY operation stops

loading
Copy Options

FROM externalStage
RETURN_FAILED_ONLY = TRUE | FALSE
✓ Specifies whether to return only files that have failed to load in the statement result
✓ DEFAULT = FALSE
Copy Options

FROM externalStage
TRUNCATECOLUMNS = TRUE | FALSE
✓ Specifies whether to truncate text strings that exceed the target column length
Copy Options

FROM externalStage
FORCE = TRUE | FALSE
✓ Specifies to load all files, regardless of whether they’ve been loaded previously and
have not changed since they were loaded
✓ Note that this option reloads files, potentially

duplicating data in a table
Copy Options

FROM externalStage
TRUNCATECOLUMNS = TRUE | FALSE
✓ Specifies whether to truncate text strings that exceed the target column length
✓ TRUE = strings are automatically truncated to the target column length
✓ FALSE = COPY produces an error if a loaded string exceeds the target column length
✓ DEFAULT = FALSE
Copy Options

FROM externalStage
SIZE_LIMIT = num
✓ Specify maximum size (in bytes) of data loaded in that command (at least one file)
✓ When the threshold is exceeded, the COPY operation stops

loading
✓ Threshold for each file
✓ DEFAULT: null (no size limit)

Copy Options
FROM externalStage
PURGE = TRUE | FALSE
✓ specifies whether to remove the data files from the stage

automatically after the data is loaded successfully
✓ DEFAULT: FALSE
Load unstructured data
Create Stage
Load raw data Type VARIANT
Analyse & Parse
Flatten & Load

Performance Optimization
✓ Add indexes, primary keys

✓ Create table partitions
✓ Analyze the query execution table plan
✓ Remove unnecessary full table scans
✓ Add indexes, primary keys

✓ Create table partitions
✓ Analyze the query execution table plan
✓ Remove unnecessary full table scans
How does it work in Snowflake?
✓ Automatically managed micro-

partitions
What is our job?
✓ Assigning appropriate data types

✓ Sizing virtual warehouses
✓ Cluster keys
Performance aspects
Dedicated virtual Scaling
warehouses Up
✓ Separated according to different workloads ✓ For known patterns of high work load
Scaling Maximize
Out Cache Usage
✓ Dynamically fo unknown patterns of work load ✓ Automatic caching can be maximized
Cluster ✓ For large tables

Keys
Dedicated virtual warehouse
Database administrators
Data scources
Reporting
BI
ETL/ELT
Marketing
Data Science
Dedicated virtual warehouse
Identify &
Classify
✓ Identify & Classify groups of workload/users

✓ BI Team, Data Science Team, Marketing department
Create dedicated
virtual
warehouses
✓ For every class of workload & assign users
Considerations
Not too many

VW
✓ Avoid underutilization
Refine
classifications
✓ Work patterns can change

Considerations
✓ If you use at least Entripse Edition all warehouses should be Multi-Cluster
✓ Minimum: Default should be 1

✓ Maximum: Can be very high
Let's practice!
ETL/ELT
Data scources
Scaling Up/Down
✓ Changing the size of the virtual warehouse
depending on different work loads in different periods
✓ ETL at certain times (for example between 4pm and 8pm)

Use cases
✓ Special business event with more work load
✓ NOTE: Common scenario is increased query complexity

NOT more users (then Scaling out would be better)
Scaling Out
Scaling Up Scaling Out

Increasing the size of virtual Using addition warehouses/ Multi-
warehouses Cluster warehouses
More complex query More concurrent users/queries
Scaling Out
✓ Handling performance related to large numbers of concurrent users
✓ Automation the process if you have fluctuating number of users

Caching
✓ Automatical process to speed up the queries
✓ If query is executed twice, results are cached and can be re-used
✓ Results are cached for 24 hours or until underlaying data has changed
What can we do?
✓ Ensure that similar queries go on the same warehouse
✓ Example: Team of Data Scientists run similar queries, so they should all use
the same warehouse
Clustering in Snowflake
✓ Snowflake automatically maintains these cluster keys
✓ In general Snowflake produces well-clustered tables
✓ Cluster keys are not always ideal and can change over time
✓ Manually customize these cluster keys

What is a cluster key?
✓ Subset of rows to locate the data in micro-partions
✓ For large tables this improves the scan efficiency in our queries
Event Date Event ID Customers City
2021-03-12 134584 … …
2021-12-04 134586 … …
2021-11-04 134588 … …
2021-04-05 134589 … …
2021-06-07 134594 … …
2021-07-03 134597 … …
2021-03-04 134598 … …
2021-08-03 134599 … …
2021-08-04 134601 … …
Event Date Event ID Customers City Event Date Event ID Customers City
2021-03-12 134584 … … 2021-03-12 134584 … …
1
2021-12-04 134586 … … 2021-12-04 134586 … …
2021-11-04 134588 … … 2021-11-04 134588 … …
2021-04-05 134589 … … 2021-04-05 134589 … …
2
2021-06-07 134594 … … 2021-06-07 134594 … …
2021-07-03 134597 … … 2021-07-03 134597 … …
2021-03-04 134598 … … 2021-03-04 134598 … …
2021-08-03
2021-08-04
134599
134601
…
…
…
…
2021-08-03
2021-08-04
134599
134601
…
…
…
…
3
2021-03-12 134584 … …
2021-12-04 134586 … …
2021-11-04 134588 … …
SELECT COUNT(*)
2021-04-05 134589 … … WHERE Event_Date > '2021-07-01'
2021-06-07 134594 … … AND Event_Date < '2021-08-01 '
2021-07-03 134597 … …
2021-03-04 134598 … …
2021-08-03 134599 … …
2021-08-04 134601 … …
2021-03-12 134584 … …
2021-12-04 134586 … …
2021-11-04 134588 … …
SELECT COUNT(*)
2021-04-05 134589 … … WHERE Event_Date > '2021-07-01'
2021-06-07 134594 … … AND Event_Date < '2021-08-01'
2021-07-03 134597 … … All partitions need to be scanned!
2021-03-04 134598 … …
2021-08-03 134599 … …
2021-08-04 134601 … …
Event Date Event ID Customers City Event Date Event ID Customers City
2021-03-12 134584 … … 2021-03-12

2021-03-04 134584
134598 … …
1
2021-12-04 134586 … … 2021-12-04
2021-03-12 134586
134584 … …
2021-11-04 134588 … … 2021-11-04

2021-04-05 134588
134589 … …
2021-04-05 134589 … … 2021-04-05

2021-06-07 134589
134594 … …
2
2021-06-07 134594 … … 2021-06-07
2021-07-03 134594
134597 … …
2021-07-03 134597 … … 2021-07-03

2021-08-03 134597
134599 … …
2021-03-04 134598 … … 2021-03-04

2021-08-04 134598
134601 … …
2021-08-03
2021-08-04
134599
134601
…
…
…
…
2021-08-03
2021-11-04
2021-08-04
2021-12-04
134599
134588
134601
134586
…
…
…
…
3
When to cluster?
✓ Clustering is not for all tables
✓ Mainly very large tables of multiple terabytes can benefit

How to cluster?
✓ Columns that are used most frequently in WHERE-clauses

(often date columns for event tables)
✓ If you typically use filters on two columns then the table can also benefit
from two cluster keys
✓ Column that is frequently used in Joins
✓ Large enough number of distinct values to enable effective grouping

Small enough number of distinct values to allow effective grouping
CREATE TABLE <name> ... CLUSTER BY ( <column1> [ , <column2> ... ] )
CREATE TABLE <name> ... CLUSTER BY ( <expression> )
ALTER TABLE <name> CLUSTER BY ( <expr1> [ , <expr2> ... ] )
ALTER TABLE <name> DROP CLUSTERING KEY

✓ Columns that are used most frequently in WHERE-clauses

(often date columns for event tables)
✓ If you typically use filters on two columns then the table can also benefit
from two cluster keys
✓ Column that is frequently used in Joins
✓ Large enough number of distinct values to enable effective grouping

Small enough number of distinct values to allow effective grouping
Snowpipe
What is Snowpipe?
✓ Enables loading once a file appears in a bucket

✓ If data needs to be available immediately for analysis
✓ Snowpipe uses serverless features instead of
warehouses
Snowpipe
S3 notification Serverless
Load
COPY
S3 bucket
Snowflake DB
Setting up Snowpipe
Create Stage ✓ To have the connection
Test COPY COMMAND ✓ To make sure it works
Create Pipe ✓ Create pipe as object with COPY COMMAND
S3 Notification ✓ To trigger snowpipe

Fail Safe and Time Travel
Time Travel

Critical
✓ Time travel up to 1 day ✓ Time travel up to 90 ✓ Time travel up to 90 ✓ Time travel up to 90

days days days
RETENTION
PERIODE
DEFAULT = 1
Fail Safe
✓ Protection of historical data in case of

disaster
✓ Non-configurable 7-day period for permanent
tables
✓ Period starts immediately after Time Travel period
ends
✓ No user interaction & recoverable only by
Snowflake
✓ Contributes to storage cost
Fail Safe
✓ Access and query data etc.
Current
Data Storage
Continuous Data Protection Lifecycle
✓ No user
✓ Recovery beyond Time Travel
operations/queries ✓ SELECT … AT | BEFORE
✓ Access and query data etc.
✓ Restoring only by snowflake support UNDROP
etc.
Fail Safe Current

(transient: 0 days Time Travel Data Storage
permanent: 7 days) (1 – 90 days)
Table Types
Table types
Only for data that does not Non-permanent
Permanent data
need to be protected data
Until dropped Until dropped Only in session
Permanent Transient Temporary
CREATE TABLE CREATE TRANSIENT TABLE CREATE TEMPORARY TABLE
✓ Time Travel Retention Period ✓ Time Travel Retention Period ✓ Time Travel Retention Period
0 – 90 days 0 – 1 day 0 – 1 day
✓ Fail Safe × Fail Safe × Fail Safe

Table types
Only for data that does not Non-permanent
Permanent data
need to be protected data
Until dropped Until dropped Only in session
Permanent Transient Temporary

Managing Storage Cost
CREATE TRANSIENT TABLE
CREATE TABLE CREATE TEMPORARY TABLE
✓ Time Travel Retention Period ✓ Time Travel Retention Period ✓ Time Travel Retention Period
0 – 90 days 0 – 1 day 0 – 1 day
✓ Fail Safe × Fail Safe × Fail Safe

Table types notes
✓ Types are also available for other
database objects (database, schema
etc.)
✓ For temporary table no naming conflicts
with permanent/transient tables!
Other tables will be effectively hidden!

Zero Copy Cloning
Zero-Copy Cloning
✓ Create copies of a database, a schema or a

table
✓ Cloned object is independent from original

table
✓ Easy to copy all meta data & improved storage
management
✓ Creating backups for development purposes
✓ Works with time travel also

Zero-Copy Cloning
CREATE TABLE <table_name> ...

CLONE <source_table_name>
BEFORE ( TIMESTAMP => <timestamp> )
Swapping
Swapping Tables
✓ Use-case: Development table into production
table
Development Production
Swap
Meta data Meta data
Swapping
ALTER TABLE <table_name> ...

SWAP WITH <target_table_name>
Swapping
ALTER SCHEMA <schema_name> ...

SWAP WITH <target_schema_name>
Swaping Tables
✓ Create copies of a database, a schema or a

table
Original
Copy
Meta data operation

Data Sharing
Data Sharing
✓ Usually this can be also a rather complicated

process
✓ Data sharing without actual copy of the data &
uptodate
✓ Shared data can be consumed by the own compute

resources
✓ Non-Snowflake-Users can also access through a

reader account
Data Sharing
Account 1
Producer
Account 2
Consumer
Read-only
Data Sharing
Account 1
Account 2
Compute Resources Account 2
Read-only
Data Sharing
Account 1
Own Compute
Resources
Reader Account
Data Sharing
Own Compute Account 1

Resources
Reader Account
Data Sharing with
Non Snowflake Users

Resources
Reader Account
Sharing with
Non Snowflake users
New Reader ✓ Indepentant instance with
Account own url & own compute resources
Share data ✓ Share database & table
Create Users ✓ As administrator create user & roles
Create database ✓ In reader account create database from share

Data Sampling
Data Sampling
Why Sampling? 10 TB
SAMPLE
500 GB
Data Sampling
Why Sampling?
- Use-cases: Query development, data analysis etc.
- Faster & more cost efficient (less compute resources)

Data Sampling
Why Sampling? 10 TB
SAMPLE
500 GB
Data Sampling Methods
ROW or BERNOULLI method
BLOCK or SYSTEM method

Data Sampling Methods
ROW or BERNOULLI method BLOCK or SYSTEM method
Every row is chosen with percentage p Every block is chosen with percentage p
More "randomness" More effective processing
Smaller tables Larger tables

Data Sampling

Resources
Reader Account
Tasks & Streams
Scheduling Tasks
✓ Tasks can be used to schedule SQL statements
✓ Standalone tasks and trees of tasks
Understand Create tasks Schedule tasks

tasks
Tree of tasks Check task

history
Tree of Tasks
Root task
✓ Every task has one parent
Task A Task B
Task C Task D Task E Task F

Tree of Tasks
CREATE TASK ...

AFTER <parent task>
AS …
ALTER TASK ...

ADD AFTER <parent task>
Streams
Table
Stream object
Streams
Table
Stream object
DELETE
INSERT
UPDATE
Streams
Table
Stream object
Streams
Table
Stream object
METADATA$ACTION
METADATA$UPDATE
METADATA$ROW_ID
Streams
CREATE STREAM <stream name>

ON TABLE <table name>
SELECT * FROM <stream name>

Streams
Table
Stream object
INSERT
Streams
ETL
Data scources
Streams
Reporting
Data Science
Raw Data
Access layer
data integration

Streams
Reporting
Data Science
Raw Data
Access layer
data integration

Streams
Reporting
Data Science
Raw Data
Access layer
data integration

Streams
Reporting
Data Science
Raw Data
Access layer
data integration

Streams
Object that records (DML-)changes made
to a table Reporting
This process is called change data capture

(CDC)
Data Science
Raw Data
Access layer
data integration

Types of streams
STANDARD APPEND-ONLY
✓ INSERT ✓ INSERT
✓ UPDATE
✓ DELETE
Syntax
CREATE STREAM <stream name>

ON TABLE <table name>
APPEND_ONLY = TRUE
Materialized Views
Materialized views
✓ We have a view that is queried frequently

and that a long time to be processed
× Bad user experience
× More compute consumption

Materialized views
✓ We have a view that is queried frequently

and that a long time to be processed
✓ We can create a materialized view to solve

that problem
What is a materialized view?
✓ Use any SELECT-statement to create this MV
✓ Results will be stored in a seperate table

and this will be updated automatically
based on the base table
When to use MV?
✓ Benefits
✓ Maintenance costs
When to use MV?
✓ View would take a long time to be processed

and is used frequently
✓ Underlaying data is change not frequently

and on a rather irregular basis
When to use MV?
If the data is updated on a very regular basis…
✓ Using tasks & streams could be a better alternative

Alternative – streams & tasks
Stream object
VIEW / TABLE
Underlaying Table
TASK with MERGE

When to use MV?
✓ Don't use materialized view if data changes are very

frequent
✓ Keep maintenance cost in mind
✓ Considder leveraging tasks (& streams) instead

Limitations
Only available for Enterprise edition

Limitations
× Joins (including self-joins) are not supported
× Limited amount of aggregation functions

Limitations
APPROX_COUNT_DISTINCT (HLL).
AVG (except when used in PIVOT).
BITAND_AGG.
BITOR_AGG.
BITXOR_AGG.
COUNT.
MIN.
MAX.
STDDEV.
STDDEV_POP.
STDDEV_SAMP.
SUM.
VARIANCE (VARIANCE_SAMP, VAR_SAMP).
VARIANCE_POP (VAR_POP).
Limitations
× UDFs
× HAVING clauses.
× ORDER BY clause.
× LIMIT clause
Data Masking
Data Masking
Data Masking
Data Masking
Column-level Security
Access Control
Access Control
✓ Who can access and perform operations

on objects in Snowflake
✓ Two aspects of access control combined

Access Control
Discretionary Role-based
Access Control Access Control
(DAC) (RBAC)
✓ Each object has an owner who can ✓ Access privileges are assigned to
grant access to that object roles, which are in turn assigned
to users
Access Control
GRANT <role>
TO <user>
User 1
Creates
Role 1 Table Role 2
Owns User 2
Privilege
Role 3
GRANT <privilege> User 3
ON <obeject>
TO <role>
Securable objects
Account
Other Account
User Role Database Warehouse objects
Schema
Other Schema
Table View Stage Integration objects
Access Control
✓ Every object owned by a single role (multiple users)
✓ Owner (role) has all privileges per default

Key concepts
USER ✓ People or systems
✓ Entity to which privileges are granted

ROLE
(role hierarchy)
✓ Level of access to an object

PRIVILEGE
(SELECT, DROP, CREATE etc.)
✓ Objects to which privileges can be

SECURABLE OBJECT
granted
(Database, Table, Warehouse etc.)
Snowflake Roles
ACCOUNTADMIN
USERADMIN
PUBLIC
Snowflake Roles
ACCOUNTADMIN
USERADMIN Custom Role 1 Custom Role 2
Custom Role 3
PUBLIC
Snowflake Roles
ACCOUNTADMIN SECURITYADMIN SYSADMIN USERADMIN PUBLIC
✓ SYSADMIN and ✓ USERADMIN role is ✓ Create warehouses ✓ Dedicated to user ✓ Automatically

SECURITYADMIN granted to and databases (and and role granted to every
✓ top-level role in the SECURITYADMIN more objects) management only user
system ✓ Can manage users ✓ Recommended that ✓ Can create users and ✓ Can create own
✓ should be granted only and roles all custom roles are roles objects like every
to a limited number of ✓ Can manage any assigned other role (available
users object grant globally to every other
user/role
ACCOUNTADMIN
ACCOUNTADMIN
USERADMIN
PUBLIC
ACCOUNTADMIN
Top-Level-Role
✓ Manage & view all objects

Best practises
✓ All configurations on account level ✓ Very controlled assignment strongly recommended!
✓ Account operations
✓ Multi-factor authentification
(create reader account, billing
At least two users should be assigned to that role
✓ First etc.)
✓
user will have this role assigned
✓ Avoid creating objects with that role unless you have
✓ Initial setup & managing account level to
objects
ACCOUNTADMIN
ACCOUNTADMIN
✓ Account admin tab
✓ Billing & Usage
✓ Reader Account
✓ Multi-Factor Authentification
✓ Create other users

ACCOUNTADMIN
✓ USERADMIN role is
granted to
SECURITYADMIN
✓ Can manage users
and roles
✓ Can manage any
object grant globally
SECURITYADMIN
Sales Admin Role HR Admin Role
Sales Role HR Role

SECURITYADMIN
Custom Role 1
Custom Role 3
SYSADMIN
✓ Create & manage objects
✓ Create & manage warehouses,

databases, tables etc.
✓ Custom roles should be assigned to the

SYSADMIN role as the parent
Then this role also has the ability to grant privileges on

warehouses, databases, and other objects to the custom
roles.
SYSADMIN
Sales Role HR Role
✓ Create a virtual warehouse & assign it to the custom roles
✓ Create a database and table & assign it to the custom

roles
Custom roles
Sales Role HR Role
✓ Customize roles to our needs & create own hierarchies
✓ Custom roles are usually created by SECURITYADMIN
✓ Should be leading up to the SYSADMIN role

USERADMIN
Sales Role HR Role
✓ Create Users & Roles (User & Role Management)
✓ Not for granting privileges (only the one that is owns)

PUBLIC
Sales Role HR Role
✓ Create Users & Roles (User & Role Management)
✓ Not for granting privileges (only the one that is owns)

PUBLIC
✓ Least privileged role (bottom of hierarchy)
✓ Every user is automatically assigned to this role
✓ Can own objects
✓ These objects are then available to everyone

Snowflake & Other Tools
Snowflake & other tools
Database administrators
Data scources
Reporting
BI
ETL/ELT
Marketing
Data Science
✓ Create easily trial accounts with Snowflake partners
✓ Convenient option for trying 3rd-party tools

✓ ETL/data integration tools – Moving & transforming data
✓ Machine Learning & Data Science tools
✓ Security & Governance

Best Practices
Best practices
✓ Virtual warehouses
✓ Table design
✓ Monitoring
✓ Retention period
ETL/ELT
Data scources
Virtual warehouse
✓ Best Practice #1 – Enable Auto-Suspend
✓ Best Practice #2 – Enable Auto-Resume
✓ Best Practice #3 – Set appropriate timeouts
ETL / Data Loading BI / SELECT queries DevOps / Data Science
Timeout Immediately 10 min 5 min

Table design
✓ Best Practice #1 – Appropiate table type
✓ Staging tables – Transient
✓ Productive tables – Permanent
✓ Development tables – Transient

Table design
✓ Best Practice #1 – Appropiate table type
✓ Best Practice #2 – Appropiate data type
✓ Best Practice #3 – Set cluster keys only if necesarry

✓ Large table
✓ Most query time for table scan
✓ Dimensions
Retention period
✓ Best Practice #1: Staging database – 0 days (transient)
✓ Best Practice #2 – Production – 4-7 days (1 day min)
✓ Best Practice #3 – Large high-churn tables – 0 days

(transient)
Active Time Travel Fail Safe
Timeout 20GB 400GB 2.8TB

All Course Slides

Uploaded by

Copyright:

Available Formats

All Course Slides

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

All Course Slides

Uploaded by

Copyright:

Available Formats

Snowflake MasterClass

What will you learn?

Architecture Load from Azure Zero-Copy Cloning Materialized views

Loading Data Load from GCP Data Sharing Data Masking

Copy Options Snowpipe Data Sampling Access Management

Unstructured Data Time Travel Scheduling Tasks Partner Connect

Performance Fail Safe Visualizations Best practices

Snowflake Architecture 7 Performance Optimization 60 Tasks & Streams 124

Multi-Clustering 11 Snowpipe 88 Materialized Views 142

Cloud Computing 26 Table Types 97 Access Control 159

Snowflake Roles 41 Data Sharing 109

Make use of the

Resources, quizzes &

Ask questions Help others

Make use of the

Resources, quizzes &

Ask questions Help others

Virtual Virtual Virtual

- Muscle of the system -

- Hybrid Columnar Storage -

Auto-Scaling: When to start an additional cluster?

Policy Description Cluster Starts… Cluster Shuts Down…

Immediately when either a query After 2 to 3 consecutive

Conserves credits by favoring

Skip the lecture if you are already familiar

What is the purpose of a data warehouse?

= Database that is used for reporting and

Staging Data Production

Data scources Other Apps

Why Cloud Computing?

Virtual machines Cloud provider

Virtual machines Cloud provider

Standard Enterprise Business Virtual Private

✓ Charged for active warehouses per hour ✓ Monthly storage fees

Standard Enterprise Business Virtual Private

✓ $2.70 / Credit ✓ $4 / Credit ✓ $5.40 / Credit ✓ Contact Snowflake

❖ Scenario 1: 100GB of storage used ❖ Scenario 1: 100GB of storage used

❖ Scenario 2: 800GB of storage used ❖ Scenario 2: 800GB of storage used

Region: US East (Northern Virginia)

✓ Start with On Demand

USERADMIN Custom Role 1 Custom Role 2

ACCOUNTADMIN SECURITYADMIN SYSADMIN USERADMIN PUBLIC

✓ SYSADMIN and ✓ USERADMIN role is ✓ Create warehouses ✓ Dedicated to user ✓ Automatically

✓ Most frequent method ✓ Designed to load small volumes of data

✓ Not to be confused with dataware house

✓ External cloud provider ✓ Local storage maintained

✓ Database object created in Schema

COPY INTO <table_name>

COPY INTO <table_name>

COPY INTO <table_name>

✓ Validate the data files instead of loading them

COPY INTO <table_name>

✓ Validate the data files instead of loading them

COPY INTO <table_name>

✓ When the threshold is exceeded, the COPY operation stops

COPY INTO <table_name>

COPY INTO <table_name>

COPY INTO <table_name>

✓ Note that this option reloads files, potentially