Data Engineering - Dimensional Modelling
Data Engineering - Dimensional Modelling
Modelling
Important Concepts
DATA ENGINEERING - DIMENSIONAL MODELLING
1
DIMENSIONAL MODELING
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
2
STAR SCHEMA
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
3
SNOWFLAKE SCHEMA
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
4
FACT TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
5
DIMENSION TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
6
GRAIN
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
7
SURROGATE KEY
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
8
SLOWLY CHANGING DIMENSIONS
(SCD)
Techniques for managing and tracking
changes in dimension table attributes
over time.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
9
TYPE 1 SCD
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
10
TYPE 2 SCD
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
11
TYPE 3 SCD
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
12
CONFORMED DIMENSIONS
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
13
JUNK DIMENSION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
14
ROLE-PLAYING DIMENSIONS
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
15
FACTLESS FACT TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
16
AGGREGATE FACT TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
17
BRIDGE TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
18
DEGENERATE DIMENSION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
19
ETL (EXTRACT, TRANSFORM,
LOAD)
The process of extracting data from
source systems, transforming it, and
loading it into a data warehouse.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
20
BUS ARCHITECTURE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
21
DATA MART
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
22
GRAIN DECLARATION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
23
DIMENSIONAL HIERARCHY
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
24
MULTIVALUED DIMENSIONS
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
25
OUTRIGGER DIMENSION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
26
MINI-DIMENSION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
27
DATA STEWARDSHIP
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
28
SURROGATE KEY PIPELINE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
29
SLOWLY CHANGING MEASURE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
30
FACT TABLE GRAIN
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
31
SNAPSHOT FACT TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
32
ACCUMULATING SNAPSHOT FACT
TABLE
Tracks the progress of a process over
time, updating records as milestones are
reached.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
33
SEMI-ADDITIVE MEASURES
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
34
NON-ADDITIVE MEASURES
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
35
ETL STAGING AREA
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
36
DATA QUALITY
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
37
DATA LINEAGE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
38
BUSINESS PROCESS
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
39
DRILL-DOWN ANALYSIS
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
40
DERIVED TABLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
41
FACT TABLE AGGREGATION
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
42
PERFORMANCE TUNING
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
43
DATA WAREHOUSE
ARCHITECTURE
The overall structure and organization of
the data warehouse, including schemas,
ETL processes, and data storage.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
44
DIMENSIONAL INTEGRITY
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
45
LATE ARRIVING DATA
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
46
DATA WAREHOUSE LIFECYCLE
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
47
OLAP (ONLINE ANALYTICAL
PROCESSING)
A category of software tools that provide
analysis of data stored in a database,
often used in data warehousing.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
48
KIMBALL METHODOLOGY
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
49
CORPORATE INFORMATION
FACTORY (CIF)
A framework for enterprise data
warehousing that integrates data from
various sources into a central repository.
Shwetank Singh
GritSetGrow - GSGLearn.com
DATA ENGINEERING - DIMENSIONAL MODELLING
50
DATA VAULT MODELING
Shwetank Singh
GritSetGrow - GSGLearn.com