Introduction To Data Mining

Data Mining
Data Mining References
Jiawei Han and Micheline Kamber, Data Mining: Concepts and

Techniques, Morgan Kaufmann Publishers, Elsevier, 3 rd Edition,
2012.
Margaret H. Dunham, Data Mining: Introduction and Advanced

Topics, Pearson Education, 2006.
Pang-Ning Tan, Michael Steinbach and Vipin Kumar, Introduction to

Data Mining , Pearson Education, 2006.
Richard O. Duda, Peter E. Hart and David G. Stork , Pattern

Classification, Wiley Publication, 2nd Edition, 2000.
Ian H. Witten, Eibe Frank and Mark A. Hall, Data Mining Practical
Machine Learning Tools and Techniques, Morgan Kaufmann
Publishers, Elsevier, 3rd Edition, 2011.
IEEE Transactions
Knowledge and Data Engineering
ACM Transactions
Information Systems
Database Systems
Internet Technology
2
Data Mining Objectives
Data Mining or
Knowledge Discovery from Data
OBJECTIVES
Understanding basic data mining concepts &

techniques:
uncovering interesting data patterns, hidden in large data

sets
Development of data mining tools:
scalable and efficient
Evolution of Sciences
Before 1600, empirical science
1600-1950s, theoretical science
Each discipline has grown a theoretical component. Theoretical models often

motivate experiments and generalize our understanding.
1950s-1990s, computational science
Over the last 50 years, most disciplines have grown a third, computational
branch (e.g. empirical, theoretical, and computational ecology, or physics, or
linguistics.)
Computational Science traditionally meant simulation. It grew out of our

inability to find closed-form solutions for complex mathematical models.
1990-now, data science
The flood of data from new scientific instruments and simulations
The ability to economically store and manage petabytes of data online
The Internet and computing Grid that makes all these archives universally
accessible
Scientific info. management, acquisition, organization, query, and

visualization tasks scale almost linearly with data volumes. Data mining is a
major new challenge!
Evolution of Database
Technology
1960s:
data creation & collection
IMS
electronic mode
hierarchical database system by IBM
network DBMS
1970s:
relational data model
relational DBMS implementation
1980s:
RDBMS
advanced data models
extended-relational, OO, deductive, etc.
application-oriented DBMS
spatial, scientific, engineering, etc.

5
Evolution of Database
Technology
1990s:
Data mining
Data warehousing
Multimedia databases
Web databases
2000s:
Stream data management and mining
Data mining and its applications
Web technology
XML
data integration
social networks
global information systems
DM Evolution
Data Mining Importance
The Explosive Growth of Data:
Terabytes (240 bytes)
Petabytes
Exabytes
Zitabytes
Drowning in DATA, but STARVING for KNOWLEDGE !
Data Tombs to Golden Nuggets
PLATO
Greek philosopher and mathematician
Necessity is the Mother of Invention
Data Mining automated analysis of massive data sets

8
Data Mining Definition
Data mining definition:
Extraction or mining of interesting (non-trivial, implicit, previously

unknown and potentially useful) patterns or knowledge from large
amounts of data stored in databases, data warehouses, or other
information repositories
Alternative names
knowledge discovery (mining) in databases (KDD)
knowledge extraction
data/pattern analysis
data archeology
data dredging
information harvesting
business intelligence etc.

9
Knowledge Discovery (KDD) Process
Data mining
Pattern Evaluation
core of knowledge discovery process (identify true interesting patterns representing knowledge)
Pattern
Data Mining
(intelligent methods applied to extract patterns)
Task-relevant Data
Transformation
(summary, aggregation etc.)
Selection
(retrieve relevant data)
Data Warehouse
Data Cleaning
(remove noise and inconsistent data)
Data Integration
(combine multiple data sources)
Databases
10
Data Mining TOOLS
EXPLORE !!!!!!!!!!!!!!
R TOOL
PYTHON TOOL
WEKA TOOL
SPSS TOOL
ORANGE TOOL
CLEMENTINE TOOL
And many more.

References: DM Papers
11
Data Mining and Business

Intelligence
Increasing potential
to support
business decisions
Decisio
n
Making
Data Presentation
Visualization Techniques
End User
Business
Analyst
Data Mining
Information Discovery
Data
Analyst
Data Exploration
Statistical Summary, Querying, and Reporting
Data Preprocessing/Integration, Data Warehouses
Data Sources
Paper, Files, Web documents, Scientific experiments, Database Systems
DBA
12
Data Mining: Confluence of Multiple

Disciplines
Database
Technology
Machine
Learning
Pattern
Recognition
Statistics
Data Mining
Algorithm
Visualization
Other
Disciplines
13
Why Not Traditional Data

Analysis?
Tremendous amount of data
High-dimensionality of data
Algorithms must be highly scalable to handle such as terabytes of data

Micro-array may have tens of thousands of dimensions
High complexity of data
Data streams and sensor data
Time-series data, temporal data, sequence data
Structure data, graphs, social networks and multi-linked data
Heterogeneous databases and legacy databases
Spatial, spatiotemporal, multimedia, text and Web data
Software programs, scientific simulations
New and sophisticated applications

14
Data Mining: Classification Schemes
General functionality
Descriptive data mining
Predictive data mining
Different views lead to different classifications
Data view: Kinds of data to be mined
Knowledge view: Kinds of knowledge to be

discovered
Method view: Kinds of techniques utilized
Application view: Kinds of applications adapted

15
Multi-Dimensional View of Data

Mining
Data to be mined
Knowledge to be mined
Characterization, discrimination, association,

clustering, trend/deviation, outlier analysis, etc.
Multiple/integrated functions and mining at multiple levels
classification,
Techniques utilized
Relational, data warehouse, transactional, stream, objectoriented/relational, active, spatial, time-series, text, multimedia, heterogeneous, legacy, WWW
Database-oriented, data warehouse (OLAP), machine learning,

statistics, visualization, etc.
Applications adapted
Retail, telecommunication, banking, fraud analysis, bio-data

mining, stock market analysis, text mining, Web mining, etc.
16
Data Warehousing
consolidation of data from several databases which are in turn

maintained by individual business units along with historical and
summary information
Roll-up
17
Multi-Tiered Architecture
other
sources
Operational
DBs
Metadata
Extract
Transform
Load
Refresh
Monitor
&
Integrator
Data
Warehouse
OLAP Server
Serve
Analysis
Query
Reports
Data mining
Data Marts
Data Sources
Data Storage
OLAP Engine Front-End Tools
18
Data Mining Research
Publications
Tayal, D. K., Jain, A., Arora, S. , Agarwal, S., Gupta, T. and Tyagi, N., Crime
Detection and Criminal Identification in India Using Data Mining Techniques,
Artificial Intelligence & Society (AIS), SPRINGER, vol. 30, no. 1, pp. 117-127,
Feb 2015. [Indexed: Scopus, Google Scholar, EDSCO, ACM Digital Library,
DBLP]
Jain, A. Yadav, D., and Tayal, D. K., NER for Hindi Language Using Association
Rules, International Conference on Data Mining and Intelligent Computing
(ICDMIC 2014), IGDTUW Delhi, India, IEEE, 5th-6th Sept 2014. [Indexed: Scopus]
19

Introduction To Data Mining

Uploaded by

Copyright:

Available Formats

Introduction To Data Mining

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Introduction To Data Mining

Uploaded by

Copyright:

Available Formats

What are some of the major data mining techniques discussed?

What are some of the major data mining techniques discussed?

What are some of the challenges in data mining?

What are some of the challenges in data mining?

Data Mining

Data Mining References

Jiawei Han and Micheline Kamber, Data Mining: Concepts and

Margaret H. Dunham, Data Mining: Introduction and Advanced

Pang-Ning Tan, Michael Steinbach and Vipin Kumar, Introduction to

Richard O. Duda, Peter E. Hart and David G. Stork , Pattern

Knowledge and Data Engineering

Data Mining Objectives

Knowledge Discovery from Data

Understanding basic data mining concepts &

uncovering interesting data patterns, hidden in large data

Development of data mining tools:

scalable and efficient

Before 1600, empirical science

1600-1950s, theoretical science

Each discipline has grown a theoretical component. Theoretical models often

1950s-1990s, computational science

Computational Science traditionally meant simulation. It grew out of our

1990-now, data science

The flood of data from new scientific instruments and simulations

The ability to economically store and manage petabytes of data online

Scientific info. management, acquisition, organization, query, and

data creation & collection

relational data model

relational DBMS implementation

advanced data models

extended-relational, OO, deductive, etc.

spatial, scientific, engineering, etc.

Stream data management and mining

Data mining and its applications

global information systems

Data Mining Importance

The Explosive Growth of Data:

Terabytes (240 bytes)

Drowning in DATA, but STARVING for KNOWLEDGE !

Data Tombs to Golden Nuggets

Greek philosopher and mathematician

Necessity is the Mother of Invention

Data Mining automated analysis of massive data sets

Data Mining Definition

Data mining definition:

Extraction or mining of interesting (non-trivial, implicit, previously

knowledge discovery (mining) in databases (KDD)

business intelligence etc.

Knowledge Discovery (KDD) Process

Data Mining TOOLS

And many more.

Data Mining and Business

Data Mining: Confluence of Multiple

Why Not Traditional Data

Tremendous amount of data

Algorithms must be highly scalable to handle such as terabytes of data

High complexity of data

Data streams and sensor data