Data Mining: Concepts and Techniques: - Slides For Textbook - Chapter 1
Data Mining: Concepts and Techniques: - Slides For Textbook - Chapter 1
Data Mining: Concepts and Techniques: - Slides For Textbook - Chapter 1
http://www.cs.sfu.ca/~han/dmbook
1960s:
Data collection, database creation, IMS and network DBMS
1970s:
Relational data model, relational DBMS implementation
1980s:
RDBMS, advanced data models (extended-relational, OO,
deductive, etc.) and application-oriented DBMS (spatial, scientific,
engineering, etc.)
1990s—2000s:
Data mining and data warehousing, multimedia databases, and
Web databases
December 19, 2018 Data Mining: Concepts and Techniques 7
What Is Data Mining?
Customer profiling
data mining can tell you what types of customers buy what
products (clustering or classification)
Applications
widely used in health care, retail, credit card services,
telecommunications (phone card fraud), etc.
Approach
use historical data to build models of fraudulent behavior and
use data mining to help identify similar instances
Examples
auto insurance: detect a group of people who stage accidents to
collect on insurance
money laundering: detect suspicious money transactions (US
Treasury's Financial Crimes Enforcement Network)
medical insurance: detect professional patients and ring of
doctors and ring of references
December 19, 2018 Data Mining: Concepts and Techniques 13
Fraud Detection and Management (2)
Sports
IBM Advanced Scout analyzed NBA game statistics (shots
blocked, assists, and fouls) to gain competitive advantage for
New York Knicks and Miami Heat
Astronomy
JPL and the Palomar Observatory discovered 22 quasars with
the help of data mining
Internet Web Surf-Aid
IBM Surf-Aid applies data mining algorithms to Web access logs
for market-related pages to discover customer preference and
behavior pages, analyzing effectiveness of Web marketing,
improving Web site organization, etc.
Pattern Evaluation
Data mining: the core of
knowledge discovery
process. Data Mining
Task-relevant Data
Data Cleaning
Data Integration
Databases
December 19, 2018 Data Mining: Concepts and Techniques 16
Steps of a KDD Process
Data Exploration
Statistical Analysis, Querying and Reporting
Pattern evaluation
Data
Databases Warehouse
Relational databases
Data warehouses
Transactional databases
Advanced DB and information repositories
Object-oriented and object-relational databases
Spatial databases
Time-series data and temporal data
Text databases and multimedia databases
Heterogeneous and legacy databases
WWW
December 19, 2018 Data Mining: Concepts and Techniques 20
Data Mining Functionalities (1)
Outlier analysis
Outlier: a data object that does not comply with the general behavior
of the data
It can be considered as noise or exception but is quite useful in fraud
detection, rare events analysis
Machine
Learning
Data Mining Visualization
Information Other
Science Disciplines
General functionality
Descriptive data mining
Predictive data mining
Techniques utilized
Database-oriented, data warehouse (OLAP), machine learning,
Layer2
MDDB
MDDB
Meta Data