教科书:数据挖掘:概念与技术(第二版),Jiawei Han和Micheline Kamber 著,机械工业出版社(2007)
Lecture 1: Introduction
1) Why data mining?
Necessity Is the Mother of Invention需要是发明之母
2) What is data mining?
Data mining (knowledge discovery from data从大量数据中提取或挖掘知识)
Extraction of interesting (non-trivial, implicit, previously unknown and potentially useful) patterns or knowledge from huge amount of data从大量的数据中挖掘哪些令人感兴趣的、有用的、隐含的、先前未知的和可能有用的模式或知识
Alternative names: Knowledge discovery (mining) in databases (KDD) 数据库中的知识挖掘
Steps of a KDD Process
Learning the application domain: relevant prior knowledge and goals of application
Creating a target data set: data selection
Data cleaning and preprocessing: (may take 60% of effort!)
Data reduction and transformation:Find useful features, dimensionality/variable reduction, invariant representation
Choosing functions of data mining: summarization, classification, regression, association, clustering
Choosing the mining algorithm(s)
Data mining: search for patterns of interest
Pattern evaluation and knowledge presentation: visualization, transformation, removing redundant patterns, etc.
Use of discovered knowledge
Architecture: Typical Data Mining System
3) On what kind of data?
Traditional database and appllications
Relational database, data warehouse, transactional database关系数据库,数据仓库,事务数据库
Advanced database and advanced applications
Object-relational databases对象-关系数据库
Temporal database, sequence data (incl. biosequences), time-series data时间数据库、序列数据库和时间序列数据库
Spatial database and spatiotemporal database空间数据库和时间空间数据库
Text databases Multimedia database文本数据库和多媒体数据库
Heterogeneous databases and legacy databases异构数据库和遗产数据库
Data streams and sensor data数据流和传感器数据
Structure data, graphs, social networks and link databases
Text databases Multimedia database文本数据库和多媒体数据库
The World-Wide Web万维网
4) Data Mining Functionalities
Lass/concept description: Characterization and discrimination 类/概念描述: 特性化和区分
Frequent patterns, association, correlation and causality频繁模式、关联和相关
Classification and prediction分类和预测
Cluster analysis聚类分析
Outlier analysis离群点分析
Trend and evolution analysis趋势和演变分析
5) Are all the patterns interesting?
6) Classification of data mining systems