Lecture 2 Raw Data Analysis and Pre-processing Dr.李晓瑜Xiaoyu Li Email:xiaoyuuestc@uestc.edu.cn http://blog.sciencenet.cn/u/uestc2014xiaoyu 2019-Spring SunData Group http://www.sundatagroup.org School of Information and Software Engineering,UESTC 1966 Copyright2019 by Xiaoyu Li
Dr.李晓瑜 Xiaoyu Li Email：xiaoyuuestc@uestc.edu.cn http://blog.sciencenet.cn/u/uestc2014xiaoyu 2019-Spring Lecture 2 Raw Data Analysis and Pre-processing SunData Group http://www.sundatagroup.org/ School of Information and Software Engineering, UESTC Copyright © 2019 by Xiaoyu Li. 1
GunData Group Content (6H) .2.1 Overview of data types .2.2 Review of Data pre-processing tools and platforms 2.3 Clean,storage and management of raw data 2.4 Collections of data analysis and data mining 4 Copyright 2019 by Xiaoyu Li
Content（6H） 2.1 Overview of data types 2.2 Review of Data pre-processing tools and platforms 2.3 Clean, storage and management of raw data 2.4 Collections of data analysis and data mining Copyright © 2019 by Xiaoyu Li. 4
Group Target JATA Obtain the work flow of raw data to clean and pre-process. Know some useful data processing tools and platforms. 5 Copyright 2019 by Xiaoyu Li
Target Obtain the work flow of raw data to clean and pre-process. Know some useful data processing tools and platforms. Copyright © 2019 by Xiaoyu Li. 5
Data Science Process Exploratory Data Analysis Raw Data Data Is Clean Collected Processed Dataset Models Algorithms Data Communicate Visualize Make Product Report Decisions ATA 6 Copyright 2019 by Xiaoyu Li
Copyright © 2019 by Xiaoyu Li. 6 Data Science Process
2.1 Overview of data types What's data? ●What's data types? 。Date:1980-1-1 。Time:20:08:12 ·Age:65 years .Colors:Red,Black,Blue,Green,White,... ·Name:Xiaoyu Li.. 。Symbols:%,&,#,*,… 7 DATA Copyright 2019 by Xiaoyu Li
Copyright © 2019 by Xiaoyu Li. 7 2.1 Overview of data types What’s data? What’s data types? Date：1980-1-1 Time：20:08:12 Age: 65 years Colors: Red, Black, Blue, Green, White,… Name: Xiaoyu Li…. Symbols: %, &, #, *, …