PyconChina2015丁来强Pydata Ecosystem
pydata ecosystem基于python的数据分析生态系统
0.
Agenda
Data Science ecosystem
Data Wrangling
Data Analysis
Data Visualization
3 Real Case Demo
Bigger Data Consideration
Spark Data Frame Demo
1.
Data Science Process
Data Collection
Databases
Applications
3rdpart data
Data Wrangling
Enrichment
ETL/Blending
Data
Intergration
Data Analysis
insights
Statistics
Visualization
Modeling
2.
Data Wrangling
Data scientists spend 80% of their time convert data into a usable form.
Clean data:handle messy or missed data
Transform and Extract data
Merge,Join and Reshape data
Time series Resampling
3.Data Analysis
Interactive Data Exploration
Rich visualzation
Satistical Modeling
4.python vs R
TIOBE Index
5.Pros and Cons
R+visualization = perfect match
R,Lingua Franca of Statistics(develop by Statistics)
R is slow
Python is multi-purpose language
Python is challenger for either visualization or essential R packages replacement
6.PyData Ecosystem
Fundamental Libs
numpy\scipy
AdvancedLibs
pandas\sympy\Scikit-lean\xray\Blaze
7.Numpy
High performance N-Arrary operation lib
高性能多维
8.pands
打包
9.Blaze
High-level user interface for databases and array computing systems
10.Spark
11.DataFrame
12.matplotlib
13.seaborn
14.Bokeh
15.IPython
最新文章
- hdfs client access the hdfs cluster not in one domain
- mysql实用操作
- UILabel顶部对齐解决方法(转载)
- 自动去除nil的NSDictionary和NSArray构造方法
- 关于IE9中webdiriver使用autoit上传文件报错
- C#.NET序列化XML、JSON、二进制微软自带DLL与newtonsoft(json.net)
- Create Custom Modal Dialog Windows For User Input In Oracle Forms
- 5 给我们的c#程序添加注释
- 【记忆化搜索】Codeforces Round #295 (Div. 2) B - Two Buttons
- MarkdownPad2
- NGRC远程控制
- c#基础语言编程-序列化
- 如何使用getopt()函数解析参数
- linux 解决Ubuntu编译内核uImage出现问题“mkimage” command not found - U-Boot images will not be built问题
- 学习笔记——桥接模式Bridge
- 剑指offer：调整数组顺序使奇数位于偶数前面
- 评测parser的好坏
- 【VMware vSphere】ESXi系统设置静态IP
- TCP/IP协议三次握手与四次握手
- 《Linux内核原理与分析》第二周作业