Improving MapReduce Performance Using Smart Speculative Execution Strategy Qi Chen, Cheng Liu, and Zhen Xiao Oct 2013 To appear in IEEE Transactions on Computers
Improving MapReduce Performance Using Smart Speculative Execution Strategy Qi Chen, Cheng Liu, and Zhen Xiao Oct 2013 To appear in IEEE Transactions on Computers
Outlines 1 Introduction 02.Background 03. Previous work ◎4. Pitfalls 5. Our Desian ◎6. Evaluation ◎7. Conclusion
0 Outlines 2. Background 3. Previous work 4. Pitfalls 5. Our Design 1. Introduction 6. Evaluation 7. Conclusion
Outlines 1 Introduction 2. Background 3. Previous work 4. Pitfalls 5. Our Desian 06. Evaluation 07. Conclusion
0 Outlines 2. Background 3. Previous work 4. Pitfalls 5. Our Design 1. Introduction 6. Evaluation 7. Conclusion
Introduction The new era of Big Data is coming! oogle- 20 PB per day(2008) YAHOO!-30 TB per day(2009) facebook 60 TB per day(2010) amazon eb y-petabytes per day What does big data mean? Important user information significant business value
Introduction The new era of Big Data is coming! – 20 PB per day (2008) – 30 TB per day (2009) – 60 TB per day (2010) –petabytes per day What does big data mean? Important user information significant business value
MapReduce What is mapreduce? most popular parallel computing model proposed by Google Select, Join gre Page rank Inverted index Clustering, machine translation Log analysis database operation Reco Search M engine earnIng Applications Scientific Cryptanalysis computation
MapReduce What is MapReduce? most popular parallel computing model proposed by Google database operation Search engine Machine learning Cryptanalysis Scientific computation Applications … Select, Join, Group Page rank, Inverted index, Log analysis Clustering, machine translation, Recommendation