Big Data-Definition and Concepts Big Data means different things to people with different backgrounds and interests Traditionally, Big Data"= massive volumes of data E.g., volume of data at CERN, NASA, Google Where does the Big Data come from? Everywhere! Web logs, RFID, GPS systems, sensor networks, social networks. Internet-based text documents Internet search indexes, detail call records, astronomy, atmospheric science, biology, genomics, nuclear physics, biochemical experiments, medical records, scientific research, military surveillance, multimedia archives, Copynight@ 2014 Pearson Education, Inc Slide 6-6
Copyright © 2014 Pearson Education, Inc. Slide 6 - 6 Big Data - Definition and Concepts ▪ Big Data means different things to people with different backgrounds and interests ▪ Traditionally, “Big Data” = massive volumes of data ▪ E.g., volume of data at CERN, NASA, Google, … ▪ Where does the Big Data come from? ▪ Everywhere! Web logs, RFID, GPS systems, sensor networks, social networks, Internet-based text documents, Internet search indexes, detail call records, astronomy, atmospheric science, biology, genomics, nuclear physics, biochemical experiments, medical records, scientific research, military surveillance, multimedia archives, …
Technology Insights 6.1 The Data Size Is Getting Big, Bigger, Hadron Collider -1 PB/sec Boeing jet -20 TB/hr Facebook -500 TB/day You lube -1 TB/4 min Name Symbo Value Kilobyte The proposed Square Kilometer Array telescope gigabyte (the world's proposed terabyte Petabyte biggest telescope)-1 EB/day Zettabyte Yottaby Brontobyte BB GeB 30 "Not an official SI (International System of Units) name/symbol, yet Copynight@ 2014 Pearson Education, Inc Slide 6-7
Copyright © 2014 Pearson Education, Inc. Slide 6 - 7 Technology Insights 6.1 The Data Size Is Getting Big, Bigger, … ▪ Hadron Collider - 1 PB/sec ▪ Boeing jet - 20 TB/hr ▪ Facebook - 500 TB/day ▪ YouTube – 1 TB/4 min ▪ The proposed Square Kilometer Array telescope (the world’s proposed biggest telescope) – 1 EB/day
Big Data-Definition and Concepts Big data is a misnomer Big Data is more than just big The Vs that define Big Data Volume Variety Velocity Veraci Variability Value Copynight@ 2014 Pearson Education, Inc Slide 6-8
Copyright © 2014 Pearson Education, Inc. Slide 6 - 8 Big Data - Definition and Concepts ▪ Big Data is a misnomer! ▪ Big Data is more than just “big” ▪ The Vs that define Big Data ▪ Volume ▪ Variety ▪ Velocity ▪ Veracity ▪ Variability ▪ Value ▪ …
Big Data-Definition and Concepts Big Data is not new! Traditionally, Big Data= massive volumes of data Volume of data at CERN, NASA, Google Where does the Big Data come from? Everywhere! Web logs, RFID, GPS systems, sensor networks, social networks, Internet-based text documents Internet search indexes, detail call records, astronomy, atmospheric science, biology, genomics, nuclear physics biochemical experiments, medical records, scientific research, military surveillance, multimedia archives Copynight@ 2014 Pearson Education, Inc Slide 6-9
Copyright © 2014 Pearson Education, Inc. Slide 6 - 9 Big Data - Definition and Concepts ▪ Big Data is not new! ▪ Traditionally, “Big Data” = massive volumes of data ▪ Volume of data at CERN, NASA, Google, … ▪ Where does the Big Data come from? ▪ Everywhere! Web logs, RFID, GPS systems, sensor networks, social networks, Internet-based text documents, Internet search indexes, detail call records, astronomy, atmospheric science, biology, genomics, nuclear physics, biochemical experiments, medical records, scientific research, military surveillance, multimedia archives, …
A High-Level Conceptual Architecture for Big Data Solutions(by AsterData/Teradata) UNIFIED DATA ARCHITECTURE System Conceptual View MOVE MANAGE ACCESS DATA PLATFORM INTEGRATED DATA WAREHOUSE Customers Images Frontline Workers 司 Machine DISCOVERY PLATFORM Analysts EVENT PROCESSING DATA USERS Copynight@ 2014 Pearson Education, Inc Slide 6-10
Copyright © 2014 Pearson Education, Inc. Slide 6 - 10 A High-Level Conceptual Architecture for Big Data Solutions (by AsterData / Teradata) Math and Stats Data Mining Business Intelligence Applications Languages Marketing ANALYTIC TOOLS & APPS USERS DISCOVERY PLATFORM INTEGRATED DATA WAREHOUSE DATA PLATFORM MOVE MANAGE ACCESS UNIFIED DATA ARCHITECTURE System Conceptual View Marketing Executives Operational Systems Frontline Workers Customers Partners Engineers Data Scientists Business Analysts EVENT PROCESSING ERP SCM CRM Images Audio and Video Machine Logs Text Web and Social BIG DATA SOURCES ERP