hadoop大数据处理讲义-vmware讲座.pdf

Big Data in Virtualization and Cloud Gavin Lu, Sr RD Manager June 4, 2014 © 2014 VMware Inc. All rights reserved. Agenda • What’s VMware? • What’s big data? • Why virtualized big data? – Virtual Hadoop • What’s Big Data Extensions? • How BDE works? • What’s next? CONFIDENTIAL 2 What’s VMware? CONFIDENTIAL 3 What’s Big Data? Four V’s of Big Data CONFIDENTIAL 5 Big Data Landscape CONFIDENTIAL 6 Generic Big Data System Architecture Real Time Streams Real-Time Processing Analytics ETL Data Real Time Parallel Structured Big SQL Batch Database Processing Unstructured Data (HDFS) CONFIDENTIAL 7 Why Virtualized Big Data? vHadoop: Just Another Type of Workload Dynamic elastic scaling on shared resource pool 50%+ resources are sitting idle while high priority job is Utilize all resources from burning up its cluster. pool on demand. vSphere HA/F