1 / 34

Harnessing Big Data with Hadoop

DBI210. Harnessing Big Data with Hadoop. Dipti Sangani ; Madhu Reddy. BIG HYPE?. OR. REAL DEAL?. Big Data: Big Hype . Big Data: Big Hype . May 21, 2012. VC firms pour money into big-data vendors. title. Microsoft’s Big Data Vision and Platform . Dipti Sangani.

tavarius
Download Presentation

Harnessing Big Data with Hadoop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DBI210 Harnessing Big Data with Hadoop DiptiSangani; Madhu Reddy

  2. BIG HYPE? OR REAL DEAL?

  3. Big Data: Big Hype

  4. Big Data: Big Hype

  5. May 21, 2012 VC firms pour money into big-data vendors

  6. title Microsoft’s Big Data Vision and Platform

  7. Dipti Sangani Sr. Program Manager diptis@microsoft.com Madhu Reddy Sr. Product Planner mareddy@microsoft.com

  8. The world of Relational Data is changing 10x increase every 5 years VOLUME 4.3 connected devices per adult VELOCITY Relational Data VARIETY 85% from new data types

  9. It’s all about new insights! New Insights New Data Large& Unstructured. Multiple Sources. Fast. New Economics Open Source Software Commodity Hardware. Cloud Scale.

  10. What’s the social sentiment for my • brand or products? • How do I better predict future outcomes? • How do I optimize my fleet based on weather and traffic patterns? Advanced ANALYTICS SOCIAL & Web ANALYTICS LIVE DATA FEEDS

  11. Any Data, Any Size Anywhere Microsoft’s approach to Big Data Connecting with the World’s Data Immersive Insight , Wherever you are

  12. MICROSOFT BIG DATA: AN END-TO-END APPROACH DATA MANAGEMENT 1 1 1 0 1 0 NON-RELATIONAL RELATIONAL STREAMING

  13. MICROSOFT BIG DATA: AN END-TO-END APPROACH DATA ENRICHMENT DISCOVER AND RECOMMEND SHARE AND GOVERN TRANSFORM AND CLEAN DATA MANAGEMENT 1 1 1 0 1 0 NON-RELATIONAL RELATIONAL STREAMING

  14. MICROSOFT BIG DATA: AN END-TO-END APPROACH INSIGHT SELF-SERVICE | COLLABORATIVE | MOBILE | REAL-TIME DATA ENRICHMENT DISCOVER AND RECOMMEND SHARE AND GOVERN TRANSFORM AND CLEAN DATA MANAGEMENT 1 1 1 0 1 0 NON-RELATIONAL RELATIONAL STREAMING

  15. MICRSOFT BIG DATA: AN END-TO-END APPROACH INSIGHT SELF-SERVICE | COLLABORATIVE | MOBILE | REAL-TIME DATA ENRICHMENT DISCOVER AND RECOMMEND SHARE AND GOVERN TRANSFORM AND CLEAN DATA MANAGEMENT 1 1 1 0 1 0 NON-RELATIONAL RELATIONAL STREAMING

  16. Microsoft Hadoop StrategyMake Hadoop Enterprise Ready

  17. BIG DATA at Klout • Use Case: • Klout provides a score to measure customer influence • Klout used SSAS OLAP Cube to speed queries and offer custom BI • OLAP Cube loads data from Hive Data Warehouse • New solution analyzes 35 billions rows of data and delivers fast queries in under 10 seconds! Microsoft BI Tools OLAP Cube Hive Data Warehouse 18

  18. DEMOS! DEMOS! DEMOS!

  19. Hadoop Ecosystem(Still) Rapidly Evolving Oozie (Workflow) Traditional BI Tools HBase / Cassandra (Columnar NoSQL Databases) Hive (Warehouse and Data Access) Karmasphere (Development Tool) Apache Mahout Flume Pig (Data Flow) Sqoop HBase (Column DB) MapReduce (Job Scheduling/Execution System) Hadoop = MapReduce + HDFS Zookeeper (Coordination) Avro (Serialization) HDFS (Hadoop Distributed File System)

  20. MICROSOFT HADOOP ECOSYSTEM Data Warehouse & Analytics Digital Shoebox Self-Service BI ETL & Data Mgmt

  21. demo Hadoop on Azure Name Title Group

  22. While dramatically simplifying programming on Hadoop MapReduce programs in JavaScript Simplified Deployment of MapReduce jobs • Benefits Simplified Programming JS Integration with .NET and new JavaScript libraries for Hadoop Deploy JavaScript Hadoop jobs from a simple web browser on any supported device • Key Features

  23. demo Big Data App Development

  24. unlocking immersive insights from all data with Microsoft BI tools Familiar self service BI tools • Benefits Hive ODBC Driver integrates Hadoop to SQL Server Analysis Services, PowerPivot, and Power View, Hive Add-in for excel • Key Features

  25. demo Big Data Analytics with Hive and Excel

  26. CALL TO ACTION Checkout: http://HadoopOnAzure.com

  27. THANK YOU!

  28. Track Resources Hands-On Labs @sqlserver @ms_teched SQL Server 2012 Eval Copy Get Certified! mva Microsoft Virtual Academy

  29. Resources Learning TechNet • Connect. Share. Discuss. • Microsoft Certification & Training Resources http://northamerica.msteched.com www.microsoft.com/learning • Resources for IT Professionals • Resources for Developers http://microsoft.com/technet http://microsoft.com/msdn

  30. Required Slide Complete an evaluation on CommNet and enter to win!

  31. MS Tag Scan the Tag to evaluate this session now on myTechEd Mobile

  32. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More Related