PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: quiz answers

Helland Cosmos Big Data and Big Challenges - microsoft.com

Cosmos Big data and Big Challenges Pat Helland July 2011 1 Outline Introduction Cosmos Overview The Structured Streams Project Some Other Exciting Projects Conclusion 2 What Is Cosmos ? Petabyte Store and Computation System About 62 physical petabytes stored (~275 logical petabytes stored) Tens of thousands of computers across many datacenters Massively parallel processing based on Dryad Similar to MapReduce but can represent arbitrary DAGs of computation Automatic computation placement with data SCOPE (Structured Computation Optimized for Parallel Execution)

–Changed to deal with input and output streams • SCOPE is a high level declarative language for data manipulation –It translates very naturally into parallel computation 10 Scope Job Stream-1 Stream-2 Stream-3 Stream-A Stream-B Input Output Input Arrives as Sets of Records Computation Occurs as Sets of Records Output Written as

Loading..

Tags:

  Data, Microsoft, Output, Sets, Cosmo, And output

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of Helland Cosmos Big Data and Big Challenges - microsoft.com

Related search queries