Transcription of Data Storage Infrastructure at Facebook - …
{{id}} {{{paragraph}}}
Example: biology
Data Storage Infrastructure at Facebook - …
Data Storage Infrastructure at FacebookSpring 2018 Cleveland State UniversityCIS 601 PresentationYi DongInstructor: Dr. Chung Outline Strategy of data Storage , processing, and log collection Data flow from the source to the data warehouse Storage systems and optimization Data discovery and analysis Challenges in resource sharing Facebook s Architecture Facebook s ArchitecturePHPHipHop compilerScribeThriftHadoop HbaseHayStackHiveMySQLM emcached Part 1: Strategy for Data Storage , Processing, Log collection Apache Hadoop Apache Hive Scribe Hadoop, Why? Scalability Able to process multi petabyte datasets Fault Tolerance Node failure is expected everyday Number of nodes is not constant High Availability User can access from nearest node Cost Efficiency Open source Use commodity hardware as a node in Hadoop clusters Eliminates particular technology dependency Hadoop Architecture HDFS (Hadoop Distributed File System) Map-Reduce Infrastructure Hive SQL-like analysis tool (Hi)
Outline Strategy of data storage, processing, and log collection Data flow from the source to the data warehouse Storage systems and optimization Data discovery and analysis Challenges in resource sharing
Loading..
Information
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document: