Transcription of The Google File System
{{id}} {{{paragraph}}}
The Google File SystemSanjay Ghemawat, Howard Gobioff, and Shun-Tak LeungGoogle ABSTRACTWe have designed and implemented the Google File Sys-tem, a scalable distributed file System for large distributeddata-intensive applications. It provides fault tolerance whilerunning on inexpensive commodity hardware, and it delivershigh aggregate performance to a large number of sharing many of the same goals as previous dis-tributed file systems, our design has been driven by obser-vations of our application workloads and technological envi-ronment, both current and anticipated, that reflect a markeddeparture from some earlier file System assumptions. Thishas led us to reexamine traditional choices and explore rad-ically different design file System has successfully met our storage is widely deployed within Google as the storage platformfor the generation and processing of data used by our ser-vice as well as research and development efforts that requirelarge data sets.
Moreover, GFS has snapshot and record append opera-tions. Snapshot creates a copy of a file or a directory tree at low cost. Record append allows multiple clients to ap-pend data to the same file concurrently while guaranteeing the atomicity of each individual client’s append. It is use-ful for implementing multi-way merge results and producer-
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}