Transcription of The Google File System
{{id}} {{{paragraph}}}
The Google File SystemSanjay Ghemawat, Howard Gobioff, and Shun-Tak LeungGoogle ABSTRACTWe have designed and implemented the Google File Sys-tem, a scalable distributed file System for large distributeddata-intensive applications. It provides fault tolerance whilerunning on inexpensive commodity hardware, and it delivershigh aggregate performance to a large number of sharing many of the same goals as previous dis-tributed file systems, our design has been driven by obser-vations of our application workloads and technological envi-ronment, both current and anticipated, that reflect a markeddeparture from some earlier file System assumptions. Thishas led us to reexamine traditional choices and explore rad-ically different design file System has successfully met our storage is widely deployed within Google as the storage platformfor the generation and processing of data used by our ser-vice as well as research and development efforts that requirelarge data sets.
The master maintains all file system metadata. This in-cludes the namespace, access control information, the map-pingfrom files tochunks, and thecurrent locations of chunks. It also controls system-wide activities such as chunk lease management, garbage collection of orphaned chunks, and chunk migration between chunkservers. The master peri-
Domain:
Source:
Link to this page:
Please notify us if you found a problem with this document:
{{id}} {{{paragraph}}}