• This repository has been archived on 06/Mar/2023
  • Stars
    star
    156
  • Rank 239,589 (Top 5 %)
  • Language
    Go
  • License
    MIT License
  • Created over 8 years ago
  • Updated about 7 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A simple implementation of the Google File System in golang

goGFS

goGFS is a simple implementation of the Google File System (GFS) in golang.
It is tested with a small cluster of inexpensive machines (1 master, 12 chunkservers and 12 clients).
Fault tolerance is provided.

Feature

  • Architecture & Consistency Model
    • Same as the paper
  • System Interactions
    • atomic record append (append at least once)
  • Master
    • Persistent Metadata
    • Re-replication
    • Garbage Collection
    • Stale Detection
  • ChunkServer
    • Persistent Metadata
  • Client
    • Familiar File System Interface
  • Fault Tolerance

Todo

  • pipelined data flow
  • snapshot

Reference

The Google File System
Class Wiki
Test Repo