• Stars
    star
    8
  • Rank 2,041,714 (Top 42 %)
  • Language
    Rust
  • Created over 4 years ago
  • Updated about 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

E2E Solution for Distributed Cold-Data Storage

Fido [Active Development]

E2E Solution for your distributed file storage

Real-World use case

  1. you need to download a file, many files, a bunch of file from your scraper
  2. one disk is not enough, you always need more
  3. then you decide to use Fido with Systemd
  4. Fido will automatically distribute your files into selected external disk
  5. When your files getting bigger again, just add external disk again to your server

Prerequisite

  1. Make sure you have running mongodb server, if not, install mongodb
  2. Setup mongodb url in here

Installation

git clone 
cd Fido
cargo build --release

Usage

# generate symbolic link for any data that already in brick/slave/disk
# --path are not used in --cmd 0
./target/release/Fido --cmd 0 --path / --bricks /mnt/disks/disk-1

# move temporary file to brick/slave/disk, then create ln from disk to temporary location
./target/release/Fido --cmd 1 --path /path/to/scrapped-data --bricks /mnt/disks/

More Repositories

1

batch-image-generator

Generate dynamic image content based on a template image and a CSV file.
Svelte
74
star
2

pc-auth-notifier

Someone tried to unlock your device
Go
60
star
3

file.io

🐈 💻 Simple File Share Service where the file is completely deleted after download.
CSS
43
star
4

file-server

Multi-source file server [💾 | 💽 | 💿] 🧐
Go
19
star
5

docker-script

Embed your whole project files into single existing Dockerfile file with respect to .dockerignore & GZIP compression support.
Go
19
star
6

ficha

An super secret chat app for any body who need privacy ✉
Crystal
18
star
7

temporar

S3-Backed Anonymous Temporary File Sharing
CSS
17
star
8

kemal-mysql-blog

Crystal, Kemal, MySQL, Blog
CSS
11
star
9

telelog

Embed to your app or tail a file, send the log to your telegram account &/ group
Go
9
star
10

sveltekit-telegram-captcha-bot

JavaScript
9
star
11

elastis

Tool for Export / Dump / Import / Copy Elastic/Open Search indexes data
Go
8
star
12

golang-ktp-aws-textract

KTP Extractor based on AWS Textract
Go
7
star
13

CoBat-RAT-Malware

RAT Malware for school project, educational purpose
Java
6
star
14

gstransfer

Google Cloud Storage upload relay/gateway with destination path rewrite support & zero disk allocation ⚡
Go
6
star
15

portable-http-server

Simple HTTP Server with Dir Listing, Explore & File Upload support
Go
6
star
16

elixir-sse-example

Server Sent Events example in Elixir + Phoenix
Elixir
5
star
17

sdfs

a Connector |> Distributed File System based on Symlinking (that fit author need)
Go
5
star
18

Data-Wilayah.js

Indonesian territory data in JavaScript
Python
5
star
19

GoTral

Golang Centralized Configuration management (LIBRARY)
Go
4
star
20

chuck-norris-holy-quotes

An Chuck Norris Holy Quotes written in Crystal
Crystal
4
star
21

elixir-two-factor-auth

Library for generating QR-Code, Random Secret and Verify Time Based Password
Elixir
4
star
22

node-examp-app

Node JS, SQLite, IO Exam app
CSS
4
star
23

golang-elasticsearch-crud

Go / Golang elasticsearch CRUD example
Go
4
star
24

install-latest-go-linux

Shell
4
star
25

terminus-red

Terminus Red GTK 2/3 Theme
CSS
4
star
26

phoenix-auth-example

Phoenix authentication example with ETS, Multi Session & Single Session example
Elixir
4
star
27

go-screenshot

Go package for taking screenshot from Linux+, Windows-, Mac-
Go
4
star
28

wasmc.cr

A WebAssembly Compiler for Crystal. WIP : Work In Progress !
Crystal
4
star
29

cloudflare-system-internship-task-2020

🔥 Basic option, IPv4 & IPv6 support, Save output as HTML, change percentile
Go
4
star
30

web-mirror

Make any web accessible from your own host / domain
Go
4
star
31

lazy-mongo

Insert data to mongo from text plain or file
Crystal
3
star
32

crystal-mysql-crud-example

Crystal MySQL CRUD Example
Crystal
3
star
33

go-mongo-web-boilerplate

Go net/http & mgo Web Boilerplate
Go
3
star
34

minikv

In-memory KV database with expiration (TTL) support, can be dumped and loaded (for non RT persistence).
Go
3
star
35

heineken-music-player

Listen to any music by given audio file or youtube url
CSS
3
star
36

job-test

Push your test here !
JavaScript
3
star
37

Danilla

Secret Management written in Elixir based on Mnesia & ETS
CSS
3
star
38

GoTral-Server

Server for GoTral, Encrypted Golang Centralized Configuration management
Go
3
star
39

GoMiss

Auto `go get -u` from missing package message
Go
3
star
40

June

a Read Only Selenium for Web Scrapping
Crystal
2
star
41

md5-cpp

MD5 -> WASM
C
2
star
42

slicey

Spicy slice in Go, collection of slice modifier
Go
2
star
43

golang-code-sample

Go Code Sample plugin for vscode
2
star
44

Kaskus-Thread-Remover

Python
2
star
45

barachy

a Static File Loader, Handler and Backuper
Crystal
2
star
46

s2c

SASS To CSS Converter [GUI]
Crystal
2
star
47

zenly

Server Side and Portable NVR, Powered by gphoto2
2
star
48

EaW-GaS-Stack

Introduction to EaW (Elixir as Web) & GaS (Golang as Service) Stack
2
star
49

.vimrc

My tiny simple .vimrc File
Vim Script
2
star
50

Ngeue

Rust Web Framework dedicated for API
2
star
51

systemd-generator

systemd service generator
2
star
52

lemmehand

Lemmehand Proxy Server, Written in Crystal
Crystal
2
star
53

go-gin-recaptcha-example

Go Golang Gin reCAPTCHA Example (v2 & v3)
HTML
2
star
54

telegram-profile-info-changer

change your telegram name and profile picture every pyrogram.Filters passed
Python
2
star
55

go-web-boilerplate

Golang Web Boilerplate with Auth, User Management, reCaptcha, Page Generator
Go
2
star
56

selenium-session-manager

Selenium session manager
Python
2
star
57

clipmonkey

Learning Go Programming Language
Go
2
star
58

GoTral-node

GoTral library for node.js
1
star
59

go-press

Simple CMS written in Go + sqlite - compatible with HUGO Template
1
star
60

go-auto-deploy

Auto Deployment for Go
1
star
61

telegram-captcha-bot

1
star
62

git-push-telegram-log

1
star
63

nim-totp

Time-based One-time Password library in NIM
1
star
64

grab

Collection of numerous GRAB's API in Go
Go
1
star
65

persisten-cookiejar

because @juju persisten-cookiejar doesn't works for me
1
star
66

go-module-test

1
star
67

mongodumper

Automate your mongo database backup
1
star
68

goimagemerge

Go
1
star
69

spjalla

1
star
70

WinSS

1
star
71

10K-Addons

10K is browser addons/extension that listen XHR request to collecting api value by specified routes
1
star
72

gin-recaptcha

Gin reCAPTCHA Middleware, Auto detect, verify and abort c.PostForm("g-recaptcha-response")
Go
1
star
73

tiktod-downloader

1
star
74

youtube-channel-search

1
star
75

upwork-rss-telegram-notification

1
star
76

tiktod-rest

Powerful REST Client built for cutting edge era
1
star
77

Shika

1
star
78

igigle

Omegle / Ome.tv written in Go
1
star
79

codenoid.github.io

HTML
1
star
80

go-image-combiner

1
star
81

goprox

Highly Intuitive Proxy Server
1
star
82

pumpkinfs

1
star
83

webdriver-protocol

Go implementation of https://www.w3.org/TR/webdriver
1
star
84

id-phone-number-parser

Indonesian phone number parser
HTML
1
star
85

TheFATWoman

TFW is screen-spyware that curently only run in Windows & Linux
1
star
86

json-to-anything

Convert JSON to "Anything"
1
star
87

google-image

1
star
88

keybd_converter

1
star
89

hello-world

1
star
90

pm2.go

pm2 in Go
1
star
91

process-manager

process-manager let you start, maintain and kill the process.
1
star
92

qupac

QUIC + msgpack rules!!, darn fast RPC based on HTTP/3 & msgpack
1
star
93

Ciayo-Comics-Wordpress-Version

An Wordpress Version of ciayo comics
CSS
1
star
94

monopoly

1
star
95

GoTral-python

1
star
96

random-hitter-server

Random Hitter Server
1
star
97

fiber-recaptcha

Fiber reCAPTCHA Middleware, Auto detect, verify and abort c.FormValue("g-recaptcha-response")
Go
1
star
98

SnakesAndLadders

1
star
99

github-pm2-auto-deployer

1
star
100

gocar

1
star