mafintosh/awesome-p2p

Stars
301
Rank 138,451 (Top 3 %)
Language
Created almost 8 years ago
Updated over 1 year ago

mafintosh/awesome-p2p

mafintosh

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

List of great p2p resources

Awesome P2P

A list of great resources on p2p things. The content here is curated by me, @mafintosh but please open PRs with suggestions.

Protocols

Existing systems that I really like for the simplicity and ingenuity

Data integrity / authentication

Ways of securing / verifying data when receiving it from untrusted peers

DHT / Peer discovery

In a distributed system finding other peers interested in the same topic as you is usually an important step.

Kademlia. Probably the simplest DHT out and a very well written paper. Use the key value store to point p2p key -> ip:port for discovery

Connectivity

How to connect to other peers

ZeroTier blog post about hole punching

peerflix

Streaming torrent client for node.js

playback

Video player built using electron and node.js

torrent-stream

The low level streaming torrent engine that peerflix uses

why-is-node-running

Node is running but you don't know why? why-is-node-running is here to help you.

chromecasts

Query your local network for Chromecasts and have them play media

csv-parser

Streaming csv parser inspired by binary-csv that aims to be faster than everyone else

torrent-mount

Mount a torrent (or magnet link) as a filesystem in real time using torrent-stream and fuse. AKA MAD SCIENCE!

turbo-http

Blazing fast low level http server

is-my-json-valid

A JSONSchema validator that uses code generation to be extremely fast

pump

pipe streams together and close all of them if one of them closes

airpaste

A 1-1 network pipe that auto discovers other peers using mdns

hyperdb

Distributed scalable database

protocol-buffers

Protocol Buffers for Node.js

signalhub

Simple signalling server that can be used to coordinate handshaking with webrtc or other fun stuff.

turbo-json-parse

Turbocharged JSON.parse for type stable JSON data

turbo-net

Low level TCP library for Node.js

peercast

torrent-stream + chromecast

hyperbeam

A 1-1 end-to-end encrypted internet pipe powered by Hyperswarm

multicast-dns

Low level multicast-dns implementation in pure javascript

hyperlog

Merkle DAG that replicates based on scuttlebutt logs and causal linking

hypervision

webcat

Mad science p2p pipe across the web using webrtc that uses your Github private/public key for authentication and a signalhub for discovery

tar-stream

tar-stream is a streaming tar parser and generator.

webrtc-swarm

Create a swarm of p2p connections using webrtc and a signalhub

discovery-swarm

A network swarm that uses discovery-channel to find peers

tar-fs

fs bindings for tar-stream

torrent-docker

MAD SCIENCE realtime boot of remote docker images using bittorrent

fuse-bindings

Notice: We published the successor module to this here https://github.com/fuse-friends/fuse-native

peerwiki

all of wikipedia on bittorrent

hyperfs

A content-addressable union file system build on top of fuse, hyperlog, leveldb and node

respawn

Spawn a process and restart it if it crashes

pumpify

Combine an array of streams into a single duplex stream using pump and duplexify

polo

Polo is a zero configuration service discovery module written completely in Javascript.

benny-hill

Play the Benny Hill theme while running another command

streamx

An iteration of the Node.js core streams with a series of improvements.

mp4-stream

Streaming mp4 encoder and decoder

hyperphone

A telephone over Hyperbeam

flat-file-db

Fast in-process flat file database that caches all data in memory

diffy

A tiny framework for building diff based interactive command line tools.

dns-discovery

Discovery peers in a distributed system using regular dns and multicast dns.

duplexify

Turn a writable and readable stream into a streams2 duplex stream with support for async initialization and streams1/streams2 input

browser-server

A HTTP "server" in the browser that uses a service worker to allow you to easily send back your own stream of data.

browserify-fs

fs for the browser using level-filesystem and browserify

ims

Install My Stuff - an opinionated npm module installer

dns-packet

An abstract-encoding compliant module for encoding / decoding DNS packets

jitson

Just-In-Time JSON.parse compiler

dnsjack

A simple DNS proxy that lets you intercept domains and route them to whatever IP you decide.

nanobench

Simple benchmarking tool with TAP-like output that is easy to parse

localcast

A shared event emitter that works across multiple processes on the same machine, including the browser!

level-filesystem

Full implementation of the fs module on top of leveldb

dht-rpc

Make RPC calls over a Kademlia based DHT.

tetris

Play tetris in your terminal - in color

hyperssh

Run SSH over hyperswarm!

end-of-stream

Call a callback when a readable/writable/duplex stream has completed or failed.

flat-tree

A series of functions to map a binary tree to a list

lil-pids

Dead simple process manager with few features

airswarm

Network swarm that automagically discovers other peers on the network using multicast dns

wat2js

Compile WebAssembly .wat files to a common js module

node-modules

Search for node modules

ssh-exec

Execute a script over ssh using Node.JS

add-to-systemd

Small command line tool to simply add a service to systemd

deejay

Music player that broadcasts to everyone on the same network

protocol-buffers-schema

No nonsense protocol buffers schema parser written in Javascript

tree-to-string

Convert a tree structure into a human friendly string

unordered-array-remove

Efficiently remove an element from an unordered array without doing a splice

hyperpipe

Distributed input/output pipe.

abstract-chunk-store

A test suite and interface you can use to implement a chunk based storage backend

shared-structs

Share a struct backed by the same underlying buffer between C and JavaScript

mininet

Spin up and interact with virtual networks using Mininet and Node.js

p2p-workshop

a workshop to learn about p2p

jsonkv

Single file write-once database that is valid JSON with efficient random access on bigger datasets

ansi-diff-stream

A transform stream that diffs input buffers and outputs the diff as ANSI. If you pipe this to a terminal it will update the output with minimal changes

browser-sync-stream

Rsync between a server and the browser.

docker-registry-server

docker registry server in node.js

dns-socket

Make custom low-level DNS requests from node with retry support.

utp-native

Native bindings for libutp

taco-nginx

Bash script that runs a service and forwards a subdomain to it using nginx when it listens to $PORT

gunzip-maybe

Transform stream that gunzips its input if it is gzipped and just echoes it if not

merkle-tree-stream

A stream that generates a merkle tree based on the incoming data.

media-recorder-stream

The Media Recorder API in the browser as a readable stream

thunky

Delay the evaluation of a paramless async function and cache the result

peervision

a live p2p streaming protocol

noise-network

Authenticated P2P network backed by Hyperswarm and Noise

soundcloud-to-dat

Download all music from a Soundcloud url and put it into a Dat

blecat

1-1 pipe over bluetooth low energy

debugment

A debug comment -> debugment

hyperdht

A DHT that supports peer discovery and distributed hole punching

docker-browser-console

Forward input/output from docker containers to your browser

srt-to-vtt

Transform stream that converts srt files to vtt files (html5 video subtitles)

speedometer

speed measurement in javascript

mutexify

Bike shed mutex lock implementation

p2p-file-sharing-workshop

A workshop where you learn about distributed file sharing

mirror-folder

Small module to mirror a folder to another folder. Supports live mode as well.

utp

utp (micro transport protocol) implementation in node

echo-servers.c

A collection of various echo servers in c

recursive-watch

Minimal recursive file watcher

docker-browser-server

Spawn and expose docker containers over http and websockets

are-feross-and-mafintosh-stuck-in-an-elevator

Are @feross and @mafintosh stuck in an elevator?

parallel-transform

Transform stream for Node.js that allows you to run your transforms in parallel without changing the order

peer-wire-swarm

swarm implementation for bittorrent