• Stars
    star
    1,409
  • Rank 33,381 (Top 0.7 %)
  • Language
  • Created about 8 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Technical specifications for the libp2p networking stack

libp2p specification

libp2p logo

Overview

This repository contains the specifications for libp2p, a framework and suite of protocols for building peer-to-peer network applications. libp2p has several implementations, with more in development.

The main goal of this repository is to provide accurate reference documentation for the aspects of libp2p that are independent of language or implementation. This includes wire protocols, addressing conventions, and other "network level" concerns.

For user-facing documentation, please see https://docs.libp2p.io

In addition to describing the current state of libp2p, the specs repository serves as a coordination point and a venue to drive future developments in libp2p. For the short and long term roadmap see ROADMAP.md. To participate in the evolution of libp2p via the specs process, please see the Contributions section.

Status

The specifications for libp2p are currently incomplete, and we are working to address this by revising existing specs to ensure correctness and writing new specifications to detail currently unspecified parts of libp2p.

This document replaces an earlier RFC, which still contains much useful information and is helpful for understanding the libp2p design philosophy. It is avaliable at _archive/README.md.

Specification Index

This index contains links to all the spec documents that are currently merged. If documents are moved to new locations within the repository, this index will be updated to reflect the new locations.

Specs Framework

These specs define processes for the specification framework itself, such as the expected lifecycle and document formatting.

Core Abstractions and Types

These specs define abstractions and data types that form the "core" of libp2p and are used throughout the system.

  • Addressing - Working with addresses in libp2p.
  • Connections and Upgrading - Establishing secure, multiplexed connections between peers, possibly over insecure, single stream transports.
  • Peer Ids and Keys - Public key types & encodings, peer id calculation, and message signing semantics

Protocols

These specs define wire protocols that are used by libp2p for connectivity, security, multiplexing, and other purposes.

The protocols described below all use protocol buffers (aka protobuf) to define message schemas.

Existing protocols may use proto2, and continue to use them. proto3 is recommended for new protocols. proto3 is a simplification of proto2 and removes some footguns. For context and a discussion around proto3 vs proto2, see #465.

  • ping - Ping protocol
  • autonat - NAT detection
  • identify - Exchange keys and addresses with other peers
  • kademlia - The Kademlia Distributed Hash Table (DHT) subsystem
  • mdns - Local peer discovery with zero configuration using multicast DNS
  • mplex - The friendly stream multiplexer
  • yamux - Yet Another Multiplexer
  • noise - The libp2p Noise handshake
  • plaintext - An insecure transport for non-production usage
  • pnet - Private networking in libp2p using pre-shared keys
  • pubsub - PubSub interface for libp2p
    • gossipsub - An extensible baseline PubSub protocol
      • episub - Proximity Aware Epidemic PubSub for libp2p
  • relay - Circuit Switching for libp2p (similar to TURN)
    • dcutr - Direct Connection Upgrade through Relay protocol
  • rendezvous - Rendezvous Protocol for generalized peer discovery
  • secio - SECIO, a transport security protocol for libp2p
  • tls - The libp2p TLS Handshake (TLS 1.3+)
  • quic - The libp2p QUIC Handshake
  • webrtc - The libp2p WebRTC transports
  • WebTransport - Using WebTransport in libp2p

Contributions

Thanks for your interest in improving libp2p! We welcome contributions from all interested parties. Please take a look at the Spec Lifecycle document to get a feel for how the process works, and open an issue if there's work you'd like to discuss.

For discussions about libp2p that aren't specific to a particular spec, or if you feel an issue isn't the appropriate place for your topic, please join our discussion forum and post a new topic in the contributor's section.

More Repositories

1

go-libp2p

libp2p implementation in Go
Go
6,012
star
2

rust-libp2p

The Rust Implementation of the libp2p networking stack.
Rust
3,768
star
3

libp2p

A modular and extensible networking stack which solves many challenges of peer-to-peer applications.
2,357
star
4

js-libp2p

The JavaScript Implementation of libp2p networking stack.
TypeScript
2,283
star
5

go-reuseport

reuse tcp/udp ports in golang
Go
681
star
6

go-libp2p-kad-dht

A Kademlia DHT implementation on go-libp2p
Go
485
star
7

py-libp2p

The Python implementation of the libp2p networking stack 🐍 [under development]
Python
460
star
8

cpp-libp2p

C++17 implementation of libp2p
C++
355
star
9

go-libp2p-examples

Example libp2p applications
339
star
10

js-libp2p-webrtc-star

libp2p WebRTC transport that includes a discovery mechanism provided by the signalling-star
TypeScript
320
star
11

go-libp2p-pubsub

The PubSub implementation for go-libp2p
Go
291
star
12

jvm-libp2p

a libp2p implementation for the JVM, written in Kotlin 🔥
Kotlin
257
star
13

rust-yamux

Multiplexer over reliable, ordered connections.
Rust
171
star
14

go-libp2p-core

Interfaces and abstractions that make up go-libp2p
Go
145
star
15

js-libp2p-kad-dht

JavaScript implementation of the DHT for libp2p
TypeScript
138
star
16

go-libp2p-swarm

The libp2p swarm manages groups of connections to peers, and handles incoming and outgoing streams
Go
114
star
17

go-libp2p-quic-transport

An implementation of a libp2p transport using QUIC
Go
113
star
18

js-libp2p-websockets

WebSockets module that libp2p uses and that implements the interface-transport spec
TypeScript
96
star
19

go-libp2p-daemon

a libp2p-backed daemon wrapping the functionalities of go-libp2p for use in other languages
Go
90
star
20

go-libp2p-peerstore

an object to manage sets of peers, their addresses and other metadata
Go
90
star
21

hydra-booster

A DHT Indexer node & Peer Router
Go
87
star
22

universal-connectivity

Realtime decentralised chat with libp2p showing ubiquitous peer-to-peer connectivity between multiple programming languages (Go, Rust, TypeScript) and runtimes (Web, native binary) using QUIC, WebRTC and WebTransport
TypeScript
85
star
23

go-libp2p-webrtc-direct

A libp2p transport that enables browser-to-server, and server-to-server, direct communication over WebRTC without requiring signalling servers
Go
82
star
24

js-libp2p-crypto

The libp2p crypto primitives, for Node.js and the Browser!
TypeScript
80
star
25

js-peer-id

peer-id implementation in JavaScript. Deprecated; use https://github.com/libp2p/js-libp2p-peer-id instead.
JavaScript
80
star
26

js-libp2p-webrtc-direct

Dial using WebRTC without the need to set up any Signalling Rendezvous Point!
TypeScript
78
star
27

research-pubsub

Research on PubSub algorithms for libp2p
76
star
28

js-libp2p-tcp

JavaScript implementation of the TCP module that libp2p uses that implements the interface-transport spec
TypeScript
76
star
29

js-libp2p-interfaces

Contains test suites and interfaces you can use to implement the various components of js libp2p.
TypeScript
75
star
30

go-buffer-pool

Go
71
star
31

js-libp2p-examples

Examples for the JS implementation of libp2p
70
star
32

go-libp2p-raft

A LibP2P wrapper for hashicorp/raft implementation.
Go
64
star
33

go-libp2p-nat

NAT port mapping library for go-libp2p
Go
63
star
34

go-libp2p-http

HTTP on top of libp2p
Go
62
star
35

go-ws-transport

a websocket implementation of a go-libp2p transport
Go
60
star
36

go-tcp-transport

An implementation of a libp2p transport using tcp
Go
59
star
37

docs

Documentation site for the libp2p project.
HTML
59
star
38

go-libp2p-gorpc

A simple RPC library for libp2p.
Go
57
star
39

go-libp2p-discovery

Active Peer Discovery
Go
53
star
40

go-libp2p-autonat

DEPRECATED: NAT Autodiscovery
Go
53
star
41

js-libp2p-mplex

JavaScript implementation of https://github.com/libp2p/mplex
TypeScript
52
star
42

js-libp2p-mdns

libp2p MulticastDNS Peer Discovery
TypeScript
51
star
43

punchr

🥊 Components to measure Direct Connection Upgrade through Relay (DCUtR) performance.
Jupyter Notebook
49
star
44

go-netroute

Routing table abstraction library
Go
48
star
45

test-plans

Interoperability tests for libp2p
TypeScript
48
star
46

go-libp2p-kbucket

A kbucket implementation for use as a routing table
Go
47
star
47

js-libp2p-switch

[DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo
JavaScript
47
star
48

go-libp2p-circuit

Circuit Switching for libp2p
Go
47
star
49

js-libp2p-floodsub

Also known as pubsub-flood or just dumbsub, this implementation of pubsub focused on delivering an API for Publish/Subscribe, but with no CastTree Forming (it just floods the network).
TypeScript
47
star
50

go-libp2p-secio

a minimal secure channel for libp2p
Go
44
star
51

go-libp2p-peer

[DEPRECATED] PKI based identities for use in go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
41
star
52

go-libp2p-crypto

[DEPRECATED] Various cryptographic utilities used by libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
40
star
53

devgrants

want to hack on libp2p? this repo tracks libp2p endeavors eligible for incentivization.
40
star
54

js-libp2p-websocket-star

libp2p-webrtc-star without webrtc. Just plain socket.io.
JavaScript
39
star
55

go-mplex

A port of maxogden's multiplex to go
Go
38
star
56

js-libp2p-webrtc

TypeScript
38
star
57

js-peer-info

libp2p Peer abstraction Node.js implementation
JavaScript
37
star
58

notes

libp2p Collaborative Notebook for Research
37
star
59

interface-transport

⛔️ DEPRECATED: interface-transport is now included in https://github.com/libp2p/js-interfaces
JavaScript
35
star
60

repl

[toy project 🎈] a libp2p interactive shell
Go
34
star
61

website

Webpage of the libp2p project. A multi protocol approach for a interoperable network stack that follows the 'self description' in favor of assumptions
Less
34
star
62

go-stream-muxer

[DEPRECATED] stream multiplexer interface; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
33
star
63

xtp

XTP - eXternal Transports Protocol
33
star
64

go-libp2p-noise

a secure channel for go-libp2p based on the Noise protocol framework
Go
33
star
65

go-libp2p-net

[DEPRECATED] Network interfaces for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
32
star
66

js-libp2p-secio

libp2p SECIO
JavaScript
30
star
67

js-libp2p-bootstrap

Rail a libp2p node through a bootstrap peer list
TypeScript
30
star
68

go-libp2p-transport

[DEPRECATED] libp2p transport code; moved to https://github.com/libp2p/go-libp2p-core/ and https://github.com/libp2p/go-libp2p-testing/
Go
30
star
69

interface-stream-muxer

⛔️ DEPRECATED: interface-stream-muxer is now included in https://github.com/libp2p/js-interfaces
JavaScript
29
star
70

go-yamux

Go
27
star
71

go-libp2p-relay-daemon

A standalone libp2p circuit relay daemon providing relay service for version v2 of the protocol.
Go
25
star
72

go-libp2p-routing

[DEPRECATED] a collection of routing interfaces for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
24
star
73

js-libp2p-websocket-star-rendezvous

The rendezvous service for libp2p-websocket-star enabled nodes meet and talk with each other
JavaScript
24
star
74

go-libp2p-gostream

Go "net" wrappers for libp2p
Go
23
star
75

go-libp2p-record

signed records for use with routing systems
Go
22
star
76

go-libp2p-pubsub-router

Go
22
star
77

testlab

A testlab built with Nomad and Consul to analyze the behavior of p2p networks at scale
Go
22
star
78

workspace-go-libp2p

workspace for go-libp2p contributors
Shell
21
star
79

research-dht

Moved discussion notes to https://github.com/libp2p/notes
21
star
80

go-libp2p-connmgr

a resource sentinel that keeps connection count under reasonable bounds
Go
20
star
81

demo-multi-lang

Simple libp2p demos implemented in Go, JS and Rust
Go
20
star
82

js-libp2p-pubsub

Pubsub base protocol for libp2p pubsub routers
TypeScript
19
star
83

js-libp2p-keychain

Key management and cryptographically protected messages
TypeScript
19
star
84

go-libp2p-host

[DEPRECATED] The host interface for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
19
star
85

go-libp2p-consensus

A consensus interface for LibP2P
Go
19
star
86

go-sockaddr

DEPRECATED - Go Sockaddr -> RawSockaddr conversions
Go
19
star
87

js-libp2p-circuit

[DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo
JavaScript
19
star
88

interface-connection

⛔️ DEPRECATED: interface-connection is now included in https://github.com/libp2p/js-interfaces
JavaScript
18
star
89

go-libp2p-transport-upgrader

Go
17
star
90

js-libp2p-record

Implementation of go-libp2p-record in JavaScript
TypeScript
17
star
91

js-libp2p-delegated-peer-routing

Leverage other peers in the network to perform Peer Routing calls.
TypeScript
16
star
92

interop

Interoperability tests for libp2p Implementations
TypeScript
16
star
93

js-peer-book

[DEPRECATED]: peer-book is now at https://github.com/libp2p/js-libp2p/tree/master/src/peer-store as PeerStore
JavaScript
16
star
94

go-libp2p-tls

go-libp2p's TLS encrypted transport
Go
16
star
95

js-libp2p-daemon

A js-libp2p backed daemon
TypeScript
15
star
96

go-libp2p-coral-dht

golang implementation of the CoralDHT protocol
Go
15
star
97

js-libp2p-webtransport

WebTranport module that libp2p uses and that implements the interface-transport spec
TypeScript
15
star
98

go-eventbus

a simple and fast eventbus for type-based local event delivery.
Go
15
star
99

js-libp2p-connection-manager

[DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo
JavaScript
14
star
100

cs-libp2p-peer

LibP2P Peer
C#
14
star