• Stars
    star
    291
  • Rank 137,757 (Top 3 %)
  • Language
    Go
  • License
    Other
  • Created over 7 years ago
  • Updated 9 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

The PubSub implementation for go-libp2p

go-libp2p-pubsub


This repo contains the canonical pubsub implementation for libp2p. We currently provide three message router options:

  • Floodsub, which is the baseline flooding protocol.
  • Randomsub, which is a simple probabilistic router that propagates to random subsets of peers.
  • Gossipsub, which is a more advanced router with mesh formation and gossip propagation. See spec and implementation for more details.

Repo Lead Maintainer

@vyzo

This repo follows the Repo Lead Maintainer Protocol

Table of Contents

Install

go get github.com/libp2p/go-libp2p-pubsub

Usage

To be used for messaging in p2p instrastructure (as part of libp2p) such as IPFS, Ethereum, other blockchains, etc.

Example

https://github.com/libp2p/go-libp2p/tree/master/examples/pubsub

Documentation

See the libp2p specs for high level documentation and godoc for API documentation.

In this repo, you will find

.
β”œβ”€β”€ LICENSE
β”œβ”€β”€ README.md
# Regular Golang repo set up
β”œβ”€β”€ codecov.yml
β”œβ”€β”€ pb
β”œβ”€β”€ go.mod
β”œβ”€β”€ go.sum
β”œβ”€β”€ doc.go
# PubSub base
β”œβ”€β”€ pubsub.go
β”œβ”€β”€ blacklist.go
β”œβ”€β”€ notify.go
β”œβ”€β”€ comm.go
β”œβ”€β”€ discovery.go
β”œβ”€β”€ sign.go
β”œβ”€β”€ subscription.go
β”œβ”€β”€ topic.go
β”œβ”€β”€ trace.go
β”œβ”€β”€ tracer.go
β”œβ”€β”€ validation.go
# Floodsub router
β”œβ”€β”€ floodsub.go
# Randomsub router
β”œβ”€β”€ randomsub.go
# Gossipsub router
β”œβ”€β”€ gossipsub.go
β”œβ”€β”€ score.go
β”œβ”€β”€ score_params.go
└── mcache.go

Tracing

The pubsub system supports tracing, which collects all events pertaining to the internals of the system. This allows you to recreate the complete message flow and state of the system for analysis purposes.

To enable tracing, instantiate the pubsub system using the WithEventTracer option; the option accepts a tracer with three available implementations in-package (trace to json, pb, or a remote peer). If you want to trace using a remote peer, you can do so using the traced daemon from go-libp2p-pubsub-tracer. The package also includes a utility program, tracestat, for analyzing the traces collected by the daemon.

For instance, to capture the trace as a json file, you can use the following option:

tracer, err := pubsub.NewJSONTracer("/path/to/trace.json")
if err != nil {
  panic(err)
}

pubsub.NewGossipSub(..., pubsub.WithEventTracer(tracer))

To capture the trace as a protobuf, you can use the following option:

tracer, err := pubsub.NewPBTracer("/path/to/trace.pb")
if err != nil {
  panic(err)
}

pubsub.NewGossipSub(..., pubsub.WithEventTracer(tracer))

Finally, to use the remote tracer, you can use the following incantations:

// assuming that your tracer runs in x.x.x.x and has a peer ID of QmTracer
pi, err := peer.AddrInfoFromP2pAddr(ma.StringCast("/ip4/x.x.x.x/tcp/4001/p2p/QmTracer"))
if err != nil {
  panic(err)
}

tracer, err := pubsub.NewRemoteTracer(ctx, host, pi)
if err != nil {
  panic(err)
}

ps, err := pubsub.NewGossipSub(..., pubsub.WithEventTracer(tracer))

Contribute

Contributions welcome. Please check out the issues.

Check out our contributing document for more information on how we work, and about contributing in general. Please be aware that all interactions related to multiformats are subject to the IPFS Code of Conduct.

Small note: If editing the README, please conform to the standard-readme specification.

License

The go-libp2p-pubsub project is dual-licensed under Apache 2.0 and MIT terms:

More Repositories

1

go-libp2p

libp2p implementation in Go
Go
5,462
star
2

rust-libp2p

The Rust Implementation of the libp2p networking stack.
Rust
3,768
star
3

libp2p

A modular and extensible networking stack which solves many challenges of peer-to-peer applications.
2,357
star
4

js-libp2p

The JavaScript Implementation of libp2p networking stack.
TypeScript
2,141
star
5

specs

Technical specifications for the libp2p networking stack
1,409
star
6

go-reuseport

reuse tcp/udp ports in golang
Go
681
star
7

go-libp2p-kad-dht

A Kademlia DHT implementation on go-libp2p
Go
485
star
8

py-libp2p

The Python implementation of the libp2p networking stack 🐍 [under development]
Python
444
star
9

go-libp2p-examples

Example libp2p applications
339
star
10

cpp-libp2p

C++17 implementation of libp2p
C++
336
star
11

js-libp2p-webrtc-star

libp2p WebRTC transport that includes a discovery mechanism provided by the signalling-star
TypeScript
320
star
12

jvm-libp2p

a libp2p implementation for the JVM, written in Kotlin πŸ”₯
Kotlin
242
star
13

rust-yamux

Multiplexer over reliable, ordered connections.
Rust
162
star
14

go-libp2p-core

Interfaces and abstractions that make up go-libp2p
Go
145
star
15

js-libp2p-kad-dht

JavaScript implementation of the DHT for libp2p
TypeScript
138
star
16

go-libp2p-swarm

The libp2p swarm manages groups of connections to peers, and handles incoming and outgoing streams
Go
114
star
17

go-libp2p-quic-transport

An implementation of a libp2p transport using QUIC
Go
112
star
18

js-libp2p-websockets

WebSockets module that libp2p uses and that implements the interface-transport spec
TypeScript
96
star
19

go-libp2p-peerstore

an object to manage sets of peers, their addresses and other metadata
Go
90
star
20

go-libp2p-daemon

a libp2p-backed daemon wrapping the functionalities of go-libp2p for use in other languages
Go
88
star
21

hydra-booster

A DHT Indexer node & Peer Router
Go
82
star
22

go-libp2p-webrtc-direct

A libp2p transport that enables browser-to-server, and server-to-server, direct communication over WebRTC without requiring signalling servers
Go
81
star
23

js-libp2p-crypto

The libp2p crypto primitives, for Node.js and the Browser!
TypeScript
80
star
24

js-peer-id

peer-id implementation in JavaScript. Deprecated; use https://github.com/libp2p/js-libp2p-peer-id instead.
JavaScript
80
star
25

js-libp2p-webrtc-direct

Dial using WebRTC without the need to set up any Signalling Rendezvous Point!
TypeScript
78
star
26

research-pubsub

Research on PubSub algorithms for libp2p
76
star
27

js-libp2p-tcp

JavaScript implementation of the TCP module that libp2p uses that implements the interface-transport spec
TypeScript
76
star
28

js-libp2p-interfaces

Contains test suites and interfaces you can use to implement the various components of js libp2p.
TypeScript
75
star
29

go-buffer-pool

Go
70
star
30

js-libp2p-examples

Examples for the JS implementation of libp2p
64
star
31

go-libp2p-nat

NAT port mapping library for go-libp2p
Go
63
star
32

go-libp2p-raft

A LibP2P wrapper for hashicorp/raft implementation.
Go
63
star
33

go-ws-transport

a websocket implementation of a go-libp2p transport
Go
60
star
34

docs

Documentation site for the libp2p project.
HTML
60
star
35

universal-connectivity

Realtime decentralised chat with libp2p showing ubiquitous peer-to-peer connectivity between multiple programming languages (Go, Rust, TypeScript) and runtimes (Web, native binary) using QUIC, WebRTC and WebTransport
TypeScript
60
star
36

go-tcp-transport

An implementation of a libp2p transport using tcp
Go
59
star
37

go-libp2p-http

HTTP on top of libp2p
Go
59
star
38

go-libp2p-gorpc

A simple RPC library for libp2p.
Go
55
star
39

go-libp2p-discovery

Active Peer Discovery
Go
53
star
40

go-libp2p-autonat

DEPRECATED: NAT Autodiscovery
Go
53
star
41

js-libp2p-mplex

JavaScript implementation of https://github.com/libp2p/mplex
TypeScript
52
star
42

js-libp2p-mdns

libp2p MulticastDNS Peer Discovery
TypeScript
51
star
43

go-libp2p-kbucket

A kbucket implementation for use as a routing table
Go
47
star
44

punchr

πŸ₯Š Components to measure Direct Connection Upgrade through Relay (DCUtR) performance.
Jupyter Notebook
47
star
45

js-libp2p-switch

[DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo
JavaScript
47
star
46

go-libp2p-circuit

Circuit Switching for libp2p
Go
47
star
47

js-libp2p-floodsub

Also known as pubsub-flood or just dumbsub, this implementation of pubsub focused on delivering an API for Publish/Subscribe, but with no CastTree Forming (it just floods the network).
TypeScript
47
star
48

go-netroute

Routing table abstraction library
Go
44
star
49

test-plans

Interoperability tests for libp2p
TypeScript
44
star
50

go-libp2p-secio

a minimal secure channel for libp2p
Go
44
star
51

go-libp2p-peer

[DEPRECATED] PKI based identities for use in go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
41
star
52

go-libp2p-crypto

[DEPRECATED] Various cryptographic utilities used by libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
40
star
53

js-libp2p-websocket-star

libp2p-webrtc-star without webrtc. Just plain socket.io.
JavaScript
39
star
54

devgrants

want to hack on libp2p? this repo tracks libp2p endeavors eligible for incentivization.
39
star
55

go-mplex

A port of maxogden's multiplex to go
Go
38
star
56

js-libp2p-webrtc

TypeScript
38
star
57

js-peer-info

libp2p Peer abstraction Node.js implementation
JavaScript
37
star
58

notes

libp2p Collaborative Notebook for Research
37
star
59

interface-transport

⛔️ DEPRECATED: interface-transport is now included in https://github.com/libp2p/js-interfaces
JavaScript
35
star
60

repl

[toy project 🎈] a libp2p interactive shell
Go
34
star
61

website

Webpage of the libp2p project. A multi protocol approach for a interoperable network stack that follows the 'self description' in favor of assumptions
Less
34
star
62

go-stream-muxer

[DEPRECATED] stream multiplexer interface; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
33
star
63

xtp

XTP - eXternal Transports Protocol
33
star
64

go-libp2p-noise

a secure channel for go-libp2p based on the Noise protocol framework
Go
33
star
65

go-libp2p-net

[DEPRECATED] Network interfaces for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
32
star
66

js-libp2p-bootstrap

Rail a libp2p node through a bootstrap peer list
TypeScript
30
star
67

js-libp2p-secio

libp2p SECIO
JavaScript
30
star
68

go-libp2p-transport

[DEPRECATED] libp2p transport code; moved to https://github.com/libp2p/go-libp2p-core/ and https://github.com/libp2p/go-libp2p-testing/
Go
30
star
69

interface-stream-muxer

⛔️ DEPRECATED: interface-stream-muxer is now included in https://github.com/libp2p/js-interfaces
JavaScript
29
star
70

go-libp2p-routing

[DEPRECATED] a collection of routing interfaces for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
24
star
71

js-libp2p-websocket-star-rendezvous

The rendezvous service for libp2p-websocket-star enabled nodes meet and talk with each other
JavaScript
24
star
72

go-libp2p-relay-daemon

A standalone libp2p circuit relay daemon providing relay service for version v2 of the protocol.
Go
24
star
73

go-libp2p-gostream

Go "net" wrappers for libp2p
Go
23
star
74

go-libp2p-record

signed records for use with routing systems
Go
22
star
75

go-libp2p-pubsub-router

Go
22
star
76

testlab

A testlab built with Nomad and Consul to analyze the behavior of p2p networks at scale
Go
22
star
77

workspace-go-libp2p

workspace for go-libp2p contributors
Shell
21
star
78

research-dht

Moved discussion notes to https://github.com/libp2p/notes
21
star
79

go-libp2p-connmgr

a resource sentinel that keeps connection count under reasonable bounds
Go
20
star
80

demo-multi-lang

Simple libp2p demos implemented in Go, JS and Rust
Go
20
star
81

go-yamux

Go
20
star
82

js-libp2p-pubsub

Pubsub base protocol for libp2p pubsub routers
TypeScript
19
star
83

go-libp2p-host

[DEPRECATED] The host interface for go-libp2p; use https://github.com/libp2p/go-libp2p-core/ instead.
Go
19
star
84

go-libp2p-consensus

A consensus interface for LibP2P
Go
19
star
85

go-sockaddr

DEPRECATED - Go Sockaddr -> RawSockaddr conversions
Go
19
star
86

js-libp2p-circuit

[DEPRECATED]: now part of the https://github.com/libp2p/js-libp2p repo
JavaScript
19
star
87

js-libp2p-keychain

Key management and cryptographically protected messages
TypeScript
18
star
88

interface-connection

⛔️ DEPRECATED: interface-connection is now included in https://github.com/libp2p/js-interfaces
JavaScript
18
star
89

go-libp2p-transport-upgrader

Go
17
star
90

js-libp2p-record

Implementation of go-libp2p-record in JavaScript
TypeScript
17
star
91

js-libp2p-delegated-peer-routing

Leverage other peers in the network to perform Peer Routing calls.
TypeScript
16
star
92

interop

Interoperability tests for libp2p Implementations
TypeScript
16
star
93

js-peer-book

[DEPRECATED]: peer-book is now at https://github.com/libp2p/js-libp2p/tree/master/src/peer-store as PeerStore
JavaScript
16
star
94

go-libp2p-tls

go-libp2p's TLS encrypted transport
Go
16
star
95

go-libp2p-coral-dht

golang implementation of the CoralDHT protocol
Go
15
star
96

js-libp2p-webtransport

WebTranport module that libp2p uses and that implements the interface-transport spec
TypeScript
15
star
97

go-eventbus

a simple and fast eventbus for type-based local event delivery.
Go
15
star
98

js-libp2p-daemon

A js-libp2p backed daemon
TypeScript
14
star
99

cs-libp2p-peer

LibP2P Peer
C#
14
star
100

interface-peer-discovery

⛔️ DEPRECATED: interface-peer-discovery is now included in https://github.com/libp2p/js-interfaces
JavaScript
14
star