• This repository has been archived on 16/Apr/2020
  • Stars
    star
    183
  • Rank 210,154 (Top 5 %)
  • Language
  • Created over 9 years ago
  • Updated over 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

[ARCHIVED] Repo to coordinate archival efforts with IPFS

This repository has been archived!

This IPFS-related repository has been archived, and all issues are therefore frozen. If you want to ask a question or open/continue a discussion related to this repo, please visit the official IPFS forums.

We archive repos for one or more of the following reasons:

  • Code or content is unmaintained, and therefore might be broken
  • Content is outdated, and therefore may mislead readers
  • Code or content evolved into something else and/or has lived on in a different place
  • The repository or project is not active in general

Please note that in order to keep the primary IPFS GitHub org tidy, most archived repos are moved into the ipfs-inactive org.

If you feel this repo should not be archived (or portions of it should be moved to a non-archived repo), please reach out and let us know. Archiving can always be reversed if needed.


IPFS Archives (archives)

banner

Repo to coordinate archival efforts with IPFS

One of the fundamental goals of IPFS is to improve archival storage of humanity's public record. This is a critically important endeavor. In particular, our highest priority is research artifacts -- scientific publications, data repositories, wikipedia, etc.

This repo helps us organize efforts. See the efforts in the issues.

Table of Contents

Improving on the status quo of Archival

IPFS improves data storage

  • Chunking: IPFS employs a clever chunking strategy: by default it uses Rabin Fingerprint chunking, a content-driven chunking algorithm that optimizes for finding duplicate data blocks. Chunking is also modular, so users can chunk data in whatever way is most useful to them. (we may employ diff-chunking in the future). This is particularly useful for special chunking of audio and video media.
  • Deduplication: the chunking strategy allows IPFS to deduplicate vast amounts of data in large repositories.
  • Cryptographic Integrity: the integrity of the data is protected and guaranteed by cryptography. Bitrot will be caught and not passed to the user.

IPFS improves distribution

  • Bandwidth Sharing: as a meshing protocol, IPFS can use the bandwidth of replicas, which act like seeds in a swarm, NOT traditional HTTP mirrors. These can be dedicated systems, or even users currently viewing the files. This reduces the bandwidth usage for servers, and improves the download bandwidth for end users.
  • Speed: IPFS achieves blazing fast speeds and great bandwidth utilization by leveraging immutability, cryptographic integrity checks, and data locality in the network.
  • Replication: it is easy to replicate an archive: ipfs daemon --init & ipfs pin add -r <path>. One needs only to follow the HEAD of the archive (a hash reference), and retrieve the latest additions to an archive. (Today in git, in the future in an IPNS name).
  • Collaboration: the distribution model makes it extremely easy (one command) to replicate an archive for safe-keeping, and contribute bandwidth to the effort of serving it to others.

Current Projects

Current archival efforts are being coordinated via issues.

Feel free to suggest other open-access archives by opening a new issue. [However, please ensure that data is under an appropriate license (such as Creative Commons), or you have obtained proper permission, before copying it to IPFS.]

Some suggestions for possible future archival efforts can be found here.

Examples

(TODO finish README)

Maintainers

Captain: @flyingzumwalt

If you're interested in captaining this repo, open an issue!

Contribute

Feel free to join in! Look at the existing discussions in the issues, or open an issue if you want to talk about something new. All welcome.

Want to hack on IPFS?

License

CC-BY 3.0 © 2016 Protocol Labs Inc.

More Repositories

1

js-ipfs-http-client

[ARCHIVED] now part of the https://github.com/ipfs/js-ipfs repo
JavaScript
1,050
star
2

research-CRDT

[ARCHIVED] Repo to organize our ideas about research implementations of CRDTs.
484
star
3

reading-list

[ARCHIVED] Moved to https://docs.ipfs.io — papers to read to understand IPFS
TeX
225
star
4

interface-js-ipfs-core

[ARCHIVED] now part of the https://github.com/ipfs/js-ipfs repo
JavaScript
192
star
5

examples

[ARCHIVED] DEPRECATED — merged into IPFS docs
185
star
6

website

This repo has been replaced by https://github.com/ipfs/ipfs-website/
Less
182
star
7

faq

[ARCHIVED] DEPRECATED, please use https://discuss.ipfs.io! Frequently Asked Questions
164
star
8

blog

[ARCHIVED] Source for the IPFS Blog
CSS
98
star
9

package-managers

[ARCHIVED] 📦 IPFS Package Managers Task Force
97
star
10

docs

[ARCHIVED] 🤖 📚 IPFS documentation working group, plus IPFS docs site code
HTML
87
star
11

kubernetes-ipfs

[ARCHIVED] kubernetes-ipfs
Go
60
star
12

dynamic-data-and-capabilities

[ARCHIVED] Dynamic Data and Capabilities in IPFS Working Group
59
star
13

js-libp2p-ipfs-nodejs

[ARCHIVED] DEPRECATED — libp2p build (module) used in js-ipfs
JavaScript
42
star
14

bifrost-gateway

Experimental gateway with delegated backend. No longer maintained, consider migrating to https://github.com/ipfs/rainbow/
Go
41
star
15

http-api-docs

Documentation on IPFS HTTP API endpoints.
Go
39
star
16

js-libp2p-ipfs-browser

[ARCHIVED] DEPRECATED — libp2p build (module) used in js-ipfs when running it on the browser
JavaScript
37
star
17

old-js-ipfs-website

The Website for the JavaScript implementation of the IPFS protocol
HTML
35
star
18

ipfs.js

[ARCHIVED] See https://github.com/ipfs/js-ipfs
33
star
19

starlog

[ARCHIVED] [DEPRECATED] logging the development of an interplanetary filesystem
HTML
33
star
20

http-api-spec

[ARCHIVED] DEPRECATED — Apiary IPFS HTTP API description
API Blueprint
32
star
21

sig-blockchain-data

[ARCHIVED] Using IPFS for storing data for Blockchain apps.
32
star
22

conf

[ARCHIVED] IPFS Conf [PLACEHOLDER REPOSITORY]
28
star
23

js-ipfs-mfs

[ARCHIVED] now part of the https://github.com/ipfs/js-ipfs repo
JavaScript
28
star
24

POST

[ARCHIVED] POST - a datastructure for human communication
24
star
25

ipfs-postmsg-proxy

[DEPRECATED] Use ipfs-message-port-server/client instead:
JavaScript
24
star
26

ipfs-ui-style-guide

A UI style guide for IPFS Apps
JavaScript
22
star
27

support

[ARCHIVED] For questions on how to get IPFS up and running smoothly
22
star
28

js-ipfs-unixfs-engine

[ARCHIVED] JavaScript implementation of the layout and chunking mechanisms used by IPFS
JavaScript
22
star
29

ipfs-web-app

[ARCHIVED] DEPRECATED — ipfs-web-app tool
JavaScript
19
star
30

developer-meetings

[ARCHIVED] 2018 IPFS Developers Meeting in Berlin
17
star
31

npm-go-ipfs-dep

DEPRECATED by https://github.com/ipfs/npm-go-ipfs
JavaScript
16
star
32

file-browser

[ARCHIVED] generic-ipfs-file-browser-ui-thing
JavaScript
16
star
33

research-p2p-video

[ARCHIVED] Repo to organize our ideas about research and implementations Video applications on top of IPFS and libp2p
16
star
34

research-bitswap

[ARCHIVED] repo to organize research on bitswap
15
star
35

research

[ARCHIVED] Moved to https://github.com/ipfs/notes
14
star
36

ipfs-redux-bundle

[DEPRECATED] Use ipfs-provider instead:
JavaScript
13
star
37

logo

[ARCHIVED] IPFS logo
HTML
13
star
38

refs

[ARCHIVED] DMCA notices, and tools for publishing them
Go
12
star
39

2016-IPFS-Workshop-Lisbon

[ARCHIVED] Repo for the 2016 Q3 Workshop, in Lisbon and remote
12
star
40

go-iprs

[ARCHIVED] go-ipfs records
Go
12
star
41

pdd

[ARCHIVED] Protocol Driven Development
12
star
42

archive-format

[ARCHIVED] DEPRECATED — car - Certified ARchives
12
star
43

gx-workspace

[ARCHIVED] A gx tool for working with a big bunch of repositories/packages
Go
12
star
44

window.ipfs-fallback

[DEPRECATED] Use ipfs-provider instead:
JavaScript
11
star
45

RFC

[ARCHIVED] RFCs for changes to IPFS and its surrounding projects
11
star
46

user-research

[ARCHIVED] User research for the IPFS Project.
10
star
47

glossary

[ARCHIVED] A collection of descriptions for terms related to ipfs and surrounding techs
10
star
48

pm-test-lab

[ARCHIVED] DEPRECATED — check https://github.com/ipfs/testground/ for the latest
10
star
49

fs-stress-test

[ARCHIVED] IPFS Stress tests
Shell
10
star
50

benchmark-js.ipfs.io

[ARCHIVED] Benchmarking interface for js-ipfs
JavaScript
9
star
51

window.ipfs-is-required

Show a download link for IPFS Companion when window.ipfs is not detected.
JavaScript
8
star
52

ipfs-performance-profiling

[ARCHIVED] Benchmarking tests for js-ipfs, using go-ipfs as a baseline.
JavaScript
8
star
53

jenkins

[ARCHIVED] Configuration for IPFS's build system
HCL
8
star
54

project-operations

[ARCHIVED] The IPFS Project Operations Working Group
7
star
55

project-repos

[ARCHIVED] Project health metrics
CoffeeScript
7
star
56

js-ipfs-name

Publishing and resolving IPNS records
JavaScript
6
star
57

connections-globe

[ARCHIVED] An interactive globe to view all your IPFS peers
JavaScript
6
star
58

interface-pull-blob-store

[ARCHIVED] Test suite for pull-blob-stores
JavaScript
6
star
59

websiter

[ARCHIVED] Foundation and tool for managing websites around IPFS
HTML
5
star
60

ops-requests

[ARCHIVED] Requests about infrastructure operations
5
star
61

dweblink-infra

[ARCHIVED] DEPRECATED — Infrastructure for dweb.link
HCL
5
star
62

ipfs-pages

[ARCHIVED] Easy publishing of static web content on IPFS
5
star
63

js-ipfs-multipart

[ARCHIVED] A set of utilities to help dealing with IPFS multipart
JavaScript
5
star
64

bitswap-ml

[ARCHIVED] bitswap + ml
5
star
65

go-commands

[ARCHIVED] DEPRECATED — Commands library for go-ipfs
Go
5
star
66

go-blocks

[ARCHIVED] DEPRECATED — Blockservice and blockstore for go-ipfs
Go
5
star
67

js-ipfs-unixfs-importer

[ARCHIVED] JavaScript implementation of the UnixFs importer used by IPFS
JavaScript
5
star
68

go-ipfs-addr

[ARCHIVED] DEPRECATED - Parsing utility for ipfs multiaddrs
Go
5
star
69

community-call-helper

[ARCHIVED] Schedule a Community Sync Up via Github Issues
Vue
4
star
70

ci-sync

[ARCHIVED] CI dashboard for Protocol Labs projects
Go
4
star
71

js-docker-base

[ARCHIVED] Base image for JS projects
Shell
4
star
72

sprint-helper-bot

[ARCHIVED] A helper for sprints
JavaScript
4
star
73

dev-team-enablement

[ARCHIVED] Dev Team Enablement Working Group
3
star
74

ipfs-mans

[ARCHIVED] DEPRECATED: The IPFS CLI Manuals
JavaScript
3
star
75

ipfs-metrics

[ARCHIVED] ipfs-metrics is a tool for managing ipfs event log streams
Go
3
star
76

conf.ipfs.io

[ARCHIVED] The IPFS Conference & Developer Meetings Website
3
star
77

go-key

[ARCHIVED] DEPRECATED — ipfs block keys and related utilities
Go
2
star
78

go-ds-lru

[ARCHIVED] A datastore implementation that uses an lru to cache results from a different backing datastore
Go
2
star
79

ipfs-nodeschool

[ARCHIVED] The workshoper to go InterPlanetary 🌍🚀✨🌌
JavaScript
2
star
80

go-waffle

[ARCHIVED] Repo used to create a overview of all the Golang repos in waffle
2
star
81

jest-environment-aegir

[ARCHIVED] Jest Environment used in Aegir
JavaScript
2
star
82

jenkins-libs

[ARCHIVED] Reusable pipelines to be run on Jenkins
Groovy
2
star
83

badgerds-upgrade

[ARCHIVED] Badger datastore upgrade tool
Go
2
star
84

eslint-config-aegir

[ARCHIVED] Eslint Shareable Config for Aegir
JavaScript
2
star
85

node-github-issue-bot

[ARCHIVED] DEPRECATED — Automatically schedule and create GitHub issues
JavaScript
2
star
86

js-ipfs-unixfs-exporter

[ARCHIVED] JavaScript implementation of the UnixFs exporter used by IPFS
JavaScript
2
star
87

datatogether

[ARCHIVED] Old website for datatogether.org
HTML
2
star
88

ipfs-sharness-tests

[ARCHIVED] Sharness tests to test IPFS implementations
Shell
2
star
89

community-calls-reminder

[ARCHIVED] A script that reminds folks to sign up for community calls
JavaScript
1
star
90

aegir-test-repo

[ARCHIVED] A clone of js-ipfs-api that we use for testing aegir.
JavaScript
1
star
91

browser-process-platform

[ARCHIVED] Browser shim for Node.js process.platform.
JavaScript
1
star
92

go-ipfs-flags

[ARCHIVED] DEPRECATED - go-ipfs-flags groups go-ipfs configuration options used by several modules
Go
1
star
93

js-waffle

[ARCHIVED] Repo used to create a overview of all the JS repos in waffle
1
star