Discover webrecorder/public-web-archives Open Source project

A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!

1,366

archiveweb.page

Serverless replay of web archives directly in the browser

841

replayweb.page

Run a high-fidelity browser-based crawler in a single Docker container

693

browsertrix-crawler

Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)

547

webrecorder-player

Streaming WARC/ARC library for fast web archive IO

423

warcio

345

webrecorder-desktop

Webrecorder Desktop App!

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

201

browsertrix

Specifications developed and maintained by the Webrecorder community.

178

specs

wabac.js - Web Archive Browsing Augmentation Client

117

wabac.js

Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System

browsertrix-old

Wombat.js client-side rewriting library

wombat

Convert Directories, Files and ZIP Files to Web Archives (WARC)

warcit

Convert HTTP Archive (HAR) -> Web Archive (WARC) format

har2warc

JS Streaming WARC IO optimized for Browser and Node

warcio.js

py-wacz

Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.

browsertrix-behaviors

archiveweb.page-site

The ArchiveWeb.page Site

Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application

wsgiprox

CDXJ Indexing of WARC/ARCs

cdxj-indexer

Static Site Generator for Viewing Web Archives (in WACZ) format

web-replay-gen

A Cloudflare Worker to render embeds on a single page using oEmbed

oembed.link

A prototype server to swarm multiple DATs for Webrecorder

dat-share

Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives

pywb-remote-browsers

A Github Action for turning Markdown into ReSpec HTML

markdown-to-respec

Webrecorder Automated In-Page Behavior Framework

behaviors

A S3 hybrid storage interface for dat and hyperdrive

dat-s3-hybrid-storage

express.archiveweb.page

ArchiveWeb.page Express!

Specification for authentication and creating signed WACZ Files

wacz-auth-spec

platform-spec

Discussion of the broader Webrecorder platform spec

autobrowser

authsign

kubecaptures-backend

awp-sw

sup-digital-web-archives

A collection of self-hostable web archive built for Stanford University Press (SUP)

This is an example web archive using the ReplayWebPage component.

example-webarchive

save-tweet-now

Save Tweet Now (to IPFS)

Webrecorder Kubernetes-native Browser Ochestration

browserkube

QA tests for webrecorder player (WORK IN PROGRESS)

webrecorder-tests

Webrecorder Auto Archiver for Scalar Prototype

autoscalar

A straightforward single page application for uploading your WACZ archives to IPFS

browsertrix-browser-base

Dockerfile

wacz-uploader

CORS proxy for use with wabac.js-based tools

wabac-cors-proxy

CLI and library for create composite files in IPFS

ipfs-composite-files

wabac.js-1.0

Conver WACZ files to CAR files for uploading to IPFS.

wacz2car

(Deprecated) Old Webrecorder proxy component based on mitmproxy

proxy

Webrecorder Community Info

community

kubecaptures-ui

Browsertrix Crawler driver for Mapbox maps

mapbox-driver

Custom drivers for browsertrix crawler

dashboard-custom-drivers

sucho-web-archive