Discover webrecorder/sup-digital-web-archives Open Source project

A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!

1,335

archiveweb.page

Serverless replay of web archives directly in the browser

787

replayweb.page

Run a high-fidelity browser-based crawler in a single Docker container

678

browsertrix-crawler

Webrecorder Player for Desktop (OSX/Windows/Linux). (Built with Electron + Webrecorder)

547

webrecorder-player

Streaming WARC/ARC library for fast web archive IO

423

warcio

345

webrecorder-desktop

Webrecorder Desktop App!

Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

201

browsertrix

Specifications developed and maintained by the Webrecorder community.

158

specs

HTML

117

wabac.js

wabac.js - Web Archive Browsing Augmentation Client

Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System

browsertrix-old

Wombat.js client-side rewriting library

wombat

Convert Directories, Files and ZIP Files to Web Archives (WARC)

warcit

Convert HTTP Archive (HAR) -> Web Archive (WARC) format

har2warc

A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format

public-web-archives

py-wacz

JS Streaming WARC IO optimized for Browser and Node

warcio.js

Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.

browsertrix-behaviors

Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application

archiveweb.page-site

The ArchiveWeb.page Site

HTML

wsgiprox

CDXJ Indexing of WARC/ARCs

cdxj-indexer

Static Site Generator for Viewing Web Archives (in WACZ) format

web-replay-gen

A Cloudflare Worker to render embeds on a single page using oEmbed

oembed.link

A prototype server to swarm multiple DATs for Webrecorder

dat-share

Docker Compose based system for running remote browsers (including Flash and Java support) connected to web archives

pywb-remote-browsers

A Github Action for turning Markdown into ReSpec HTML

markdown-to-respec

Webrecorder Automated In-Page Behavior Framework

behaviors

A S3 hybrid storage interface for dat and hyperdrive

dat-s3-hybrid-storage

express.archiveweb.page

ArchiveWeb.page Express!

Specification for authentication and creating signed WACZ Files

wacz-auth-spec

platform-spec

Discussion of the broader Webrecorder platform spec

autobrowser

authsign

This is an example web archive using the ReplayWebPage component.

example-webarchive

HTML

save-tweet-now

Save Tweet Now (to IPFS)

Webrecorder Kubernetes-native Browser Ochestration

browserkube

QA tests for webrecorder player (WORK IN PROGRESS)

webrecorder-tests

Webrecorder Auto Archiver for Scalar Prototype

autoscalar

kubecaptures-backend

awp-sw

A straightforward single page application for uploading your WACZ archives to IPFS

browsertrix-browser-base

Dockerfile

wacz-uploader

CORS proxy for use with wabac.js-based tools

wabac-cors-proxy

CLI and library for create composite files in IPFS

ipfs-composite-files

wabac.js-1.0

Conver WACZ files to CAR files for uploading to IPFS.

wacz2car

(Deprecated) Old Webrecorder proxy component based on mitmproxy

proxy

Webrecorder Community Info

community

kubecaptures-ui

Browsertrix Crawler driver for Mapbox maps

mapbox-driver

Custom drivers for browsertrix crawler

dashboard-custom-drivers