nla/chronicrawl

This repository has been archived on 13/Jan/2023
Stars
9
Rank 1,939,727 (Top 39 %)
Language
Java
License
Apache License 2.0
Created over 4 years ago
Updated almost 2 years ago

nla/chronicrawl

nla

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Experimental continouous web crawler for web archiving

outbackcdx

Web archive index server based on RocksDB

httrack2warc

Converts HTTrack crawls to WARC files

chropro

Chrome debugging protocol client for Java

solrbackup

Python script for backing up a remote Solr 4 core or SolrCloud cluster

bamboo

Web archive collection manager

robinfs

Round-robin FUSE pass-through filesystem

nla-music-android

An Android app to explore the National Library's digital collection of sheet music

outbackproxy

HTTP/S proxy server which replays content from a web archive

pandas4

Web archive workflow system

solr-grouping

Two level grouping in a solr search.

pavo

Assorted JavaScript widgets for digital collection delivery.

nla-pywb

pywb config overlay for the Australian Web Archive

yaz

A clone of the YAZ Z39.50 library from http://git.indexdata.com/ to add support for scanning SOLR indexes.

jwebrenderer

Simple web service to render pages with headless chrome

ai-scout-pictures

AI pictures proof of concept - crawl blacklight, build SOLR index with CLIP embeddings, exploratory web interface

jvmctl

Java app deployment tool

nla-arclight

Custom implementation of ArcLight for The National Library of Australia.

jelly-solr

butterflynet

Streamline single-document web archiving tool

qemu-image-extractor

The QEMU Disk Image Extractor Thing

heritrixctl

Heritrix runner and API client for Java

ai-scout-imageSearchComparison

Simple website to capture evaluation of different ways to search images.