Discover caltechlibrary/datatools Open Source project

DIBS is an implementation of a basic controlled digital lending (CDL) system using IIIF to make scanned books available for time-limited viewing.

169

dibs

Automatically archive your repository's GitHub Pages in the Wayback Machine.

waystation

dataset is a command line tool, Go package, shared library and Python package for working with JSON objects as collections

dataset

sidewall

Sidewall is a Python library for interacting with the Dimensions search API.

Collection of common Python utility functions and classes used in other Caltech Library programs.

commonpy

A Python package for a basic CLI and GUI user interface

bun

Process Caltech Archives' digital documents and photos, and annotate each page or image with information about its contents

documentarist

Bad link reporter for GitHub repositories

baler

Python library for using the CaltechDATA API

caltechdata_api

Simple Python object-oriented interface for getting records from FOLIO

pokapi

Foliage is the FOLIo chAnGe Editor, a tool to do bulk changes in FOLIO using the network API.

foliage

The CaltechDATA InvenioRDM source code

caltechdata

IGA is the InvenioRDM GitHub Archiver, a standalone program as well as a GitHub Action that lets you automatically archive GitHub software releases in an InvenioRDM repository.

iga

Newt a microservice for integrating Postgres+PostgREST and Pandoc

newt

This repository includes an example of cloud-init YAML files for use with multipass VMs.

cloud-init-examples

Simple Python objects for getting data from TIND

topi

GitHub Action converting a codemeta file to CITATION.cff

codemeta2cff

template

Template repository for software projects by the Caltech Library

SCSS

cell-atlas

Cell atlas

TeX

ames

Automated Metadata Service

coif

Cover image finder

Transform Eprints XML to DataCite XML and mint DOIs in Eprints repositories

epxml_to_datacite

Boffo is an add-on for Google Sheets written by the Caltech Library. It lets you select item barcodes in a spreadsheet and retrieve information about the item records from a FOLIO server.

boffo

Find the ultimate destination for URLs after following redirections.

urlup

A simple encoder/decoder for converting object identifiers into a Pair Tree Path (path)

pairtree

turf

Turf ("TIND.io URL Fixer") is a program to download records from the Caltech TIND.io database and check the URLs that may be embedded within the records.

Go package and command line implementation of "NAMe AS TExt" metadata embedding for directories.

namaste

tmplfn

tmplfn provides a set of common functions useful for working with Go's text/template and html/template packages

collaborator_reports

Generate collaborator reports from data sources

Search Caltech's TIND.io database and download the resulting MARC records

martian

This repository contains a new version of Caltech Library's Persistent URL Resolver, based on AWS S3.

persistent_url_resolver

Split range values produced by Caltech.tind.io in spreadsheet output

splitit

Convert and validate codemeta files using crosswalk

convert_codemeta

Simple CORS proxy server suitable for use as a system daemon on CentOS/RHEL systems

corsproxy

Package up microPublication.org and other journals for archiving into Portico and PMC

pubarchiver

The CaltechAUTHORS InvenioRDM source code

caltechauthors

A Golang package for working with RSS 2

rss2

cli

Building better command line interfaces for Caltech Library

sidetrack

Simple debug tracing package for Python, with optimization support.

Download records and documents from an EPrints server and put them in BagIt format.

eprints2bags

Send records from an EPrints server to the Internet Archive and other web archives

eprints2archives

EPrintTools is a Go package, command line utilities and a service for working with EPrints 3.3.x EPrint XML and REST API

eprinttools

git-desktop

Modified version of the Software Carpentry git-novice lesson that uses GitHub Desktop

GitHub template project for non-web Python application projects. To use this, DO NOT CLONE OR FORK this repository; click on "Use this template". After it's used to create a new repo, this will run a GitHub Actions workflow to update files and directories, so give it a minute and refresh your browser to see the finished result.

py-cli-template

A command line tool and example Bash scripts for working with the ORCID v2.0 API

orcidtools

popstar

Phone-Oriented Processing SofTware for ARchives

Web pages for CODA Movies

coda_media

This is a Go package fork working politely with the CrossRef API.

crossrefapi

libguine

Caltech Library customizations for LibGuides CMS

A Go package wrapper for Caltech Library's remote storage options supporting CRUD operations

storage

lostit

Report lost items in the Caltech Library

2018-10-18-shell-arc

A Bash script that bootstraps and installs Go language in your home directory

install-golang

Shell

RDMworkbook

bookdown files for "The Research Data Management Workbook"

TeX

acacia

Automated CaltechAUTHORS Catalog Ingest Agent

Scripts to migrate content into Invenio RDM

inveniordm-migrate

orcid-sciencv-workshop

experiment in tracking website content changes

liblog

Caltech Library's Digital Library Development sandbox.

caltechlibrary.github.io

DEPRECIATED: A unified search box for Caltech Library.

unified-search-box

Rest Client wrapper around Golang's http/http packages targeting ease of implementation working with REST API

andor

A light weight object repository concept

Workshop page for CPA Python Workshop

2019-01-22-Python-Workshop

Jupyter Notebook

wsfn

Go package for standardize web service functionality across our library's go projects

wos_reports

Scripts to generate reports from Web of Science

MMWConf presentation Fall 2016

command-line-for-librarians

ocre

OCR evaluation utilities

This repository describes how to generate a CITATION.cff, about.md and installer.sh from a codemeta.json file using Pandoc.

codemeta-pandoc-examples

A Go and Python package for working with InvenioRDM repositories.

irdmtools

cold

Controlled Object Lists Daemon

TypeScript

refoliate

REstore FOLIo sAved insTance rEcords

vcard

A light weight VCard v4 package for harvesting local directory information

2018-08-13-caltech

2018-03-29-caltech

Caltech R Workshop

Automatically harvest publications for an InvenioRDM repository

irdm_harvester

Take the information from a Python setup.cfg file and generate a codemeta.json file

metagenesys

etdb-ipfs-mirror

Code involved in setting up an IPFS mirror of ETDB

Shell

dataset-instruction

Instructional content for the dataset package

Map interface for CaltechDATA files

caltechdata_map

An intermediate exploration of Bash, curl and working with content from web API

library-shell-curl-and-api

tccon-caltechdata

Scripts for uploading TCCON data to CaltechDATA

Images of documents for testing HTR.

htr-test-cases

Repository for Carpentry Lessons based on R

R-Carpentry

Look up barcodes in Caltech's TIND server

checkit

Universal footer code to be embedded in various systems for a consistent look.

html_footer

A Go package for working with DOI

doitools

archives_drupal

Caltech Archives on Drupal 8

CSS

caltechdata_plot

Demo interactive plotting tool that uses Bokeh server to produce an interactive plot by calling the caltechDATA (Invenio 3) API

Assorted scripts for migrating content to CaltechDATA

caltechdata_migrate

Scripts to support the Caltech Library DIBS application

dibsiiif

(this has moved into the cli package) See https://github.com/caltechlibrary/cli

pkgassets

searchtools

A Python3 package for working with Elasticsearch and LunrJS.

distillery

WIP

A Bookdown book template with Caltech customizations

book-template