Discover simonw/markdown-to-sqlite Open Source project

Python CLI utility and library for manipulating SQLite databases

7,807

sqlite-utils

A command-line utility for taking automated screenshots of websites

1,191

shot-scraper

Convert CSV files into a SQLite database

1,006

csvs-to-sqlite

til

django-sql-dashboard

Django app for building dashboards using raw SQL queries

https://simonwillison.net/2020/Jul/10/self-updating-profile-readme/

400

simonw

Access large language models from the command-line

362

llm

CLI tool for exporting tables or queries from any SQL database to a SQLite file

309

db-to-sqlite

Utilities functions for node.js that borrow some useful concepts from Django

302

djangode

Python CLI tool and library for diffing CSV and JSON files

256

csv-diff

Datasette running in your browser using WebAssembly and Pyodide

238

datasette-lite

Template repository for setting up shot-scraper

237

shot-scraper-template

217

geocoders

Ultra simple API for geocoding a single string against various web services.

Tracking fire data from www.fire.ca.gov

184

ca-fires-history

165

django-openid

A modern library for integrating OpenID with Django - incomplete, but really nearly there (promise)

Save OpenAI API results to a SQLite database

163

openai-to-sqlite

A tool for creating a repository of transcribed videos

161

action-transcription

A tool for creating credentials for accessing S3 buckets

158

s3-credentials

Tools for analyzing Git history using SQLite

149

git-history

Create a SQLite database containing metadata from Google Drive

147

google-drive-to-sqlite

Experimental .transform(fn) method for Django QuerySets, for clever lazily evaluated optimisations.

142

django-queryset-transform

A memcached backed rate limiting decorator for Django.

142

ratelimitcache

Syntactic sugar for creating Python command line scripts by introspecting a function definition

141

optfunc

134

djng

Turtles all the way down

An API for identifying cougars v.s. bobcats v.s. other USA cat species

129

cougar-or-not

Jupyter Notebook

119

simonwillisonblog

The source code behind my blog

Copilot-assisted Advent of Code 2022 to learn Rust

118

advent-of-code-2022-in-rust

Rust

114

djangopeople.net

A geographical community site for Django developers.

Tools for running OCR against files stored in S3

111

scrape-chatgpt-plugin-prompts

Shell

107

s3-ocr

The Datasette macOS application

103

datasette-app

Request per second / SQLop per second monitoring for Django, using Redis for storage

100

django-redis-monitor

Opinionated cookiecutter template for creating a new Python library

python-lib

Count and truncate text based on tokens

ttok

Script for saving a JSON archive of your tweets.

mytweets

Export Airtable data to YAML, JSON or SQLite files on disk

airtable-export

Datasette plugin providing an automatic GraphQL API for your SQLite databases

datasette-graphql

LLM plugin for running models using MLC

llm-mlc

CLI tool for stripping tags from HTML

strip-tags

Integration of jCrop with the Django admin

django_cropper

Cookiecutter template for creating new Click command-line tools

click-app

Web interface for searching your code using ripgrep, built as a Datasette plugin

datasette-ripgrep

Download ESM modules from npm and jsdelivr

download-esm

The official project website for Datasette

datasette.io

Paste in some broken unicode text and FTFY will tell you how to fix it!

ftfy-web

Track changes to SQLite tables using triggers

sqlite-history

Utility for converting YAML files to SQLite

yaml-to-sqlite

Tools for dumping/loading a SQLite database to diffable directory structure

sqlite-diffable

Deploys a Datasette instance of COVID-19 data from Johns Hopkins CSSE and the New York Times

covid-19-datasette

Experimental HTTP proxy (using node.js) for avoiding the dog pile effect.

dogproxy

CSS selector support for BeautifulSoup.

soupselect

Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion

laion-aesthetic-datasette

Datasette plugin that shows a map for any data with latitude/longitude columns

datasette-cluster-map

A tool for creating a repository of transcribed videos

action-transcription-demo

Datasette plugin for visualizing data using Vega

datasette-vega

pge-outages-pre-2024

Tracking PG&E outages

Create a SQLite database containing your data from Google Calendar

google-calendar-to-sqlite

Use URL parameters to generate a map with markers, using Leaflet and OpenStreetMap

url-map

Scrapers for disaster data - writes to https://github.com/simonw/disaster-data

disaster-scrapers

A plugin system for Django

djp

CLI tool for converting GeoJSON files to SQLite (with SpatiaLite)

geojson-to-sqlite

ASGI middleware for protecting against CSRF attacks

asgi-csrf

A Datasette plugin that turns a Datasette instance into a ChatGPT plugin

datasette-chatgpt-plugin

A simple comet broadcast server, originally implemented as a demo for Full Frontal 2009.

nodecast

Group collaboration tools for hackers in forts.

bugle_project

A way of rendering django.forms widgets that differentiates between HTML and XHTML.

django-html

Datasette plugin that authenticates users against GitHub

datasette-auth-github

Vercel app for taking screenshots of web pages using Puppeteer

puppeteer-screenshot

LLM plugin for models hosted on Replicate

llm-replicate

GitHub template repository for creating new Python libraries, using the simonw/python-lib cookiecutter template

python-lib-template-repository

django-signed

Signing utilities for Django, to try out an API which is being proposed for inclusion in Django core.

A website recommending niche museums to visit

museums

Cookiecutter template for creating renamed PyPI packages

pypi-rename

Record a history of --help for various commands

help-scraper

CLI tool for converting DBF files (dBase, FoxPro etc) to SQLite

dbf-to-sqlite

Data scraped by https://github.com/simonw/disaster-scrapers

disaster-data

asyncinject

Run async workflows using pytest-fixtures-style dependency injection

Datasette plugin for publishing data using Vercel

datasette-publish-vercel

A web interface to gzthermal by caveman on encode.ru

gzthermal-web

ASGI middleware that authenticates users against GitHub

asgi-auth-github

JSON microservice for performing HEAD requests

json-head

CSRF protection for Django forms.

django-safeform

A tiny proxy for serving and resizing images fetched from a private S3 bucket

s3-image-proxy

Tool for running transformations on columns in a SQLite database

sqlite-transform

A simple Node.js server for queueing and relaying webhook requests

webhook-relay

Run TiddlyWiki in Datasette and save Tiddlers to a SQLite database

datasette-tiddlywiki

CLI tool for comparing images

image-diff

Source code for getlatlon.com - a simple, single page, pure JavaScript Google Maps application.

getlatlon.com

sf-tree-history

Tracking the history of trees in San Francisco

scrape-hacker-news-by-domain

Scrape HN to track links from specific domains

A Datasette-powered API for finding the time zone for a latitude/longitude point

timezones-api

A website that tells you where your nearest owls are!

owlsnearme

A Web Component for embedding a Datasette table on a page

datasette-table

Simple command line tool for quickly analysing the structure of an arbitrary XML file

xml-analyser

Load shapefiles into a SQLite (optionally SpatiaLite) database

shapefile-to-sqlite

A git scraper recording the CDC's Covid Data Tracker numbers on number of vaccinations per state.

cdc-vaccination-history

Python functions for flattening a JSON object to a single dictionary of pairs, and unflattening that dictionary back to a JSON object

json-flatten

Datasette plugin for rendering HTML based on JSON values

datasette-json-html