simonw/ca-fires-history

Stars
165
Rank 228,906 (Top 5 %)
Language
Created about 4 years ago
Updated over 1 year ago

simonw/ca-fires-history

simonw

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Tracking fire data from www.fire.ca.gov

ca-fires-history

Tracking fire data from www.fire.ca.gov/incidents

As-of June 28th 2023

The scraped data is stored in incidents-june-2023-format.json

Up to March 2rd 2023

The scraped data was stored in incidents.json

Background on this project: Git scraping: track changes over time by scraping to a Git repository

datasette

An open source multi-tool for exploring and publishing data

sqlite-utils

Python CLI utility and library for manipulating SQLite databases

shot-scraper

A command-line utility for taking automated screenshots of websites

csvs-to-sqlite

Convert CSV files into a SQLite database

til

Today I Learned

django-sql-dashboard

Django app for building dashboards using raw SQL queries

simonw

https://simonwillison.net/2020/Jul/10/self-updating-profile-readme/

llm

Access large language models from the command-line

db-to-sqlite

CLI tool for exporting tables or queries from any SQL database to a SQLite file

djangode

Utilities functions for node.js that borrow some useful concepts from Django

csv-diff

Python CLI tool and library for diffing CSV and JSON files

datasette-lite

Datasette running in your browser using WebAssembly and Pyodide

shot-scraper-template

Template repository for setting up shot-scraper

geocoders

Ultra simple API for geocoding a single string against various web services.

django-openid

A modern library for integrating OpenID with Django - incomplete, but really nearly there (promise)

openai-to-sqlite

Save OpenAI API results to a SQLite database

action-transcription

A tool for creating a repository of transcribed videos

s3-credentials

A tool for creating credentials for accessing S3 buckets

git-history

Tools for analyzing Git history using SQLite

google-drive-to-sqlite

Create a SQLite database containing metadata from Google Drive

django-queryset-transform

Experimental .transform(fn) method for Django QuerySets, for clever lazily evaluated optimisations.

ratelimitcache

A memcached backed rate limiting decorator for Django.

optfunc

Syntactic sugar for creating Python command line scripts by introspecting a function definition

djng

Turtles all the way down

cougar-or-not

An API for identifying cougars v.s. bobcats v.s. other USA cat species

Jupyter Notebook

simonwillisonblog

The source code behind my blog

advent-of-code-2022-in-rust

Copilot-assisted Advent of Code 2022 to learn Rust

djangopeople.net

A geographical community site for Django developers.

scrape-chatgpt-plugin-prompts

s3-ocr

Tools for running OCR against files stored in S3

datasette-app

The Datasette macOS application

django-redis-monitor

Request per second / SQLop per second monitoring for Django, using Redis for storage

python-lib

Opinionated cookiecutter template for creating a new Python library

ttok

Count and truncate text based on tokens

mytweets

Script for saving a JSON archive of your tweets.

airtable-export

Export Airtable data to YAML, JSON or SQLite files on disk

datasette-graphql

Datasette plugin providing an automatic GraphQL API for your SQLite databases

llm-mlc

LLM plugin for running models using MLC

strip-tags

CLI tool for stripping tags from HTML

django_cropper

Integration of jCrop with the Django admin

click-app

Cookiecutter template for creating new Click command-line tools

datasette-ripgrep

Web interface for searching your code using ripgrep, built as a Datasette plugin

download-esm

Download ESM modules from npm and jsdelivr

datasette.io

The official project website for Datasette

ftfy-web

Paste in some broken unicode text and FTFY will tell you how to fix it!

markdown-to-sqlite

CLI tool for loading markdown files into a SQLite database

sqlite-history

Track changes to SQLite tables using triggers

yaml-to-sqlite

Utility for converting YAML files to SQLite

sqlite-diffable

Tools for dumping/loading a SQLite database to diffable directory structure

covid-19-datasette

Deploys a Datasette instance of COVID-19 data from Johns Hopkins CSSE and the New York Times

dogproxy

Experimental HTTP proxy (using node.js) for avoiding the dog pile effect.

soupselect

CSS selector support for BeautifulSoup.

laion-aesthetic-datasette

Use Datasette to explore LAION improved_aesthetics_6plus training data used by Stable DIffusion

datasette-cluster-map

Datasette plugin that shows a map for any data with latitude/longitude columns

action-transcription-demo

A tool for creating a repository of transcribed videos

datasette-vega

Datasette plugin for visualizing data using Vega

pge-outages-pre-2024

Tracking PG&E outages

google-calendar-to-sqlite

Create a SQLite database containing your data from Google Calendar

url-map

Use URL parameters to generate a map with markers, using Leaflet and OpenStreetMap

disaster-scrapers

Scrapers for disaster data - writes to https://github.com/simonw/disaster-data

djp

A plugin system for Django

geojson-to-sqlite

CLI tool for converting GeoJSON files to SQLite (with SpatiaLite)

asgi-csrf

ASGI middleware for protecting against CSRF attacks

datasette-chatgpt-plugin

A Datasette plugin that turns a Datasette instance into a ChatGPT plugin

nodecast

A simple comet broadcast server, originally implemented as a demo for Full Frontal 2009.

bugle_project

Group collaboration tools for hackers in forts.

django-html

A way of rendering django.forms widgets that differentiates between HTML and XHTML.

datasette-auth-github

Datasette plugin that authenticates users against GitHub

puppeteer-screenshot

Vercel app for taking screenshots of web pages using Puppeteer

llm-replicate

LLM plugin for models hosted on Replicate

python-lib-template-repository

GitHub template repository for creating new Python libraries, using the simonw/python-lib cookiecutter template

django-signed

Signing utilities for Django, to try out an API which is being proposed for inclusion in Django core.

museums

A website recommending niche museums to visit

pypi-rename

Cookiecutter template for creating renamed PyPI packages

help-scraper

Record a history of --help for various commands

dbf-to-sqlite

CLI tool for converting DBF files (dBase, FoxPro etc) to SQLite

disaster-data

Data scraped by https://github.com/simonw/disaster-scrapers

asyncinject

Run async workflows using pytest-fixtures-style dependency injection

datasette-publish-vercel

Datasette plugin for publishing data using Vercel

gzthermal-web

A web interface to gzthermal by caveman on encode.ru

asgi-auth-github

ASGI middleware that authenticates users against GitHub

json-head

JSON microservice for performing HEAD requests

django-safeform

CSRF protection for Django forms.

s3-image-proxy

A tiny proxy for serving and resizing images fetched from a private S3 bucket

sqlite-transform

Tool for running transformations on columns in a SQLite database

webhook-relay

A simple Node.js server for queueing and relaying webhook requests

datasette-tiddlywiki

Run TiddlyWiki in Datasette and save Tiddlers to a SQLite database

image-diff

CLI tool for comparing images

getlatlon.com

Source code for getlatlon.com - a simple, single page, pure JavaScript Google Maps application.

sf-tree-history

Tracking the history of trees in San Francisco

scrape-hacker-news-by-domain

Scrape HN to track links from specific domains

timezones-api

A Datasette-powered API for finding the time zone for a latitude/longitude point

owlsnearme

A website that tells you where your nearest owls are!

datasette-table

A Web Component for embedding a Datasette table on a page

xml-analyser

Simple command line tool for quickly analysing the structure of an arbitrary XML file

shapefile-to-sqlite

Load shapefiles into a SQLite (optionally SpatiaLite) database

cdc-vaccination-history

A git scraper recording the CDC's Covid Data Tracker numbers on number of vaccinations per state.

json-flatten

Python functions for flattening a JSON object to a single dictionary of pairs, and unflattening that dictionary back to a JSON object

datasette-json-html

Datasette plugin for rendering HTML based on JSON values

djangocon-2022-productivity

Supporting links for my DjangoCon 2022 talk