timwis/csv-schema

Stars
314
Rank 133,353 (Top 3 %)
Language
JavaScript
Created over 8 years ago
Updated over 8 years ago

timwis/csv-schema

timwis

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Analyzes a CSV file and generates database table schema, all within the browser

CSV Schema

Analyzes a CSV file and generates database table schema, all within the browser

This application parses CSV files (including huge ones) within the browser. It analyzes each field to suggest the best database field type, max length, and whether or not there are any null values. From there, you can rename fields, ignore them, override field types/lengths, etc. and generate database table creation sql for MySQL, MariaDB, Postres, Oracle, or SQLite3.

Development

Install dependencies using npm install
Run a development server using npm start
Run linter and tests using npm test
Run a production build using npm run build
Deploy the application to surge using npm run deploy

This application uses PapaParse for CSV parsing and Knex.js for SQL query building.

jkan

A lightweight, backend-free open data portal, powered by Jekyll

markdown-to-google-doc

Converts a markdown file to .docx and then imports it to Google Drive

leaflet-choropleth

Choropleth plugin for Leaflet (color scale based on value)

vizwit

An interactive data visualization tool

eres

Use async/await with [err, result] instead of try/catch.

dataface

Build and manage data with a spreadsheet-like interface

enviar

Chat interface for SMS / text messages

markdown-menubar

Take quick notes from the menubar in markdown. Saves to a file as you type.

static-api

Creates a static API from a CSV file

handsontable-postgrest

An excel-like database table editor using Handsontable + PostgREST

form-designer

Drag & drop designer for building forms

choo-leaflet-demo

Example usage of leaflet with choo via cache-element

dataface-electron

Desktop application to manage Postgres databases

ext-postgrest-crud

An Ext.js-powered, spreadsheet-style Grid for Create/Read/Update/Delete against a postgres database with a PostgREST API in front of it

vue-lil-context-menu

A flexible context menu component for Vue

choo-infinite-list

Proof of concept using choo to render only the rows necessary to display, along with padding above and below to simulate scrolling through a giant list.

github-feed

Mobile-friendly GitHub activity feed. Check who starred what while on the go.

data-digest

Monitors an API for new data and sends digest emails to subscribers.

koa-superstruct

Use the superstruct data validation library as middleware for your koa app.

open-collect

Offline-first mobile web app for field data collection

es6-boilerplate

Front-end project boilerplate with es6 build tools. Includes babel, webpack, and npm scripts.

jekyll-travis-gh-pages

Deploy jekyll sites to gh-pages with plugins, etc. using Travis CI

responsive-map-list-template

HTML template for a map + list application

node-soda2-parser

Parse Socrata SODA2 API to Abstract Syntax Tree (AST)

soda-geoservices

Query Esri Geoservices using a SODA2-style API

actionable

A GTD-inspired todo list that lets you focus on immediately actionable tasks (tasks with no dependencies).

choo-onload-tests

A few tests to demonstrate expected functionality of on-load in choo

aframe-fps-look-controls-component

A-Frame component to enable FPS-style looking

electoral-calling

The fate of the country is in the hands of these 538 members of the electoral college. Here's who they are.

geoservices-for-humans

Human-friendly documentation of Esri GeoServices

hyperlist-component

Wraps HyperList with Nanocomponent to allow use as a pureish component.

jkan-demo

Demo instance of timwis/jkan

sheetstat

Spreadsheet driven stats site

choo-workshop

choo: the good parts of react & redux without the boilerplate

github-directory

Generates a page of your GitHub repositories. Useful for a user/org GitHub Pages site when you're not sure what to put there.

OPA-Liberator

arcbishop

Responsive bootstrap map and panel template

choo-starter

A basic starter app for playing around with choo on glitch.

soda-postgres

Use Socrata's SODA2 API to query a postgres database

standards-components

Proof of concept of using custom elements for a style guide

textblast

koop-odata

OData API functionality for esri/koop

PhillySNAP

Find nearby farmers markets and SNAP-accepting retailers via text message

socrata-creator

Create Socrata datasets via API

serverless-data

Edit data files in GitHub with a GUI

georeport

Offline-first map-based reporter (work in progress, proof of concept)

PhillySNAP-v1

PhillySNAP, an SMS-based application powered by Smsified, aims to connect low-income, technology isolated Philadelphia residents with local fresh food sources. It was developed by Deng-Shun Chang, Mark Headd, Katey Metzroth and Tim Wisniewski.

couchdb-password-reset

Password reset implementation for CouchDB

koop-soda

This plugin makes it possible to interact with Koop's many providers using a SODA2 API

github-api-demo

Login via GitHub and create/edit a file using a form interface

split-the-distance

Find mutually convenient places to meet

gatsby-starter-netlify-cms

vizwit-designer

Design VizWit card configurations with a GUI

file-schema-detector

DEPRECATED - Detect/guess schema of CSV file in the browser

export-jamboard

Bookmarklet to copy the contents of a jamboard as text

septakey-api

A REST API providing basic functions of septakey.org

hybrid-google-meet

Join Google Meet meetings with the sound and microphone muted so you can use chat and hand raising in-person to create a more equitable experience for those joining virtually.

credit-card-set-asider

Monitors daily credit card activity & sets aside a percentage of it in your savings account, so it's there to pay your balance at the end of the month.

habitat-wp-cli

A habitat package for the WordPress CLI

whowon-choo

Real-time election results with back-end database (WIP)

timwis.github.io

Personal homepage

fork-test

Testing what happens to forks and PR functionality when the default branch is renamed upstream

jkan-website

Landing page for timwis/jkan

beacon-data-importer

Convert person data to a CSV format that can easily be imported to Beacon's database

importui

cloudmine-datatables

Use dataTables.js to display, sort, and paginate CloudMine records, fetching only what's displayed

slugify-headers

A python script to get database_friendly_field_names for a CSV file

property-react

dkan-to-csv

twilio-log-cleaner

Anonymizes twilio SMS logs for use as public sample data or test fixtures.

beacon-qa

flic-google-meet

Mute/unmute Google Meet using a flic button

silly-batch-geocoder

Because it's just silly how difficult it is to batch geocode with google's API!

gatekeeper-jkan-demo

qrcard

react-boilerplate

Fork of timwis/es6-boilerplate for react apps. Just ES6/JSX/Webpack.

github-login-demo

Demonstrate logging in to github through JavaScript

property-vue

socrata-pusher

Push database tables to Socrata via DataSync

timsgeocoder

Another modular geocoder

mediawiki-to-jekyll

vizwit-builder

Layout builder tool for VizWit

geopicker

Sometimes the default geocode isn't good enough. This utility allows you to fine tune the latitude/longitude fields after your geocode independent of the address.