• Stars
    star
    652
  • Rank 66,584 (Top 2 %)
  • Language
    PowerShell
  • License
    Creative Commons ...
  • Created over 5 years ago
  • Updated 12 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

πŸ•ΆοΈA curated list of awesome tools for dealing with CSV.

Awesome CSV Awesome

A carefully curated list of CSV-related tools and resources

CSV remains the most futuristic data format from the distant past.

XML has risen and fallen. JSON is just a flash in the pan. YAML is a poisoned chalice. CSV will outlast them all.

When the final cockroach breathes her last breath, her dying act will be to scratch her date of death in a CSV file for posterity.

Contents

Here are some awesome tools for dealing with CSV:

Tools

  • NimbleText/Live - Use patterns to manipulate CSV; the world's simplest code generator *.
  • PapaParse - A powerful in-browser CSV parser.
  • d3-dsv - d3.js parser and formatter module for delimiter-separated values.
  • CSVKit - CSV utilities that includes csvsql / csvgrep / csvstat and more.
  • XSV - A fast CSV command-line toolkit written in Rust.
  • sed (gnu tool) - Stream editor.
  • gawk (gnu tool) - Text processing and data extraction using awk.
  • awk by example - Comprehensive examples of using awk.
  • Miller - Like sed / awk / cut / join / sort etc for name-indexed data such as CSV.
  • ParaText - CSV parsing at 2.5 GB per second.
  • CSVGet - Get structured data from sites as CSV.
  • CSVfix - A tool for manipulating CSV data.
  • Tad - A fast free cross-platform CSV viewer.
  • Nvd3-tags - A tiny library for making charts from csv data.
  • Powershell: Import-CSV - Powerful in-built facility for dealing with CSV (example).
  • CSV Tools - A collection of useful CSV utilities.
  • graph-cli - Flexible command line tool to create graphs from CSV data.
  • CSV to SQL - Online tool to create insert/update/delete etc from CSV data.
  • C#: kbCSV - An efficient, easy to use .NET parsing and writing library for CSV.
  • csvprintf - UNIX command line utility for parsing and formatting output based on CSV files.
  • Mockaroo - Random data generator for CSV / JSON / SQL / Excel.
  • Ron's CSV Editor - Handles big files, does miraculous things. A timeless editor for a timeless format.
  • Rainbow CSV plugins - Collection of text editor plugins for CSV/TSV syntax highlighting. Available for Vim, VS Code, Atom, Sublime Text and other editors.
  • Mighty Merge - join/union csv files.
  • Modern CSV - A tool for editing CSV files and viewing large files.

Repair or Validate CSV

  • Csvlint.go - Command line tool for validating CSV files against RFC 4180.
  • csvstudio - A smart app to repair syntax errors in very large CSV files.
  • scrubcsv - Remove bad records from a CSV file and normalize (requires rust)
  • reconcile-csv - Find relationships between a set of related CSVs

Generate Table Schema

  • CSV Schema β€” Analyzes a CSV file and generates database table schema, all within the browser
  • Wanted: More tools in this category.

Treat CSV as SQL

  • TextQL - Execute SQL against CSV or TSV.
  • Datasette Facets - Faceted browse and a JSON API for any CSV File or SQLite DB.
  • q - Run SQL Directly on CSV Files
  • RBQL - Rainbow Query Language, a SQL-like language with JavaScript or Python backend.
  • PSKit Query β€” Powershell module lets you run simple queries over objects, including imported with csv

Convert to or from CSV

  • CSV to Table - Convert CSV files to searchable and sortable HTML table.

CSV <-> JSON

  • Agnes - Two way Csv to Json **.
  • csv2json - online tool to convert your CSV or TSV formatted data to JSON and vice versa.
  • csv-to-json - Easy, privacy-friendly and offline-first online csv to json converter.

Essays

Once you've found the perfect data serialization file format, you stop looking

David Wengier

Data

Conferences

  • csv,conf - A community conference for data makers everywhere.

Standards

The wonderful thing about standards is that there are so many of them to choose from.
β€”(Possibly) Grace Hopper.

META: Other similar lists

  • structured-text-tools - List of command line tools for manipulating CSV / XML / HTML / JSON / INI etc.
  • META-META - This list as CSV.
  • META-META-META - A NimbleText pattern that produces this markdown page from this list as a CSV.

Code of Conduct

See Code of Conduct

Funtribute

To experience the fun of contributing, see Contributing

Footnotes

* I'm the author of NimbleText. Of course I put it first on the list. If I didn't personally rate it I wouldn't have spent so much time making and improving it.

** I wrote agnes but don't really endorse it for others to use (thus haven't migrated the source code to GitHub). It's slow and non-streaming. I'd go with papa-parse. On the plus side, agnes has a more comprehensive test suite and simpler api than most.

*** Mine too.

License

CC0

To the extent possible under law, Leon Bambrick has waived all copyright and related or neighboring rights to this work.

More Repositories

1

html_wysiwyg

A truly naked, brutalist html quine
HTML
493
star
2

devShop

the game of kanban
JavaScript
250
star
3

dod

DOS on dope. The last MVC Web framework you'll ever need
Batchfile
183
star
4

ok-bash

.ok folder profiles for bash
Shell
82
star
5

console-adventure

a console.log() adventure
HTML
80
star
6

til

πŸ“˜ Today I Learned
JavaScript
46
star
7

ok-ps

.ok folder profiles for Powershell
PowerShell
33
star
8

csvz

The hot new standard in open databases
30
star
9

AwesomeGUID

πŸ•ΆοΈA list of awesome things related to Globally Unique Identifiers
15
star
10

today-i-learned

My notes from continual learning πŸ€”πŸ’‘πŸ“—
HTML
13
star
11

clowncar

Static Site Generator.... πŸš—πŸ€‘πŸ€‘πŸ€‘πŸ€‘πŸ€‘πŸ€‘πŸ€‘ infinite clowns emerge from a tiny car!
C#
9
star
12

pushpop

mental stack manager
8
star
13

highlight

Syntax Highlight any powershell, in the console, with `Show-Code '$MyCode = "Colorful";`
PowerShell
8
star
14

pre

The friendly pre-processor
PowerShell
8
star
15

today-i-learned-staging

the markdown source of today-i-learned
PowerShell
6
star
16

rename-photo

A script for renaming photos in a sortable way (using EXIF data and some handy parameters)
PowerShell
6
star
17

dungeon.css

CSS-based dungeon themes (uses Karcero to generating dungeons/mazes)
C#
5
star
18

markjump

Powershell implementation of Mark & Jump
PowerShell
4
star
19

crumbs

navigate in powershell by dropping crumbs
PowerShell
2
star
20

higgins

a html (and markdown) based slide presenter
JavaScript
1
star
21

Out-TShirt

A powershell module for sending output onto a t-shirt.
PowerShell
1
star
22

style_edit

A static html page with editable style
HTML
1
star
23

robots-versus-electric-sheep

artificial life simulation
C#
1
star
24

dgaf

dreams-goals-actions-fears
HTML
1
star
25

nps

HTML
1
star
26

yard-sale

JavaScript
1
star
27

cosmic-ray-detector

HTML
1
star