Discover frictionlessdata/datapackage-pipelines-github Open Source

Data Package is a standard consisting of a set of simple yet extensible specifications to describe datasets, data files and tabular data. It is a data definition language (DDL) and data API that facilitates findability, accessibility, interoperability, and reusability (FAIR) of data.

696

datapackage

MDX

488

tableschema-py

A Python library for working with Table Schema.

Python library for reading and writing tabular data via streams.

259

tabulator-py

A Python library for working with Data Packages.

235

datapackage-py

The main repository of the Frictionless Data project. Website, issues, and discussions

191

frictionlessdata.io

Framework for processing data packages in pipelines of modular components.

141

datapackage-pipelines

[DEPRECATED] Please use https://datahub.io/docs/features/data-cli

119

dpm-js

Data presentation framework for Python that generates static sites from extended Markdown with interactive charts, tables, scripts, and other features

109

livemark

A JavaScript library for working with Table Schema.

tableschema-js

Data validation as a service. Project retired, got to the current one at frictionsless/repository

goodtables.io

A lightweight, standardized library accessing files and datasets, especially tabular ones (CSV, Excel).

frictionless-js

Generate SQL tables, load and extract data, based on JSON Table Schema descriptors.

tableschema-sql-py

Generate Pandas frames, load and extract data, based on JSON Table Schema descriptors.

tableschema-pandas-py

A Go library for working with Table Schema.

tableschema-go

datapackage-r

An R package for working with Data Package.

datapackage-js

A JavaScript library for working with Data Package.

CKAN extension for importing/exporting Data Packages.

ckanext-datapackager

Data management service that brings continuous data validation to tabular data in your repository via Github Action

frictionless-ci

Data Quality Dashboards display statistics on a collection of published data.

data-quality-dashboard

The Frictionless Data website.

website-old

CSS

examples

Example Data Packages for use in tutorials

frictionless-r

R package to read and write Frictionless Data Packages

datapackage-ui

Create and validate Data Packages in the browser

An R library for working with Table Schema.

tableschema-r

tableschema-java

A Java library for working with Table Schema.

Java

frictionless-darwin-core

DarwinCore Archive as Frictionless Data Package

A Go library for working with Data Package.

datapackage-go

datapackage-java

A Java library for working with Frictionless Data Data Packages.

Java

data-quality-spec

A spec for reporting errors in data quality.

Edit CSV files in the browser and sync them with GitHub

delimiter

🎉 A curated list of tools, libraries, patterns and projects in the Frictionless ecosystem.

awesome-frictionless

data-quality-cli

CLI for creating databases for Data Quality Dashboards.

Generate BigQuery tables, load and extract data, based on JSON Table Schema descriptors.

tableschema-bigquery-py

[DEPRECATED] Please use https://github.com/frictionlessdata/specs

schemas

Carles Pina Estany's 2020 Tool Fund: data managers and researchers collaborate to write the Frictionless Data packages, tabular schemas, etc.

schema-collaboration

React components for rendering Data Package Views.

datapackage-render-js

[DEPRECATED] Please use http://try.goodtables.io/

goodtables-web

CSS

datapackage-v2-draft

This repository has been merged back into https://github.com/frictionlessdata/datapackage.

MDX

dplib-py

Python implementation of the Data Package standard and various models and utils for working with data.

[DEPRECATED] Please use - https://github.com/frictionlessdata/frictionless-py

frictionless-prototype-py

A Ruby library for working with JSON Table Schema.

tableschema-rb

Ruby

example-continuous-data-integration

[DEPRECATED] Please use https://goodtables.io

Extension for importing and exporting Data Packages from/into Google Sheets.

googlesheets-datapackage-tools

Merged into https://github.com/frictionlessdata/frictionlessdata.io

website

A php library for working with Table Schema.

tableschema-php

PHP

components

Data integration components for TypeScript/React that implement Frictionless Data concepts in visual UI

TypeScript

datapackage-rb

Ruby library and tools for working with datapackages

Ruby

covid-tracker

A livemark tracking COVID-19 disease pandemic

🗣 Frictionless Data Forum esp for "How do I" type questions

forum

datapackage-php

A php library for working with Data Package.

PHP

tableschema-ui

A web UI for creating, editing and validating Table Schemas.

Generate Elasticsearch indexes based on Table Schema descriptors.

tableschema-elasticsearch-py

Jupyter Notebooks presenting Frictionless Data.

notebooks

Jupyter Notebook

frictionless-ckan-mapper

🛠️ A library for mapping CKAN metadata <=> Frictionless metadata

A common set of test data files and data packages for testing Frictionless Data tooling

datasets

A Julia library for working with Data Package.

DataPackage.jl

Julia

goodtables-ui

A web UI for goodtables validation and report visualizations.

TypeScript

datapackage-clj

A Clojure library for working with Data Package.

Validate tabular data in JavaScript

goodtables-js

Community curated Schema Catalog

schema-catalog

Data integration libraries for 10 programming languages that implement Frictionless Data concepts in code

libraries

A Julia library for working with Table Schema.

TableSchema.jl

Julia

datapackage-pipelines-aws

Datapackage-pipelines integration with AWS

A livemark listing data packages hosted on Github

data-packages

It's a demo repository for the Frictionless Repository project.

frictionless-ci-demo

software-legacy

DEPRECATED / MERGED to https://github.com/frictionlessdata/project

A Clojure library for working with Table Schema.

tableschema-clj

Clojure

tableschema-sql-js

Library for converting JSON Table Schema to an SQL table, for Node and the browser.

Read and write between SPSS and Table Schema.

tableschema-spss-py

A livemark listing CKAN extensions hosted on Github

ckan-extensions

Goodtables is a framework to validate tabular data [MAINTENANCE MODE]

goodtables-py

Datapackage-pipelines integration with Elasticsearch

datapackage-pipelines-elasticsearch

A Swift library for working with Data Package.

datapackage-swift

Swift

software

The Frictionless Data project provides a rich set of open source software for working with data

This is a repository for piloting a packaging approach to archaeology data

pilot-open-archaeology

pilot-elife

Scripts and data for the eLife / Goodtables pilot

Frictionless Data Tool Fund Website

toolfund

SCSS

livemark-project

Livemark project template

This repo contains databases created with https://github.com/frictionlessdata/data-quality-cli.

data-quality-databases

Makefile

datapackage-pipelines-goodtables

A datapackage-pipelines processor to validate tabular resources using goodtables

To tell a story about the Frictionless community using Livemark

community-insights

Documentation hub and automation

docs

AWS integration for dataflows

dataflows-aws

Generate CKAN DataStore tables, load and extract data, based on Table Schema descriptors.

tableschema-ckan-datastore-py

Testsuite for Frictioinless Data extended implementations.

testsuite-extended

It's a CKAN plugin for Livemark

pilot-oxford

Pilot with Oxford

livemark-ckan

An object relational mapper based on Table Schema descriptors.

tableschema-models-js

Website for fellows.frictionlessdata.io Lektor project

fellows

Jupyter Notebook

ckanext-datapackage

Data Package integreation for CKAN.

Pilot with the Catalyst cooperative

pilot-catalyst

Generate OpenRefine models, load and extract data, based on JSON Table Schema descriptors.

tableschema-openrefine-py

This training guide for trainers of the OKF x Facebook GeoData Training Programme

geodata-training

A Swift library for working with Table Schema.

tableschema-swift

Swift

goodread

Goodread executes Python and Bash codeblocks in Markdown and writes the results back

livemark-plugin

Livemark plugin template

[EXAMPLE] Data repository for goodtables.io.

goodtables.io-example

Makefile

datapackage-pipelines-ckan

Data Package Pipelines processors for CKAN