Discover datopian/datahub-qa Open Source project

Cloudflare R2 bucket File Uploader with multipart upload enabled. Tested with files up to 10 GB size.

112

r2-bucket-uploader

TypeScript

data-cli

data - command line tool for working with data, Data Packages and the DataHub

Carbon dashboard on datahub

carbondoomsday

CKAN / Data Portal frontend as microservice in pure Javascript (Node).

frontend-v2

Create beautiful dashboards from data packages

dashboard-js

💨🥫 A Data Factory system for running data processing pipelines built on AirFlow and tailored to CKAN. Includes evolution of DataPusher and Xloader for loading data to DataStore.

frontend

DataHub frontend

SCSS

aircan

Deployment automation for the DataHub

deploy

🌀 The JS data presentation framework. For a single dataset to a full catalog.

portal.js.bak

Date parsing and normalization utilities for Python.

flexidate

📝 React-based framework for building data publishing workflows (esp for CKAN)

datapub

Docker images and compose environment for local development and testing of ckan-cloud

ckan-cloud-docker

CKAN Cloud operator manages, provisions and configures Ckan Cloud instances and related infrastructure.

ckan-cloud-operator

CKAN on Kubernetes (k8s) - Helm charts

ckan-cloud-helm

🔍 📊 🌏 CKAN extension that will provide data querying and story sharing with pre configured set of rules 📰 📋

ckanext-querytool

Documentation for DataHub

datahub-content

ckanext-blob-storage

CKAN extension to offload blob storage to cloud storage providers (S3, GCS, Azure etc).

MOVED to https://tech.datopian.com/datahub/ - Technical Documentation for DataHub software

datahub-docs-tech

Desktop application for creating Data Packages and uploading to DataHub.io

data-desktop

Data Explorer app and components built in React oriented to use with CKAN

data-explorer

View library for datapackages and datapackage resources

datapackage-views-js

A Javascript-only data library providing functionality like DataFrame in Pandas or R. (Currently in research phase - does this already exist ...)

dataframe.js

ourbot

Our personalized bot

Compar-o-tron: for comparing numbers stuff

comparotron

🗄️ Library for storing dataset metadata, with versioning support and pluggable backends including GitHub.

metastore-lib

CKAN extension to display useful and important system information for portal maintenance and development

ckanext-developerpage

Turn Github into a DataHub. Share data + content in a useable form with team-mates or the world.

datahub-next

The DataHub data assembly line

assembler

API for working with DataHub (e.g., push or get a dataset)

datahub-client

Javascript frontend code for the DataHub

frontend-showcase-js

Subscriptions and notifications for CKAN.

data-subscriptions

specstore

JSON Schema viewer is a lightweight javascript library and tool that turns JSON schemas into a elegant human readable documents.

jsv

Zen of Data (Engineering)

zen-of-data

metastore

Data Catalog metadata search service (part of DataHub data management system)

covid-19

Dashboard for COVID-19.

A dashboard for city indicators starting with London

city-indicators

Tools for working on core datasets

core-datasets-tools

Project management (issues only)

datahq-pm

import-ui

REPLACED by https://github.com/datopian/datapub. A web UI for importing data in a Frictionless way

Datopian Team Playbook 📕 https://playbook.datopian.com/

playbook

A CKAN extension for data versioning.

ckanext-versions

Use CKAN to provide authorization tokens for other related systems

ckanext-authz-service

Datopian are experts in data management. This is an overview of our technology.

tech.datopian.com

Client SDK in javascript for interacting with CKAN including uploading files, adding metadata etc.

ckan-client-js

Datahub Extensions for datapackage-pipelines

datapackage-pipelines-datahub

bitstore

Bitstore for DataHub

React app for building charts (aka datapackage views)

chart-builder

Disable anonymous access to CKAN by redirecting users to login page.

ckanext-noanonaccess

Code and theme for the Data GM Open Data Portal at http://datagm.org.uk/

ckanext-datagm

Python SDK for DataHub.io

datahub-py

This is a repo for the bot on our Slack chat which purpose is to help us to be more productive in work.

slack-bot

CKAN extension for Öppnadata.se, the Swedish data management platform

ckanext-sweden

⚙️ A design for a next generation, fully-git(hub) + cloud based DataHub.

datahub-git-based

datastore-query-builder

React app for building Datastore queries on showcase page

Deprecated. See https://github.com/datopian/ckanext-versions. ⏰ CKAN extension providing data versioning (metadata and files) based on git and github.

ckanext-versioning

Automates daily, weekly and biweekly stats collection from datahub.io

datahub-metrics

Next generation Data API for data management systems including CKAN.

data-api

A demo and thoughts on how dataflow could work

dataflow-demo

gift-portal

Given a resource descriptor with inlined data and filter spec, create a new resource descriptor with inlined filtered data.

data-resource-filter

metastore-lib-js is a JavaScript library for abstracting metadata storage for datapackage.json packages

metastore-lib-js

A new Data Explorer for CKAN built on React.

ckanext-dataexplorer-react

A Python implementation of a Git-LFS client, with Giftless extras

giftless-client

dashboards

🏠 for dashboards

A simple Node JS script to automate upgrading pre v1 Data Package specs to v1

datapackage-normalize-js

A simple, markdown based format for creating flashcards and quizzes plus converters to popular apps like Google Forms and Anki.

hiring

quizzical

resolver

📋 CKAN extension for creating organization dashboards 📋

ckanext-orgdashboards

A CKAN extension for creating organization portals

ckanext-orgportals

Experiments in lightweight ways to create, display and share datasets and data-driven stories.

data-literate

DataHub command line interface in go [deprecated]

datahub-cli-go

ckanext-birmingham

Datahub factory for dataflows

factory

Dockerfile

data-explorer-graphql

GraphQL based Data Explorer

Map builder UI for Data Explorer app

map-builder

c3js based charts for CKAN

ckanext-c3charts

Python API for sending Datahub Events to ES

events

filemanager

📧 📬 CKAN extension for requesting new data 📧 📬

ckanext-requestdata

🛠️ A JS library for mapping CKAN metadata <=> Frictionless metadata

frictionless-ckan-mapper-js

DataHQ service for sending out emails

datahub-emails

Main extension for Tayside

ckanext-tayside

ckanext-validation

Plan processing based on spec

planner

CKAN extension to integrate your custom DataPub.js based dataset and resource editor

ckanext-datapub

KPIs for Montreal Data Viz Dashboard

montreal-city-indicators

Documentation and code to support CKAN Cloud cluster provisioning and management

ckan-cloud-cluster

Cypress toolkit to run integration tests against a CKAN instance

datahub-auth

ckan-integration-tests

ckanext-montrosemaps

MOVED TO https://github.com/datopian/portal.js/tree/main/examples/nextjs-tailwind-mdx [Next.js + Tailwind CSS + MDX Starter Template]

nextjs-tailwind-mdx

The custom extension for notifying(triggering) the Airflow DAG about the data to be uploaded to DataStore

ckanext-aircan

frontend-functional-tests

100

ckanext-abtassociates