Discover ctuning/ck-mlbox Open Source project

CK repository with components and automation actions to enable portable workflows across diverse platforms including Linux, Windows, MacOS and Android. It includes software detection plugins and meta packages (code, data sets, models, scripts, etc) with the possibility of multiple versions to co-exist in a user or system environment.

ck-env

CK automation actions to let users implement portable, customizable and reusable program workflows for reproducible, collaborative and multi-objective benchmarking, optimization and SW/HW co-design:

ck-autotuning

Collective Knowledge extension with unified and customizable benchmarks (with extensible JSON meta information) to be easily integrated with customizable and portable Collective Knowledge workflows. You can easily compile and run these benchmarks using different compilers, environments, hardware and OS (Linux, MacOS, Windows, Android). More info:

ctuning-programs

artifact-evaluation

Collective Knowledge repository to support artifact evaluation and reproducibility initiatives:

JavaScript

reproduce-milepost-project

Collective Knowledge workflow for the MILEPOST GCC (machine learning based compiler). See how it is used in the collaborative project with the Raspberry Pi foundation to support collaborative research for multi-objective autotuning and machine learning techniques, and prototype reproducible papers with portable workflows:

Collective Knowledge repository for NVIDIA's TensorRT

ck-tensorrt

Collective Knowledge packages for various mathematical libs to be plugged into portable and customizable CK research workflows:

ck-math

Collective Knowledge repository with actions to unify the access to different predictive analytics engines (scipy, R, DNN) from software, command line and web-services via CK JSON API:

ck-analytics

Collective Knowledge crowd-tuning extension to let users crowdsource their experiments (using portable Collective Knowledge workflows) such as performance benchmarking, auto tuning and machine learning across diverse platforms with Linux, Windows, MacOS and Android provided by volunteers. Demo of DNN crowd-benchmarking and crowd-tuning:

ck-crowdtuning

Miscellaneous resources for Quantum Collective Knowledge

ck-quantum

This repository is outdated! Join the open MLPerf workgroup to participate in the development of the next generation of automation workflows for MLPerf benchmarks:

ck-mlperf

Integration of Caffe2 to Collective Knowledge workflow framework to provide unified CK JSON API for AI (customized builds across diverse libraries and hardware, unified AI API, collaborative experiments, performance optimization and model/data set tuning):

ck-caffe2

Collective Knowledge web extension to browse CK repositories, visualize interactive graphs and articles, render CK-based websites, implement simple web services with JSON API (for example to crowdsource experiments or unify access to DNN). Demos of interactive articles, graphs and crowdsourced experiments:

ck-web

CSS

ck-crowdtuning-platforms

Meta information about platforms participating in experiment crowdsourcing using Collective Knowledge Framework (OS,CPU,GPU,GPGPU,NN...):

1C Enterprise

ck-docker

Collective Knowledge extension to automate Docker "build","run" and "push" functions and packge CK repositories for collaborative and reproducible research:

Dockerfile

ck-crowdnode

Standalone, thin and portable server to let users participate in experiment crowdsourcing using Windows devices via Collective Knowledge Framework:

ck-dev-compilers

Collective Knowledge packages to build development versions of compilers (LLVM, GCC, etc) and use them in customizable and portable CK research workflows:

Collective Knowledge extension to crowdsource bug detection in OpenCL compilers using CLSmith tool from Imperial College London

ck-clsmith

ck-ext-far-manager-plugin

CK extensions: FAR Manager plugin

Public data sets and their properties in the Collective Knowledge Format with JSON API and JSON meta information to be easily pluggable to customizable and reproducible CK experimental workflows (such as collaborative program analysis and optimization):

ctuning-datasets-min

crowdsource-experiments-using-android-devices

Android application to participate in experiment crowdsourcing (such as workload crowd-benchmarking and crowd-tuning) using Collective Knowledge Framework and open repositories of knowledge:

Java

ck-dissemination-modules

CK dissemination modules

ADAPT workshop website powered by CK

ck-web-adapt-workshop

Shared artifacts in the Collective Knowledge Format as a proof-of-concept to reproduce our recent Collective Mind- and Collective Knowledge-related papers

reproduce-ck-paper

Simple plugin and event-based interface to expose externals of hardwired tools (and connect them to Collective Knowledge Framework). Further info:

openme

Java

ck-crowd-scenarios

Public scenarios to crowdsource experiments (such as DNN crowd-benchmarking and crowd-tuning) using Collective Knowledge Framework across diverse mobile devices provided by volunteers. Results are continuously aggregated at the open repository of knowledge:

ck-guide-images

Images for CK documentation

Collective Knowledge workflow for ARM's workload automation tool: an open framework for gathering and sharing knowledge about system design and optimization using real-world workloads.

ck-wa

Shared artifacts and workflows from the EPSRC Pamela project in the customizable, portable and reusable Collective Knowledge format:

reproduce-pamela-project

Demonstration of compiler autotuning, crowd-tuning and machine learning on RPi3 via customizable Collective Knowledge workflow framework with a portable package manager. This technology supports Pareto-efficient software/hardware co-design tournaments of deep learning in terms of speed, accuracy, energy, costs:

ck-rpi-optimization-results

Portable and customizable Collective Knowledge workflows for MXNet:

ck-mxnet

Shared artifacts and workflows from the EU FP7 Carp project in the customizable, portable and reusable Collective Knowledge format:

reproduce-carp-project

Medium data set (20 frames) in the CK format for the EPSRC Pamela project:

reproduce-pamela-project-small-dataset

Portable and customizable Collective Knowledge workflows for TVM and VTA:

ck-tvm

CK-NNTest: collaboratively validating, benchmarking and optimizing neural net operators across platforms, frameworks and datasets

ck-nntest

CK workflow, portable packages and other artifacts for the ReQuEST-ASPLOS'18 submission:

ck-request-asplos18-caffe-intel

Validated Collective Knowledge workflows and results from the 1st ACM ReQuEST tournament on co-design of Pareto-efficient SW/HW stack for image classification at ASPLOS'18:

ck-request-asplos18-results

Roff

ck-request-asplos18-resnet-tvm-fpga

CK workflow, portable packages and other artifacts for the ReQuEST-ASPLOS'18 submission:

Beta Collective Knowledge workflow to automate installation, execution, customization and validation of SeisSol application from the SCC18 Reproducibility Challenge across different platforms and environments:

ck-scc18

CK workflow, portable packages and other artifacts for the ReQuEST-ASPLOS'18 submission:

ck-request-asplos18-mobilenets-tvm-arm

CK research workflows for object detection

ck-object-detection

Collective Knowledge Workflows for Movidius Neural Compute Stick as a part of AI unification:

ck-mvnc

Collective Knowledge workflows to support ReQuEST tournaments (open, reproducible and Pareto-efficient SW/HW co-design of emerging workloads such as deep learning):

ck-request

Collective Knowledge workflows for DeePhi's DNNDK

ck-dnndk

Collective Knowledge workflows for ArmNN

ck-armnn

Collective Knowledge workflows for OpenVINO Toolkit (Deep Learning Deployment Toolkit)

ck-openvino

CK repository for Quantum Information Software Kit (QISKit)

ck-qiskit

News: we have moved this code to the CK framework:

cbench

Aggregation of CK components and workflows from the community for ML Systems in one repository. They are also uploaded to the cKnowledge platform:

ck-ml

ck-scc

The procedures and a workflow to prepare Student Cluster Competition submissions:

CM interface and automation recipes to access, manage, prepare, run and reproduce research projects from AI, ML and Systems conferences

cm4research

Collective Knowledge components and workflows for MLFlow:

ck-mlflow

Portable and customizable Collective Knowledge workflows for CNTK:

ck-cntk

Integration of PyTorch to Collective Knowledge workflow framework to provide unified CK JSON API for AI (customized builds across diverse libraries and hardware, unified AI API, collaborative experiments, performance optimization and model/data set tuning):

ck-pytorch

Collective Knowledge experimental workflow to crowd-benchmark and crowd-tune Tiny DNN. Currently on stall due to lack of time and resources. Further info about collaborative DNN optimization:

ck-tiny-dnn

CK repository for Rigetti Computing workflows

ck-rigetti

Reproducibility report and the Collective Knowledge workflow for the MLSys'19 paper "AggregaThor: Byzantine Machine Learning via Robust Gradient Aggregation"

reproduce-sysml19-paper-aggregathor

Reproducing ADAPT'16 paper

reproduce-adapt16

ck-rescue-hpc

ResCuE-HPC workshop series (Reproducible, Customizable and Portable Workflows for HPC)

Reproducing some results from Grigori Fursin's research up to 2010 (before moving artifact to Collective Mind and later to Collective Knowledge)

reproduce-fgg-2010

CK repository for cKnowledge.org website:

ck-website

CSS

ctuning-modules

cTuning modules

CK automation recipes for the MLPerf inference benchmark:

ck-mlperf-inference

Roff

ck-graph-analytics

Collective Knowledge repository with workflows and packages for graph analytics applications

minimal CK components for ML

ck-ml-min

Collected experimental results in the CK format from the ReQuEST@ASPLOS'18 tournament on reproducible SW/HW co-design of Pareto-efficient deep learning for the following submission:

ck-request-asplos18-results-resnet-tvm-fpga

reproindex

[OUTDATED] Index of reproduced papers with reusable research components and unified workflows. Moved to

CK workflow, portable packages and other artifacts for the ReQuEST-ASPLOS'18 submission:

ck-request-asplos18-iot-farm

ARM's workloads in the universal Collective Knowledge Format with JSON API and JSON meta information to power Workload Automation Framework

ck-wa-workloads

Description of reusable and customizable AI artifacts in the Collective Knowledge format (can be automatically installed, plugged to CK workflows and collaboratively optimized across diverse hardware/models/data sets/libraries):

ck-ai

Collective Knowledge repository for Kalray's KaNN

ck-kann

MLPerf inference submissions v3.0 playground

mlperf_inference_submissions_v3.0

Brainstorming and prototyping the 3rd generation of the Collective Knowledge technology:

ck-x

submissions_tiny_v1.1_by_taskforce_on_auto_and_repro

Automation and Reproducibility Study for TinyMLPerf

ck-coral

Collective Knowledge workflows for the Coral EdgeTPU accelerator

Community submission to MLPerf inference v3.1 part 1

mlperf_inference_submissions_v3.1a

CK repository: large artifacts (HOG experiments) for CK-related papers

reproduce-ck-paper-large-experiments

Prototyping CK workflows for ML training

ck-tbd-suite

Community submission to MLPerf inference v3.1

mlperf_inference_submissions_v3.1

ck-assets

Public CK resources (interactive articles, slides, figures, tables, etc)

Single-node betweenness centrality demo by Flavio Vella

ck-bc

ck-crowdtuning-results

Public results in the Collective Knowledge Format (JSON meta data) from collaborative optimization of computer systems. See live repository:

ck-crowd-papers

Collaborative research papers auto-generated via Collective Knowledge framework with the help of the community

reproduce-sysml19-paper-p3

Reproducibility report and the Collective Knowledge workflow for the SysML'19 paper "Priority-based Parameter Propagation for Distributed DNN Training"

MLPerf inference v4.1 community submissions

mlperf_inference_submissions_v4.1

ck-request-asplos18-results-mobilenets-armcl-opencl

Collected experimental results in the CK format from the ReQuEST@ASPLOS'18 tournament on reproducible SW/HW co-design of Pareto-efficient deep learning for the following submission:

Roff

ck-wa-extra

Extra resources in the Collective Knowledge Format for ARM's Workload Automation Framework:

Collected experimental results in the CK format from the ReQuEST@ASPLOS'18 tournament on reproducible SW/HW co-design of Pareto-efficient deep learning for the following submission:

ck-request-asplos18-results-caffe-intel

ck-request-asplos18-results-mobilenets-tvm-arm

Collected experimental results in the CK format from the ReQuEST@ASPLOS'18 tournament on reproducible SW/HW co-design of Pareto-efficient deep learning for the following submission:

ck-spack

Collective Knowledge repository with CK package and virtual environment front-end for Spack packages: