cleanlab/multiannotator-benchmarks

Stars
30
Rank 834,916 (Top 17 %)
Language
Jupyter Notebook
License
GNU Affero Genera...
Created about 2 years ago
Updated over 1 year ago

cleanlab/multiannotator-benchmarks

cleanlab

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Benchmarking algorithms for assessing quality of data labeled by multiple annotators

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

cleanvision

Automatically find issues in image datasets and practice data-centric computer vision.

label-errors

🛠️ Corrected Test Sets for ImageNet, MNIST, CIFAR, Caltech-256, QuickDraw, IMDB, Amazon Reviews, 20News, and AudioSet

examples

Notebooks demonstrating example applications of the cleanlab library

Jupyter Notebook

cleanlab-studio

Client interface for all things Cleanlab Studio

vizzy

Cleanlab Vizzy: illustrating the core ideas behind the Cleanlab algorithm

cleanvision-examples

Notebooks demonstrating example applications of the cleanvision library

Jupyter Notebook

culture

Our company culture

label-error-detection-benchmarks

Jupyter Notebook

cleanlab-tools

Miscellaneous code made available for purposes of education, reproducibility, and transparency

Jupyter Notebook

ood-detection-benchmarks

Evaluation of algorithms to detect out-of-distribution data

Jupyter Notebook

aws-marketplace

Documentation and Example Notebooks for using AWS Marketplace solutions from Cleanlab

Jupyter Notebook

regression-label-error-benchmark

Benchmark algorithms to detect erroneous label values in regression datasets

token-label-error-benchmarks

Benchmarking methods for label error detection in token classification tasks

Jupyter Notebook

cleanlab-studio-tutorials

Automated repo - do not touch

Jupyter Notebook

multilabel-error-detection-benchmarks

Benchmarking label error detection algorithms for multi-label classification

Jupyter Notebook