Discover LAION-AI/interesting-text-datasets Open Source project

Stars
33
Rank 783,877 (Top 16 %)
Language
Created about 2 years ago
Updated over 1 year ago

LAION-AI

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Python

37,011

audio-dataset

Audio Dataset for training CLAP and other models

Python

616

CLIP_benchmark

CLIP-like model evaluation

Jupyter Notebook

601

dalle2-laion

Pretrained Dalle2 from laion

Python

499

CLAP

Contrastive Language-Audio Pretraining

Python

479

natural_voice_assistant

Python

439

laion-3d

Collect large 3d dataset and build models

253

phenaki

A phenaki reproduction using pytorch.

Python

218

aesthetic-predictor

A linear estimator on top of clip to predict the aesthetic quality of pictures

Jupyter Notebook

199

Open-Instruction-Generalist

Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks

Python

195

ldm-finetune

Home of `erlich` and `ongo`. Finetune latent-diffusion/glid-3-xl text2image on your own data.

Python

169

scaling-laws-openclip

Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)

Jupyter Notebook

152

CLIP-based-NSFW-Detector

Python

135

laion-datasets

Description and pointers of laion datasets

HTML

131

laion-dreams

Aim for the moon. If you miss, you may hit a star.

121

laion.ai

HTML

110

AIW

Alice in Wonderland code base for experiments and raw experiments data

Python

108

LAION-5B-WatermarkDetection

Python

102

video-clip

Let's make a video clip

Open-GIA

O-GIA is an umbrella for research, infrastructure and projects ecosystem that should provide open source, reproducible datasets, models, applications & safety tools for Open Generalist Interactive Agents (O-GIA). O-GIA systems will act in collaboration with human or autonomously, supporting various kind of validated decision making and assistance.

General-GPT

Jupyter Notebook

Discord-Scrapers

Implementation of a discord channel scraper to generate datasets.

Python

Text-to-speech

Python

Big-Interleaved-Dataset

Python

riverbed

Tools for content datamining and NLP at scale

Python

OCR-ensemble

Jupyter Notebook

Conditional-Pretraining-of-Large-Language-Models

Python

blade2blade

Adversarial Training and SFT for Bot Safety Models

Python

temporal-embedding-aggregation

Aggregating embeddings over time

Python

deep-image-diffusion-prior

Inverts CLIP text embeds to image embeds and visualizes with deep-image-prior.

Jupyter Notebook

watermark-detection

A repository containing datasets and tools to train a watermark classifier.

Python

medical

This repository will be a summary and outlook on all our open, medical, AI advancements.

Jupyter Notebook

Anh

Anh - LAION's multilingual assistant datasets and models

Python

laion50BU

Un-*** 50 billions multimodality dataset

conditioned-prior

(wip) Use LAION-AI's CLIP "conditoned prior" to generate CLIP image embeds from CLIP text embeds.

Python

LAION-SAFETY

An open toolbox for NSFW & toxicity detection

Jupyter Notebook

opendream

Frontend (and soon also midleware and backend) for a new, opensource image generation platform.

TypeScript

laion5B-paper

Building the laion5B paper

laion-dedup

Python

notebooks

A collection of generative and training notebooks getting mirrored to google colab.

Jupyter Notebook

laionide

This repository contains training code and checkpoitns for finetuning glide.

Python

super-resolution

This is the LAION repository for creating open super-resolution models with the help of LAION-5B subsets.

dataset-spec

Describe the format of image/text datasets

Python

LAION-PEOPLE

This project provides a data set with bounding boxes, body poses, 3D face meshes & captions of people from our LAION-2.2B. Additionally it provides clusters based on the poses and face meshes and pose-related captions based on these cluster assignments.

image-deduplication-testset

project-menu

laion-ai.github.io

dataset-usage

This repository is a summary of all systems and scientific papers that use LAION datasets.

repository-overview

This repository will give a quick overview of all projects and repositories from LAION.

LionizeR

Experiments with Summarization, Long Context and Retrieval

Python

KAISER

Knowledge Acquisition and Interlinking via Semantic Embeddings and Reasoning

lucidrains-projects

A summary of all lucidrains repositores and links to training / research approaches by LAION or other communities.

Jupyter Notebook

decentralized-learning

A basic setup for decentralized-learning that can be used for training future DALLE/CLIP/CLAP models.

diffusion-prior

DALL-E2 diffusion prior

Python

GIF

General / Global Inference Framework

Python

website

This is the development repository of the LAION-AI website.

HTML

safety-pipeline

A collection of safety classifiers and models to process image and texts.

Python

NeoGen

laion5b-subsets

Creating subsets from laion5b via embeddings search

Jupyter Notebook

human_artifacts

A repo containing images for artifact annotation.

public-relations

All media / publicity on LAION and related stuff!

public-domain-images

A collection of public domain images donated for ML training.

math_problems-step-by-step_solutions

Here we provide and collect many functions to generate math problem and step by step solutions for LLM training

Python

language-models

dataset-inference

The new repository for the genral inference pipeline.

Python

introduction-resources

Recommended intro resources

balanced-laion5b

This repository shall help finding a good distribution for huge datasets like LAION-5B for more efficient training.

hand-inference

A model to run hand inference on a cluster.

Jupyter Notebook

BUD-E_V1.0

BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the creation and integration of diverse skills for educational and research applications.

laion5b-bias

This repository is a collection of found biases in the LAION-5B dataset.

dataset-tasks

datasets that should be downloaded & converted to our standard training formart.

LAION-AUDIO

This repository contains prompts & best practices to annotate audio clips with a very high degree of details using Audio-Language-Models

AIW_webpage

Alice in Wonderland project and initiative webpage

LAION-AI/interesting-text-datasets

LAION-AI

Reviews

Repository Details

More Repositories