Discover databrickslabs/arcuate Open Source project

Stars
22
Rank 1,048,934 (Top 21 %)
Language
Python
License
Other
Created over 2 years ago
Updated 11 months ago

databrickslabs

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Delta Sharing + MLflow for ML model & experiment exchange (arcuate delta - a fan shaped river delta)

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Python

10,811

pyspark-ai

English SDK for Apache Spark

Python

739

dbx

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.

Python

440

dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

Python

313

tempo

API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation

Jupyter Notebook

306

mosaic

An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

Jupyter Notebook

270

overwatch

Capture deep metrics on one or all assets within a Databricks workspace

Scala

226

ucx

Automated migrations to Unity Catalog

Python

220

cicd-templates

Manage your Databricks deployments and CI with code.

Python

202

automl-toolkit

Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Model selection and training, Hyper parameter optimization and selection, Model interprability.

HTML

191

migrate

Old scripts for one-off ST-to-E2 migrations. Use "terraform exporter" linked in the readme.

Python

186

dlt-meta

Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines

Python

147

dataframe-rules-engine

Extensible Rules Engine for custom Dataframe / Dataset validation

Scala

134

discoverx

A Swiss-Army-knife for your Data Intelligence platform administration.

Python

105

geoscan

Geospatial clustering at massive scale

Scala

jupyterlab-integration

DEPRECATED: Integrating Jupyter with Databricks via SSH

HTML

smolder

HL7 Apache Spark Datasource

Scala

feature-factory

Accelerator to rapidly deploy customized features for your business

Python

databricks-sync

An experimental tool to synchronize source Databricks deployment with a target Databricks deployment.

Python

doc-qa

Python

transpiler

SIEM-to-Spark Transpiler

Scala

brickster

R Toolkit for Databricks

delta-oms

DeltaOMS is a solution that help build a centralized repository of Delta Transaction logs and associated operational metrics/statistics for your Delta Lakehouse. Unity Catalog supported in the v0.7.0-rc1 release.Documentation here - https://databrickslabs.github.io/delta-oms/v0.7.0-rc1/

Scala

pytester

Python Testing for Databricks

Python

remorph

Cross-compiler and Data Reconciler into Databricks Lakehouse

Scala

splunk-integration

Databricks Add-on for Splunk

Python

dbignite

Python

databricks-sdk-r

Databricks SDK for R (Experimental)

tika-ocr

Rich Text Format

sandbox

Experimental or low-maturity things

blueprint

Baseline for Databricks Labs projects written in Python

Python

delta-sharing-java-connector

A Java connector for delta.io/sharing/ that allows you to easily ingest data on any JVM.

Java

partner-connect-api

Scala

pylint-plugin

Databricks Plugin for PyLint

Python

lsql

Lightweight SQL execution wrapper only on top of Databricks SDK

Python

waterbear

Automated provisioning of an industry Lakehouse with enterprise data model

Python

databrickslabs/arcuate

databrickslabs

Reviews

Repository Details

More Repositories