Discover godatadriven/pydantic-spark Open Source project

Fast iterative local development and testing of Apache Airflow workflows

185

whirl

[DEPRECATED] A dbt adapter for Excel.

179

dbt-excel

The iterative broadcast join example code.

iterative-broadcast-join

This library can convert a pydantic class to a avro schema or generate python code from a avro schema.

pydantic-avro

Pytest plugin for dbt core

pytest-dbt-core

airflow-testing-examples

rhyme-with-ai

Rhyme with AI

Extract data from JIRA through REST and create charts.

jiraview

scala-spark-application

General solution to archetype LLM batch use case

llm-archetype-batch-use-case

Genetic algorithms and the game of Risk

risk-analysis

Prediction Intervals with specific value prediction

piven

This repository contains code to build an MVP search engine with google like interface.

build-your-own-search-engine

Code that was used as an example during the Data+AI Summit 2020

dbt-data-ai-summit

airflow_workspace

Workspace for Airflow training, inlcuding docker and docker compose

Dockerfile

python-devcontainer-template

Shows you how to use a Devcontainer for your Python project 🐳♡🐍

Skeleton project for Apache Airflow training participants to work on.

airflow-training-skeleton

Instant Hadoop cluster with Ansible and Cobbler - Just Add Water.

ansible_cluster

Example project demonstrating easy, concise and typechecked JDBC access

airflow-helm

Smarty

doobie-monix-jdbc-example

ParallelConnection

Tagging texts with tags automatically

auto-tagger

Get started with open source LLMs on a GPU

openllm-starter

A utility tool to automate certain tasks with Jupyter notebooks.

asekuro

Deployment of databricks resources with cdk

databricks-cdk

Ansible scripts to create druid cluster

c4-model-example

ASL

druid-ansible

godatadriven-blog

Sources to our blog

HTML

organization-pr-scanner

Drop some Blox! The one who drops in the most efficient way wins! 🏆

dropblox

Spark job for converting the StackExchange Network data into parquet format.

stackexchange-parquet

In this tutorial, we will register a package in GCP Artifact Registry both manually as well as with CICD. In the end, you will be able to install your own private package with pip just like you're used to.

taster-sessions

private-package-in-gcp-tutorial

Kedro-Azureml-Starter

prometheus-kafka-offsets

Material for the DataMesh presentation at GoDataFest 2021

datamesh

A package to define features and create them via a simple API

feature_catalog

Gather and analyse Github contributions with dbt-duckdb

github-contributions

TypeScript

public_cloudera_on_azure

This is needed because the Azure template cannot read from a private github

Building a real-time analytics dashboard with Materialize and Metabase

code_breakfast_materialize_metabase

flink-streaming-xke

Example how to use Flink with Kafka

Java

pydantic-examples

godatadriven-vision

Computer vision with python and OpenCV

CSS

mlops-workshop

How to MLOps: Experiment tracking & deployment 📊

Tracks our pull requests in public repositories

pr-scraper

bigger simulations = moar profit

monopoly-analysis

Material for PyData Code Breakfast: Introduction to Deep Learning

code-breakfast-deep-learning

Scripts to provision NiFi to HDInsight

provision-nifi-hdinsight

A selection of notebooks coming from the GoDataDriven trainings

os-training-materials

HTML

dbt-bi-exposures

Python package that collects dbt exposure metadata from different BI providers such as Power BI, Tableau, Looker, Metabase, etc.

A lightweight data lake using dbt-duckdb

duck-pond

ddsw-2018-dsp-workshop

azureml_experiment_tracking_tutorial

Scripts that load data into hive and create a summary for it

hive-summary-loader

Repository for Club Cloud workshop on dbt + SodaSQL

clubcloud_dbt_soda

Hadoop Data Science workshop

hadoop-ds-workshop

Example repository to show how a minimal Python application can be built and deployed remotely as Azure Function.

azure_function_python_remote_build

HCL

azure_function_terraform

HCL

data-centric-ai-hackathon

Setting up your new Macbook with an install script.

mac-install

airflow-aks-dags

Hadoop smoke testing framework

hdp-smokey

tmnl-spark-graphs-training

February 2021 GDD Friday project of Roel, Rogier and Vadim

code_breakfast_tutorial

HTML

bandit-friday

Balancing Heroes and Pokemon in Real Time: A Streaming Variant of Trueskill for Online Ranking

balancing-heroes-and-pokemon