Explore @getindata Open Source projects

122

kafka-connect-iceberg-sink

Adapter for dbt that executes dbt pipelines on Apache Flink

dbt-flink-adapter

Kedro Plugin to support running workflows on Kubeflow Pipelines

kedro-kubeflow

Library to convert DBT manifest metadata to Airflow tasks

dbt-airflow-factory

Kedro plugin to support running workflows on Microsoft Azure ML Pipelines

kedro-azureml

Kedro Plugin to support running workflows on GCP Vertex AI Pipelines

kedro-vertexai

Kedro Plugin to support running pipelines on Kubernetes using Airflow.

kedro-airflow-k8s

apache-nifi-kubernetes

Shell

datapill

Big Data Newsletter

data-pipelines-cli

CLI for data platform

streaming-jupyter-integrations

doge-datagen

Kedro Plugin to support running pipelines on AWS SageMaker.

kedro-sagemaker

Data science project development best practices and state of the art open-source tooling forged into a set of solved ML use cases to serve as blueprints for efficient prototyping.

quickstart-ml-blueprints

GetInData Helm Charts repository

helm-charts

Smarty

flink-dynamic-cep-demo

Flink dynamic CEP demo

Custom Atlantis docker image developed by GetInData

docker-atlantis

Shell

awesome-getindata-recommended-sources

A curated list of links to sources of latest updates in data/ml/ai

kedro-snowflake

Kedro Snowflake / Snowpark plugin

jupyterlab-mlflow-extension

TypeScript

first-steps-with-data-pipelines

A library that allows using Spring dependency injection framework in Flink Jobs

flink-spring

Receipes of publicly-available Jupyter images

jupyter-images

Shell

terraform-azurerm-atlantis

Terraform module for deploying Atlantis in Azure Container Group

Terraform module for managing Snowflake role and grants

terraform-snowflake-role

Terraform module template - boilerplate used to simplify creation of new Terraform modules

terraform-module-template

BigDataTutorial

Terraform Module for Azure Storage Account

terraform-azurerm-storage-account

The project contains templates for CICD processes

flink-use-case

Scala

gitlab_cicd_templates

flink-influxdb-reporter

mlflow-docker

Docker image for MLflow.

Python CLI for streaming platform

streaming-cli

Kedro starterts to quickly set up new projects according to QuickStart ML Blueprints practice.

quickstart-ml-starter

data-pipelines-template-example

The project contains an example of a template to create pipeline project with GetInData Framework based on DBT

Scripts setting up infrastructure for trainings

training-infra

Terraform module for AWS Organization management

terraform-aws-organization

flink-tutorial-old

dbt-images

Module for generating Atlantis repo config file. It contains set of custom workflows

terraform-null-atlantis-repo-config

Kedro starters by GetInData

kedro-starters

kafka-avro-producer

Flink Catalog for Elasticsearch.

flink-elastic-catalog

Terraform module for managing Snowflake database

terraform-snowflake-database

feast-kafka-postgres-demo

Framework for scheduling Flink SQL jobs on AWS Elastic MapReduce or a standalone Flink cluster.

flink-sql-runner

Demo of running SciKit model on Flink, using Mleap serialization

streaming-ml-with-flink

Scala

terraform-azurerm-mlflow

Module for deploying serverless MLflow instance on Azure, using Serverless SQL Server, Container App Service and Azure Blob Storage.

Docker image template - boilerplate used to simplify creation of new docker images

docker-image-template

This repository contains an example project showing how to run distributed PyTorch training on Azure ML pipelines with Kedro. See the related blogpost.

example-kedro-azureml-pytorch-distributed

Example of how to use kedro-airflow plugin and GKE cluster/composer together.

kedro-airflow-gke-example

Collection of reusable GitHub Actions workflows

github-workflows

terraform-azurerm-public-ip

Terraform module for managing Azure Public IP

flink-tutorial

Terraform module for creating snowflake users

terraform-snowflake-user

Terraform module for Snowflake Warehouse management

terraform-snowflake-warehouse

Terraform module for deploying MLflow on Google Cloud AppEngine Flexible

mlflow-appengine-terraform

A set of pre-commit hooks for Looker

looker-pre-commit

flink-workshop-task

tpc-h-data-pipelines-demo

Terraform module for Snowflake AWS PrivateLink management

terraform-snowflake-privatelink-aws

data-formats-benchmark

Terraform module to manage AWS Budgets

terraform-aws-budget

Skeleton for Spark Application with HiveContext and tests

test-spark-app

Scala

mlops-gcp-vertex-snowflake-dbt

The repository contains code samples from "MLOPs for Pro's - Technical perspective. Build a Feature Store Faster - an Introduction to Vertex AI, Snowflake and dbt Cloud" ebook.

Repository with lab exercises and their solutions

gid-mdp-workshop

streaming-ml-with-ksql

Demo of running Spark MLLib model on Kafka with KSQL, using Mleap serialization

Terraform Module for creating Azure Container Group

dp-framework

terraform-azurerm-container-group

Example application for Kafka Streams training

kafka-streams-avro

All tools for local Ververica Platform setup with Flink SQL

ververica-platform-flink-workshop

flink-python-loader

Introductory repository to dbt with the use of data-pipelines-cli Topics Resources

dbt-intro

flink-beam-poc

The example for init template for Data Pipelines CLI tool

data-pipelines-cli-init-example

mlflow-demo

Terraform Module for Azure Subscription

terraform-azurerm-subscription

Creates dbt based GCP workflows.

dbt-workflows-factory

openlineage-bdtw-column-lineage

It contains macros shared between projects.

dbt-common-macros

kedro-pyspark-k8s-demo

Proxy to the internal Ververica Catalog via Ververica REST Api

flink-ververica-catalog-proxy

Terraform module for managing Snowflake schemas

terraform-snowflake-schema

terraform-gke-helm-release

GKE Helm release module