• Stars
    star
    1
  • Language
    Python
  • License
    MIT License
  • Created over 1 year ago
  • Updated 8 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Example AWS DMS ingestion pipeline to Apache Hudi tables in S3

More Repositories

1

kube-no-trouble

Easily check your clusters for use of deprecated APIs
Go
2,812
star
2

kubeip

Assign static public IPs to Kubernetes nodes (GKE, EKS)
Go
379
star
3

bigquery-grafana

Google BigQuery Datasource Plugin for Grafana. (NO LONGER MAINTAINED)
TypeScript
240
star
4

gcpinstances.info

GCPinstances.info source code
Python
170
star
5

secrets-init

minimalistic init system for containers with AWS/GCP secrets support
Go
156
star
6

kube-secrets-init

Kubernetes mutating webhook for `secrets-init` injection
Go
146
star
7

zorya

Google Cloud Instance Scheduler helping to reduce costs by 60% on average for non-production environments.
JavaScript
140
star
8

secure-gcp-reference

Best practice example for secure and compliant Google Cloud Platform infrastructure
98
star
9

gSlack

Get Slack notifications from Google Cloud Platform
JavaScript
72
star
10

iris3

An upgraded and improved version of the Iris automatic GCP-labeling project
Python
68
star
11

gtoken

Securely access AWS services from GKE cluster
Go
67
star
12

SafeScrub

Safely delete unwanted resources in a GCP project, clearing clutter and saving money.
Shell
65
star
13

bigquery-optimization-queries

Queries to assist with BigQuery cost and performance.
Python
56
star
14

gpu-finder

Python
55
star
15

banias

Opinionated serverless event analytics pipeline
Go
43
star
16

janus

Janus is a simple way to assume AWS Role with Google Cloud Service Account
Python
38
star
17

ClusterCloner

Clone Kubernetes clusters (VM infrastructure, not K8s objects) to/from AWS EKS, GCP GKE, and Azure EKS.
Go
31
star
18

doit-composer-airflow-training

Getting started with Apache Airflow on Cloud Composer
Python
29
star
19

bq-snitch

Get visibility into expensive Google BigQuery queries on Slack
Python
27
star
20

gke-fundamentals-workshop

Shell
25
star
21

bqtop

Visualizing BigQuery query jobs with Cloud Functions, Firebase and Pub/Sub
JavaScript
25
star
22

CloudBlaster

Kotlin
22
star
23

AWSlack

Get Slack notifications on AWS CloudWatch events
JavaScript
19
star
24

Cloud-Tasks-In-Process-Emulator

Google doesn't offer an emulator for the Cloud Tasks API, as it does for Datastore or PubSub. This project answers that need with a single short Python module intended to be copied to your codebase.
Python
18
star
25

gcp-monitoring-metric-exporter

Python
17
star
26

workload-identity-analyzer

A tool to analyze a workload running in GKE and make sure that Workload Identity is configured properly
Python
16
star
27

dataflow-kafka-to-bq

Dataflow template which read data from Kafka (Support SSL), transform, and outputs the resulting records to BigQuery
Java
12
star
28

cloud-catalog

Extract categories and services (as unified JSON) for major public cloud services.
Python
11
star
29

doit-easily-marketplace

Python
10
star
30

AI-Platform-Notebook-Using-Custom-Container

Example for using AI platform notebook - custom container from scratch.
Shell
10
star
31

gcs-stats

Easily analyze the size of Google Cloud Storage buckets regardless of their size
JavaScript
10
star
32

aws-eks-sample-templates

The repository contains the sample templates to get started with AWS EKS quickly
9
star
33

secrets-consumer-webhook

Kubernetes mutation webhook for secrets-consumer-env - Automatically inject secrets to Pod
Go
9
star
34

gke-https-redirect

Demonstration how to use the newly introduced https redirect support in native GKE ingress resources.
9
star
35

terraform-iac-demo

GitOps demo of Terraform infrastructure as code (IaC)
HCL
8
star
36

gcp-discover-orphaned-firewall-rules

Find orphaned firewall rules that are not applied to any VM instances in a shared VPC
Go
8
star
37

esop

Employee Stock Option Plan
8
star
38

eks-spot-to-ondemand-fallback

7
star
39

terraform-bq-scheduled-queries

This is a demo project to use Terraform to manage BigQuery scheduled queries with Cloud Build CI/CD
HCL
6
star
40

long_john_silver

Long running background tasks on cloud run
Go
6
star
41

bi-engine-statistics

a opinionated bi engine statistics dashboard for dashboard
LookML
6
star
42

ignite-gke

Running Apache Ignite on GKE the "right" way
Java
6
star
43

bq-snitch-app

Get visibility into expensive Google BigQuery queries on Slack
Python
6
star
44

terraform-gcp-templates

Generic Terraform GCP templates
HCL
5
star
45

azure-instances.info

HTML
5
star
46

QuickQuickstarts

The simplest quickstart scripts for running multiple web backend infrastructures in AWS and GCP.
Shell
5
star
47

dataflow-bigquery-schema-migrator-insert

Dataflow Bigquery Schema Migrator Insert
Java
5
star
48

spotzero

Update EC2 Auto Scaling groups in AWS account to use Spot instances.
Go
4
star
49

validating-admission-policy-playground

4
star
50

galactus

A tool for detecting unused Service Accounts and Service Account Keys on GCP
Python
4
star
51

gcp-alerting-cis-benchmarks

Configuration instructions for Cloud Monitoring alerts on Google Cloud Platform for additional security based on CIS benchmarks
4
star
52

private_cloud_sql

4
star
53

intercloud-throughput

Python
4
star
54

secrets-consumer-env

Consume secrets securely from AWS, GCP and Hashicorp Vault secret managers
Go
3
star
55

ec2-auto-tag

Python
3
star
56

elasticsearch-gke

Blueprint for creating production-grade ElasticSearch deployments with Elastic K8s Operator
Makefile
3
star
57

ferent

Clojure
3
star
58

cre-playbooks

A collection of playbooks to help CREs solve problems more efficiently
3
star
59

docs-gitbook-cmp

ARCHIVED: GitBook repository for the DoiT Cloud Management Platform (CMP) User Documentation
Shell
3
star
60

docops

Common resources for doing DocOps at DoiT
Python
3
star
61

terraform-provider-doit-console

Terraform provider for DoiT API platform
Go
3
star
62

doit-eks-lens-helm-chart

Smarty
3
star
63

Security-Checklist-for-Workspace-Admins

A tool for Workspace administrators to review their security posture and inventory the admin SDK.
JavaScript
3
star
64

docops-devcontainer

DocOps devcontainer
2
star
65

next23-genai-demo

Jupyter Notebook
2
star
66

gke-ssh

HCL
2
star
67

platform-iac

DoiT platform infrastructure as a code templates
HCL
2
star
68

gcp-python-auth

Python
2
star
69

cloud-run-go-boilerplate

Go
2
star
70

GCP-Workshop

GCP Workshops
2
star
71

calculate-cloudfront-aos

Calculate CloudFront Average Object Size (AOS) using Cost Explorer API
Python
2
star
72

gceinstances

Inspired by ec2instances.info, this is a summary page for Google Compute Engine instances
HTML
2
star
73

docops-python

DoiT International DocOps Python library and CLI program
Shell
2
star
74

mysql-57-eol

Documents to help guide customers through MySQL 5.7 End of life
2
star
75

cf-google-cloud

Creating Google Cloud resources using AWS CloudFormation
Java
2
star
76

tf-fundamentals-workshop-101

Basic workshop on the topic of Terraform in the context of AWS
HCL
2
star
77

looker-cph-event

LookML
1
star
78

robust-multicloud

Kotlin
1
star
79

help

DoiT International Help Center and product documentation
JavaScript
1
star
80

secret-manager-nodejs-example

JavaScript
1
star
81

assembly-pipeline

Shell
1
star
82

cloudbuild-demo

JavaScript
1
star
83

demo-gke-pubsub-consumer

JavaScript
1
star
84

clojure-exercises

Clojure
1
star
85

poc-gcp-nextflow

Nextflow + GCP + LifeSciencesAPI + Compute Engine + NextflowTower + Workflows
1
star
86

app-engine-firebase-identity

BYO Identity through Firebase
Python
1
star
87

dynamodb-lens

Python
1
star
88

cloudrun-cloudsql-psc

Accessing CloudSQL with Private Service Connect enabled from Cloud Run
1
star
89

zen-dog

Tool to sync crucial zendesk configuration from code
1
star
90

gcp-auto-tag

Python
1
star
91

locust-demo

Python
1
star
92

GCP-Custom-metric-monitoring

Easy python script to publish custom metrics to stackdriver
Python
1
star
93

GCP-DR-Checklist

Disaster Recovery Plan - Checklist
1
star
94

gke-node-autoscheduler-poc

HCL
1
star
95

next24-genai-demo

Gen AI Demo for Google Next'24. This is a RAG system with Agents to retrieve project specific cost and combine it with DoiT blog posts to deliver a analysis on how to reduce cost.
Jupyter Notebook
1
star
96

eks-lens-agent

Go
1
star
97

aws-help

Help Docs for DoIT AWS Customers
1
star
98

gcp-qms

Quota Monitoring Solution support files for Google Cloud Platform
Shell
1
star
99

simple-cloud-run

Sometimes it's amazing how simple Google Cloud can be - this time Cloud Run
Go
1
star
100

developer-envs

HCL
1
star