• Stars
    star
    2
  • Language
    Shell
  • Created about 3 years ago
  • Updated about 3 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Airflow and Spark-Kubernetes at Scale

More Repositories

1

AcidOnSpark-ETL

Delta-Lake, ETL, Spark, Airflow
Python
42
star
2

whisper-chat

A very secure personalized chat room
HTML
18
star
3

deepface-app

Full stack data-science project
Kotlin
11
star
4

micro-telesys

super cool microservice
Python
8
star
5

spark-streaming-k8s

Developing and deploying Spark Streaming on Kubernetes!
Shell
6
star
6

FraudDetction-API

A real-time web app that classifies the fraud from credit-card's transaction data
Jupyter Notebook
4
star
7

BTC-Alarming

Bitcoin changes alerting.
Python
4
star
8

IOT-Distributed-DataLake

An Iot Application using Spark, DeltaLake, Hive, Minio, Presto, Superset and Airflow.
Python
4
star
9

Api-load-testing

load testing with locust
Python
2
star
10

real-time-datalake

A real time data warehouse architecture with kafka, flink, clickhouse, presto.
Dockerfile
2
star
11

predictive-maintenance-microservice

A nameko predictive service for remainting useful life with fastapi as webservice
Jupyter Notebook
2
star
12

distributed-ml-service

In this project based on user's dataset and required model type the a classifier will be trained!
Python
2
star
13

superset-docker

A full docker image of superset for all databases
Shell
1
star
14

lafemme

Spark ETL on HDFS, Hive, Delta Lake using scala API
Shell
1
star
15

f-on-top

Test in action
Python
1
star
16

rec-music

Music recommender deployed on heroku
Python
1
star
17

crystalline

Apache Beam ETL Pipeline with Python
Python
1
star
18

ml-jobs-spark

Getting some ml projects done with scala and spark!
Scala
1
star
19

scalable-stream-processing

distributed stream processing using faust
Python
1
star
20

presto-docker

Docker image for presto workings
Dockerfile
1
star
21

citro-m

Logs monitoring with kafka topics and Elk stack.
Jupyter Notebook
1
star
22

minium

Fastapi deployment with kubernetes and docker registery
Makefile
1
star
23

html_parser

Python
1
star
24

redbus-data-warehouse-pipeline

Realtime distributed data warehouse with timescaledb and presto
Python
1
star
25

shopping-app

This projects is build with Django and using Graphql for routing.
JavaScript
1
star