Ismail Dawoodjee (@ismaildawoodjee)
github

ismaildawoodjee

Twitter logo Share LinkedIn logo Share Facebook logo Share

Top repositories

1

GreatEx

A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in Airflow.
Python
19
star
2

aws-data-pipeline

A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from locally hosted Airflow containers. The end product is a Superset dashboard and a Postgres database, hosted on an EC2 instance at this address (powered down):
Python
14
star
3

Forecasting-Intermittent-Demand

Data Mining Cup 2020
Jupyter Notebook
3
star
4

ADExploitation-Obsidian-CheatSheet

Obsidian-friendly cheatsheets for Active Directory enumeration and exploitation
2
star
5

Great-Expectations-for-CSV

Ensuring data quality in an e-commerce data set using Great Expectations.
Jupyter Notebook
1
star
6

Python-Spellchecker-GUI

A purely Pythonic spellchecker with an integrated user-friendly GUI, built from an economics textbook corpus.
Python
1
star
7

Superset-and-Metabase

Shell
1
star
8

product-catalogue

Web scraping task to obtain industrial equipment data and produce a product catalogue out of it. From this page:
Python
1
star
9

NocoDB-and-Baserow

Python
1
star
10

nifi-data-pipeline

πŸ“¦ Containerizing everything from the book "Data Engineering with Python"
Python
1
star
11

spark-big-data

Spark with Scala. Big data project to analyze 35 GB Parquet data (~400 GB as decompressed CSV) and extract business insights from it
Scala
1
star