Discover miztiik/stream-etl-with-glue Open Source project

Stars
7
Rank 2,294,772 (Top 46 %)
Language
Python
Created over 3 years ago
Updated over 3 years ago

miztiik

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Serverless streaming ETL in with glue job & querying with Athena

AWS-Demos

A hands on repo with multiple demonstrations on AWS 🎓

Python

507

my-first-cdk-project

A hands on repo with multiple demonstrations on CDK: Used by Udemy Course🎓

Python

aws-real-time-use-cases

Repo of quick starts for real time AWS use cases 🎓

serverless-s3-to-elasticsearch-ingester

AWS Lambda function to ingest application logs from S3 Buckets into ElasticSearch for indexing

Python

DevOps-Demos

Repository to host my DevOps Experiments 🎓

dev-sec-ops

Advanced AWS Security Automation Resources: Used by Udemy Course 🎓

Python

server-migration-onprem-to-aws

Simple demonstration on how to Lift & Shift OnPremise workload to AWS 🎓

secure-private-api

AWS API Gateway Security Deep dive

Python

serverless-cloudwatch-logs-exporter

AWS Serverless Lambda function that sends log data from CloudWatch Logs and S3 🎓

Python

s3-to-rds-with-glue

Extract, transform, and load data for analytic processing using AWS Glue

Python

Serverless-AMI-Baker

Lambda to create AMI of your instances and tag them for replication or auto deletion

Python

Serverless-GuardDuty-Findings-to-SNS

A lambda function to push GuardDuty Findings to SNS Topic 🎓

Python

security-incident-response-instance-isolation

Automation ☁️AWS Security 👮- Incident Response using Lambda⚡️to prevent credential exfiltration

Python

serverless-backup

A simple AWS Boto3 script to trigger EBS Snapshots using Lambda Functions🎓

Python

elk-stack

An IaaS Implementation of ELK Stack 🎓

serverless-ami-replicator

Python(Boto) Script to replicate AMI across AWS Regions using Lambda (Serverless) Functions

Python

api-with-stage-variables

Use Stage Variables in API Gateway to point to different version of AWS Lambda Functions.

Python

emr-on-eks

Run EMR workloads on EKS

Python

run-ansible-playbook-from-ssm

Execute configuration management directives using Ansible on your instances using State Manager.

serverless-iam-key-sentry

Find and list Access Keys older than certain date

Python

serverless-kms-key-rotator

AWS KMS Encryption & Decyption using CLI & Lambda

Python

serverless-monitor-for-unused-iam-roles

Monitor Unused IAM Roles 🎓

Python

cdk-demos

A repository to hold my AWS Cloud Deployment Kit Demos 🎓

Python

reliable-queues-with-retry-dlq

Reliable Message Processing with Dead-Letter-Queues Replay

Python

serverless-kms-sentry

A simple lambda function to monitor certain KMS events through cloudtrail and notify users or security team through slack.

Python

serverless-image-processor

Process images uploaded to S3 using lambda services 🎓

Shell

improve-db-perf-with-rds-proxy

Improve Databases Performance & Availability with RDS Proxy

Python

AWS-Auto-Tagging

A python script to automatically scan and tag AWS Resources 🎓

Python

serverless-janitor-ebs-snapshots

A serverless(AWS Lambda) janitor to clean up old and unused EBS Snapshots 🎓

Python

lex-faq-bot

A simple conversational chat bot using AWS Lex, Lambda, DynamoDB

Python

serverless-ebs-penny-pincher

A Python Boto Repo to remove EBS Volumes without the requisite tags or no tags

Python

serverless-janitor-for-ami

An AWS Lambda function to automatically de-register AMIs beyond retention date and remove the corresponding EBS Snapshots

Python

serverless-code-commit-repo-event-notifier

AWS Lambda Function Trigger for an CodeCommit Event & Push to Slack 🎓

Python

scale-eks-with-keda

Event Driven Scaling Architecture with Kubernetes KEDA on AWS

Python

setup-aws-code-commit

How to setup AWS Code Commit using SSH and IAM roles. 🎓 Setup SSH key to enable IAM users to connect to Code Commit!

cross-account-ecr-access-control

Allow AWS Account B to be able to connect to Account A ECR image repository to push or pull images

migrate-from-github-to-codecommit

Migrate from Github to CodeCommit

fargate-with-efs

Run serverless containers with AWS Fargate and use persistent storage from Amazon EFS

Python

serverless-sg-sentry

Automatically Revert and Receive Notifications About Changes to Security Groups 🎓

Python

serverless-api-mutual-tls

Implement Mutual TLS auth for an API on AWS API Gateway

Python

serverless-janitor-for-security-groups

Automatically delete "launch-wizard" security groups created by AWS Console 🎓

Python

cloudera-On-Docker

clouderaOnDocker

Shell

redshift-demo

Simple getting started 1-node redshift cluster stack

Python

security-automation-respond-to-failed-ssh-access

Automation ☁️AWS Security 👮 using StepFunctions⚡️to monitor & defend SSH intrusion attempts

Python

serverless-async-lambda-api

Synchronous Vs Asynchronous Invocation with AWS Lambda

Python

Learn-Chef

Learn how to setup Hosted Chef Server to manage AWS EC2 Instances

Automated-Update-Management-in-AWS

Automated Patch and Update Management in AWS 🎓

event-driven-with-eventbridge

Event Driven Architecture with EventBridge & Lambda

Python

security-automation-remediate-unintended-iam-access

AWS☁️ Security 👮Automation using Lambda⚡️to monitor & defend unintended IAM Access

Python

security-automation-remediate-unintended-s3-object-acl

Automation ☁️AWS Security 👮 using StepFunctions⚡️to enforce object acls and keep them private

Python

event-processor-on-eks

Event Driven Architecture with Kubernetes on AWS

Python

secure-api-with-throttling

Learn how to prevent your API from being overwhelmed by too many requests

Python

dynamodb-streams-processor

AWS Lambda trigger to process new items in a stream from a DynamoDB table.

Python

reliable-sqs-with-dlq

Reliably process messages in queue with dead-letter queues in SQS

Python

url-filtering-with-nw-firewall

Deploy a firewall that should allow or drop traffic based on customisable rules

Python

api-request-validation

Validate your API requests using API Gateway | Reduce cost & Improve Performance

Python

serverless-machine-learning-api

Serverless Machine Learning API: Use PyTorch in AWS Lambda for Inference

Python

Docker-Compose-Node-on-MongoDB

Multi Container Web Application using Docker Compose

JavaScript

security-automation-monitor-users-with-excessive-privileges

AWS☁️ Security 👮Automation using Config to monitor IAM Users with excessive privileges

Python

cloudfront-auth-at-edge

Authorization@Edge – Use Lambda@Edge and JSON Web Tokens to enhance Web Application Security

CSS

serverless-cloudwatch-log-retention

Lambda function to automatically set the retention policy of CloudWatch Log 🎓

Shell

security-automation-remediate-weak-s3-policy

Automation ☁️AWS Security 👮 using StepFunctions⚡️to remediate weak s3 bucket policies📦

Python

dynamodb-global-tables

Amazon DynamoDB global tables provide a fully managed solution for deploying a multi-region, multi-master database.

serverless-s3-event-processor

AWS Lambda to process new S3 Objects - For ex, Image Resizing, Object Recognition, Insert to DynamoDB etc.

Shell

attribute-based-access-control-ec2

Automation ☁️AWS Security 👮- Attribute Based Access Control for EC2 🎓

Python

aws-config-tag-enforcement

AWS Config for TAG Enforcement

s3-object-lambda-demo

S3 Object Lambda - Process S3 Retrieved Data Inflight

Python

alexa-skills

A repository to hold all my alexa-skills

Python

uTorrent-On-Alpine-Linux

Docker container to run Torrent (uTorrent) Server on Alpine Linux

aws

Serverless and Event driven solutions using AWS services

Python

azure-scale-vmss-on-events

Scale Azure VM Scale Sets in response to events. For ex, based on queue length

Bicep

improve-ec2-performance

Use Jumbo Frames - MTU to improve EC2 performance

Python

fargate-chat-app

fargate-chat-app 🎓

JavaScript

cfn-challenges

Learn AWS CloudFormation in a fun way with these templates: Used by Udemy Course🎓

HTML

ebs-gp3-perf

EBS Volume Performance Tests on AWS r5b using fio

Python

web-server

A sample web server using nginx container 🎓

HTML

Python-Demos

Collection of python samples and demos

Python

secure-s3-with-access-points

Easily Manage Shared Data Sets with Amazon S3 Access Points

Python

tumbling-window-stream-analytics

Streaming analytics using Tumbling Windows

Python

Movie-OmdbMetadata-Fetcher

A Google App Script to read the movie year and title from Google Spreadsheet and fetch the metadata for the media through the OMDB API

JavaScript

batch-job-runner

batch-job-runner 🎓

Shell

serverless-video-metadata-processor

Extract video file metadata for file uploaded to S3 Bucket using AWS Lambda 🎓

Python

eks-persistent-storage-with-efs

Persistent storage for Kubernetes using AWS EFS

Python

serverless-aws-resource-tagger

AWS Lambda function to tag resources to ensure compliance

elasticache-for-app-performance

Improve application performance using ElastiCache Redis 🎓

Python

llm-bootcamp

Jupyter Notebook

glue-elastic-views-on-s3

AWS Glue Elastic Views: replicate data across multiple AWS data stores to use with your applications without having to write custom code

Python

eks-security-with-security-group

Secure kubernetes with AWS Security Groups

Python

restrict-ec2-launch-to-cloudformation

Restrict EC2 Launch Only through Cloudformation 🎓

serverless-poll-app

mssql-to-rds-mssql

A walkthrough to guide you through the process of migrating from Microsoft SQL Server to Amazon RDS for SQL Server

Python

azure-open-telemetry-tracing

Bicep

mysql-to-rds

A walkthrough to guide you through the process of migrating from MySQLDB to Amazon RDS MySQL

Python

xray-lambda-profiler

A simple project to show how to profile lambda calls using AWS XRay 🎓

Python

eks-log-shipping-with-fluentbit

Kubernetes(EKS) Application Logging using FluentBit

Python

restrict-ec2-launch-to-clouformation

azure-vm-to-storage-queue

Read & Write to Azure Storage Queue from VM scoped with Managed Identity permissions using Python SDK

Bicep

event-streams-with-managed-kafka

Event Driven Architecture with Kafka & Lambda

Python

uTorrent-On-CentOS-Docker-Container

uTorrent on CentOS 6.6 in docker container

100

serverless-todo-app

Vue

miztiik/stream-etl-with-glue

miztiik

Reviews

Repository Details

More Repositories