vicmar57/Web-server-logs-ETL-pipeline

Stars
1
Language
Python
Created almost 5 years ago
Updated over 4 years ago

vicmar57/Web-server-logs-ETL-pipeline

vicmar57

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

ETL streaming pipeline using python. generating a constant stream of fake web server logs, analyzing it, and storing in a PostgreSQL DB

OOP-Design-Patterns

Object Oriented Design Patterns implemented in java

GoodMovs---spring-microservices-movie-ratings

providing a simple app to track user movie ratings with java spring, using micro-services architecture (communicating through REST-API) with auto discovery (eureka) and fault tolerance (hystrix)

COVID-19-Live-Tweet-Analyzer-Kafka-Spark-Cassandra-and-Airflow

Analysing live tweets from twitter by generating a big data pipeline and scheduling it with Airflow (Using also Kafka for tweet ingestion, Cassandra for storing parsed tweets, and Spark for Analysis)

Java-projects

Academic java projects using OOP concepts (classes, interfaces, abstract classes, etc..)

Recipe-Calorie-Alert-using-Kafka

Building a system with Kafka, that parses recipes from an online API and alerts the user of recipes that exceed a calorie threshold. the system uses micro-services written in python, using Kafka-python.

Engineering-Project---Data-Extraction-from-Encrypted-Video-Streams

B.Sc Engineering Project: Data Extraction from Encrypted Video Streams - Exploiting video compression vulnerabilities to derive Motion Estimation in Encrypted video, using Machine Learning techniques.

Jupyter Notebook

Twitter-Kafka-Docker

Building a system with Kafka, that pulls live Twitter tweets from it's online API, parses them, and outputs the number of hashtags in each tweet. the system uses microservices written in Scala, that communicate through a Kafka topic.