Discover

Stream data into pipeline in near-real-time using Kafka

Kafka-Stream-Data-Pipeline-Near-Real-Time

With this activity, I warmup myself to get a practical hands-on of recommender systems in Spark. We will use the MovieLens dataset sample provided with Spark and available in directory `data`.

PySpark-Recommender-System

An Automated ETL Data pipeline which extract complex json data from web API service (GBFS-bixi Data) and convert to CSV for loading into Data-warehouse HDFS. After-that, Hive will process the further by external and managed table. Same procedure is also applied with AWS S3 and Athena.

Bixi-Cloud-ETL-Data-Pipeline-using-Scala-Hive-AWS_Athena_JDBC-Driver

Student Identification Code, an implementation of java ADT for O(1) to O(n) for insert, update, delete, find operations for large scale data

IntelligentSIDC_JAVA_ADT

Spark Big Data Processing learning

Spark_Big_Data_Processing_SQL

Tweet Analystics web Sockets application using play framework with sbt build.

Tweet_Analytics_WebSockets_SBT_build

Research project report in IEEE format on title "A Study on Clone Detection within Stack Overflow Code Snippets"

SOEN-7481_Research_Project_Paper

TeX

Code-Smell-Prediction_ML

Python: Code smell prediction using ML (10 cross-validations)

Studying the rise and the fall of Stack Overflow over the years, research in data mining

Evolution-of-Stack-Overflow

This hands-on project is for practice play framework, reactive programming using Java stream, scala and sbt tool

TwitterLytics-using-play-scala-java-sbt

Tool3-CalculateHTML-Tags-From-SO-Posts

The main task of the tool is extract metrics (e.g., #commits, #tags, #authors etc from the projects) from GitHub projects according to the settings that are related to the people i.e. the number of the developer in the project, the number of commits per project, the number of commits per developer in a project and so on using Python

Metrics-Extraction-from-GitHub-MSR_Python

Python

Tool1-Extraction-of-SO-JAVA-CodeSnippets

This tool will Extract Stack Overflow code snippets from CSV files

Scala-Avro-Confluent-Schema-Registry

Research Project: Evolution of the Stack Overflow Over the Years using R, Stack Overflow Data Dump, MSSQL, Python

Evolution-of-the-Stack-Overflow-Over-the-Years

Tool2-ParseHTML-Results-Of-NiCad

Exception handling anti-pattern code analysis tool

Code-Smell-Java-Code-analysis-tool

Programming with Hive JDBC using Scala and HDFS

Programming-with-Hive-JDBC-using-Scala-and-HDFS

SQL-Scripts-For-SO-Clone-Detection

TSQL

Java-Problem-Solving

AI-Face-Mask-Detector

Java-Code-Extraction-From-Stack-Overflow

Big Data Engineer at Bell Canada

ManikHossain08

R-Mixed-Model-Cloned-Q-A

Spark-ETL-Data-Pipeline-using-SparkStreaming-HDFS-Kafka-Hive

The objectives of this project are to get experience of coding with: Spark, Spark SQL, Spark Streaming, Kafka, Scala and functional programming

How well can you predict post release bugs?

Bug-prediction-Model-Building-Using-R

Java-OOP-Basic-Concept

Understanding of java basic concept

HTML

Sales-Analysis-Bike-Shops-In-R

Python-Programming

Real-State-Project

Real State project Using C#.Net (Server api based) and angularJs(Client with html)

JAVA-Design-Patterns-Software-Development-Methodologies

Applying different design pattern in different java projects. Designing and Implementing (Some of) Dungeon and Dragons Character Classes using various java Design patterns in java.

ETL-Data-Pipeline-using-HDFS-Hive-Scala

Research Project: A study on clone detection within the Stack Overflow code snippets. Vote Variance Factors Analysis of Similar Stack Overflow Posts (Q&A) by building Mixed Modelling.

Code-Clone-within-SO-Mixed_Model_Building

TeX

STM-Data-Enrichedment-With-Hadoop-Scala

STM data enrichment, Extract, Transform, Load (e.g., ETL)

My own solution of Hackerrank SQL hard challenges.

SQL-HackerRank-Hard-Challenges-MSSQL

TSQL

Scala-Programming-With-SBT

Scala basic from beginner to advance level. This languages is very intuitive to use and less code to write and there is no verbosity like JAVA.