PravatSutar/Spark-Nested-JSON-Parsing

Stars
1
Language
Scala
Created almost 4 years ago
Updated almost 4 years ago

PravatSutar/Spark-Nested-JSON-Parsing

PravatSutar

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

This project is developed in Spark using Scala. The code take any sort of nested JSON data and flattens it to individual fields.

SparkExamples

Pyspark Examples

SparkStreamingRESTAPI

This Spark Streaming Application reads the JSON Data from KAFKA topic and Sends the data to REST API with POST method.

DB-TO-RestAPI

The data is not directly exposed from the database to the downstream system directly for the data analytics. Instead it is exposed through Rest API End-Point. The application is developed using Spring Boot

Hive-Performance-Tuning

Create-Microservices-Using-Spring

Create Microservices Using Spring

AWS_SNS_Notification_Java

The codebase retrieves the data from RDBMS database table including the customer info. It uses the AWS SNS to send the text messages to the customer cell phone for any transaction made by him/her.

SentimentAnalysis-Twitter-Data

Sentiment Analysis after consuming Twitter Stream Data - Technology Used - Python, Apache Kafka and Spark Streaming

RestAPI-to-Kafka-Topic

This Spring Boot application consumes the JSON data from the Rest API end-point and push the data to the Kafka Topic for the REAL-TIME data analytics

powerbi

Sample Experiment on Data Visualization using PowerBI

ML_HouseRent_Prediction

The ML model reads accommodation and ratings data from db, train the model and writes the recommendation to the DB.