justinrmiller/spark-kafka-parquet-example justinrmiller/spark-kafka-parquet-example

  • Stars
    star
    17
  • Rank 1,257,181 (Top 25 %)
  • Language
    Scala
  • Created about 8 years ago
  • Updated over 3 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
justinrmiller/spark-kafka-parquet-example
github

justinrmiller

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in S3.

More Repositories

1

spring-boot-redis-microservices

Java
10
star
2

faust-cassandra-weather-example

Fause Cassandra Weather Example
Python
5
star
3

spring-boot-react-docker

JavaScript
3
star
4

ray-vector-io

Ray Vector Database Input/Output Utilities
Python
2
star
5

rust-playground

Rust
2
star
6

spark-regex-tutorial

Python
1
star
7

rust-display-case

Rust
1
star
8

regi

Rust Regex Command Line Tool for Parquet
Rust
1
star