threecuptea/spark2_emr threecuptea/spark2_emr

  • Stars
    star
    1
  • Language
    Scala
  • Created over 7 years ago
  • Updated over 5 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
threecuptea/spark2_emr
github

threecuptea

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

It collects spark2 projects deployed to AWS EMR . Automate the whole process and successfully finished ALS recommendation jobs on 26 million Movielens data in 15 minutes using limited AWS resoures

More Repositories

1

ml-spark-sklearn-tensor

Practice examples from "Hands-on Machine Learning with Scikit-Learn & TensorFlow" and port them to Spark
Jupyter Notebook
1
star
2

spark-structured-streaming2

Collect various applications using spark structured streaming aggregation, window and join
Scala
1
star
3

spark_tutorial_2

spark-tutorial_2 collects what I worked on using spark scala 2 Dataset/ DataFrame, including A/B analysis on Tivo Danube pipeline and Movielens recommendation system
Scala
1
star
4

kafka-streams-examples

kafka-streams-example collects small projects that I worked on using Kafka streams. It was inspired by kafka-src streams-examples.
Java
1
star