mjaglan/docker-spark-yarn-cluster-mode mjaglan/docker-spark-yarn-cluster-mode

  • Stars
    star
    9
  • Rank 1,939,727 (Top 39 %)
  • Language
    Shell
  • License
    Apache License 2.0
  • Created about 7 years ago
  • Updated almost 7 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
mjaglan/docker-spark-yarn-cluster-mode
github

mjaglan

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Run Spark 2.0.2 on YARN and HDFS inside docker container in Multi-Node Cluster mode

More Repositories

1

PyTextSentiment

Emotion Detection & Classification of Tweets Using Streaming APIs. [NLTK] [Scikit Learn] [Twitter Streaming API] [Bing API]
Python
13
star
2

kafka-spark-example

spark kafka producer consumer example [kafka] [spark] [scala] [gradle] [travis-ci]
Scala
3
star
3

docker-hadoop-pseudo-distributed-mode

Run Apache Hadoop 2.7 inside docker container in pseudo-distributed mode
Shell
3
star
4

AI-Foundations

Problem Solving With AI Approaches: Heuristic Searches, Statistical Classifications
Python
3
star
5

docker-hbase-distributed-mode

Run HBase 1.1.12 on Hadoop 2.7 inside docker container in Multi-Node Cluster mode
Shell
2
star
6

docker-hadoop-distributed-mode

Run Apache Hadoop 2.7 inside docker container in Multi-Node Cluster mode
Shell
2
star
7

bigdata-example-project

Clustering with Spark on OpenStack Cloud. [OpenStack] [Hadoop] [Spark] [Ansible] [YAML] [Scala] [SBT] [Shell]
Scala
2
star
8

py-word-search

Python package that searches a 2D grid of letters for valid English words. Using set() and TRIE.
Python
1
star
9

docker-kafka-zookeeper

Multi-Node Kafka on docker with kafka-manager
Shell
1
star
10

vagrant-vbox-script-sample-1

Vagrant Single-Machine (ubuntu 14.04) environment in headless mode
Shell
1
star
11

LogFileAnalyzer

Get top k users from a very large log file using Hadoop Framework. [Hadoop] [Java] [Python] [Shell]
Python
1
star
12

ScalaUnitTestsExample

Simple project to get started with writing Scala Unit Tests [travis-ci] [ScalaTest] [Gradle]
Scala
1
star
13

BasicStatisticsMCR

Compute min, max, average, and standard deviation using Hadoop MR
Java
1
star
14

vagrant-vbox-script-sample-2

Vagrant Multi-Machine (ubuntu 14.04) environment in headless mode
Shell
1
star
15

SparkDFReadWrite

Read and Write dataframe to MySQL DB. [UnitTests] [CodeCoverage] [Scala] [Spark] [gradle]
HTML
1
star
16

Web-Console

Simple web application with Node, Express and MySQL. Docker hosted (master branch)/ Vagrant+Docker hosted (vmaster branch).
JavaScript
1
star
17

mjaglan.github.io

Spring 2017 - Advanced Science Gateway Architectures
1
star
18

Hadoop.PageRank.1

Iterative MapReduce for PageRank Computation in Graphs using Hadoop framework. [Hadoop] [Java] [Shell]
Java
1
star
19

baristamatic

Simulator of an automatic coffee dispensing machine. [UnitTests] [CodeCoverage] [java] [gradle] [travis ci]
Java
1
star
20

ansible-example-debian

install {mongodb, nginx} on ubuntu VMs. [YAML] [Ansible] [OpenStack]
Shell
1
star