Discover @zutherb Open Source projects

Building-a-full-automated-Fast-Data-Platform

Many people promise fast data as the next step after big data. The idea of creating a complete end-to-end data pipeline that combined Spark, Akka, Cassandra, Kafka, and Apache Mesos came up two years ago, sometimes called the SMACK stack. The SMACK stack is an ideal environment for handling all sorts of data-processing needs which can be nightly batch-processing tasks, real-time ingestion of sensor data or business intelligence questions. The SMACK stack includes a lot of components which has to be deployed somewhere. Lets see how we can create a distributed environment in the cloud with Terraform and how we can provision the Mesos-Cluster with Mesosphere Datacenter Operating System (DC/OS) and create a powerful fast data platform.

zutherb

Top repositories