< Scala

Share Share Share

Awesome Scala Big Data

• almond 1,592

  

  | updated 2 months ago | BSD 3-Clause "New...

  A Scala kernel for Jupyter

• alpakka-kafka 1,417

  

  | updated 30 days ago | Other

  Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

• BIDMach 913

  

  | updated about 2 years ago | BSD 3-Clause "New...

  CPU and GPU-accelerated Machine Learning Library

• breeze 3,413

  

  | updated over 2 years ago | Apache License 2.0

  Breeze is a numerical processing library for Scala.

• gearpump 763

  

  | updated over 2 years ago | Apache License 2.0

  Lightweight real-time big data streaming engine over Akka

• gridscale 27

  

  | updated 9 months ago | GNU Affero Genera...

  Scala library for accessing various file, batch systems, job schedulers and grid middlewares.

• hail 978

  

  | updated 29 days ago | MIT License

  Cloud-native genomic dataframes and batch computing

• metorikku 578

  

  | updated 10 months ago | MIT License

  A simplified, lightweight ETL Framework based on Apache Spark

• pre-lt-raster-frames 19

  

  | updated over 6 years ago | Other

  Spark DataFrames for earth observation data

• scalding 3,497

  

  | updated over 1 year ago | Apache License 2.0

  A Scala API for Cascading

• schemer 111

  

  | updated over 4 years ago | Apache License 2.0

  Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

• scoobi 482

  

  | updated over 2 years ago

  A Scala productivity framework for Hadoop.

• scoozie 82

  

  | updated over 9 years ago | Other

  Scala DSL on top of Oozie XML

• spark 36,719

  

  | updated about 1 year ago | Apache License 2.0

  Apache Spark - A unified analytics engine for large-scale data processing

• spark-deployer 75

  

  | updated about 8 years ago | Apache License 2.0

  Deploy Spark cluster in an easy way.

• Spark-MongoDB 306

  

  | updated about 8 years ago | Apache License 2.0

  Spark library for easy MongoDB access

• sparkplug 28

  

  | updated over 4 years ago | Apache License 2.0

  Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌

• spark-tools 11

  

  | updated over 3 years ago | MIT License

  Executable Apache Spark Tools: Format Converter & SQL Processor

• spark-utils 31

  

  | updated over 1 year ago | MIT License

  Basic framework utilities to quickly start writing production ready Apache Spark applications

• sparta 525

  

  | updated about 5 years ago | Apache License 2.0

  Real Time Analytics and Data Pipelines based on Spark Streaming

• summingbird 2,138

  

  | updated almost 3 years ago | Apache License 2.0

  Streaming MapReduce with Scalding and Storm

• Vegas 730

  

  | updated almost 3 years ago | MIT License

  The missing MatPlotLib for Scala + Spark