Awesome Scala Big Data

  • almond almond 1,568
    star
    updated 2 days ago BSD 3-Clause "New...

    A Scala kernel for Jupyter

  • updated 16 days ago Other

    Alpakka Kafka connector - Alpakka is a Reactive Enterprise Integration library for Java and Scala, based on Reactive Streams and Akka.

  • updated over 1 year ago BSD 3-Clause "New...

    CPU and GPU-accelerated Machine Learning Library

  • breeze breeze 3,413
    star
    updated over 1 year ago Apache License 2.0

    Breeze is a numerical processing library for Scala.

  • updated about 2 years ago Apache License 2.0

    Lightweight real-time big data streaming engine over Akka

  • updated 2 months ago GNU Affero Genera...

    Scala library for accessing various file, batch systems, job schedulers and grid middlewares.

  • hail hail 940
    star
    updated 4 days ago MIT License

    Cloud-native genomic dataframes and batch computing

  • updated 4 months ago MIT License

    A simplified, lightweight ETL Framework based on Apache Spark

  • updated about 6 years ago Other

    Spark DataFrames for earth observation data

  • scalding scalding 3,469
    star
    updated 12 months ago Apache License 2.0

    A Scala API for Cascading

  • updated about 4 years ago Apache License 2.0

    Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

  • scoobi scoobi 482
    star
    updated almost 2 years ago

    A Scala productivity framework for Hadoop.

  • updated about 9 years ago Other

    Scala DSL on top of Oozie XML

  • spark spark 36,719
    star
    updated 8 months ago Apache License 2.0

    Apache Spark - A unified analytics engine for large-scale data processing

  • updated over 7 years ago Apache License 2.0

    Deploy Spark cluster in an easy way.

  • updated over 7 years ago Apache License 2.0

    Spark library for easy MongoDB access

  • updated about 4 years ago Apache License 2.0

    Spark package to "plug" holes in data using SQL based rules ⚑️ πŸ”Œ

  • updated about 3 years ago MIT License

    Executable Apache Spark Tools: Format Converter & SQL Processor

  • updated about 1 year ago MIT License

    Basic framework utilities to quickly start writing production ready Apache Spark applications

  • sparta sparta 525
    star
    updated over 4 years ago Apache License 2.0

    Real Time Analytics and Data Pipelines based on Spark Streaming

  • updated over 2 years ago Apache License 2.0

    Streaming MapReduce with Scalding and Storm

  • Vegas Vegas 729
    star
    updated over 2 years ago MIT License

    The missing MatPlotLib for Scala + Spark