🇺🇸 Made in United States

Discover United States's Leading Open Source Projects: Explore top-notch open source initiatives hailing from the vibrant tech community of United States.

twitter/the-algorithm

Source code for Twitter's Recommendation Algorithm

prisma/prisma1

💾 Database Tools incl. ORM, Migrations and Admin UI (Postgres, MySQL & MongoDB) [deprecated]

twitter/finagle

A fault tolerant, protocol-agnostic RPC system

twitter-archive/snowflake

Snowflake is a network service for generating unique ID numbers at high scale with some simple guarantees.

enso-org/enso

Hybrid visual and textual functional programming.

microsoft/SynapseML

Simple and Distributed Machine Learning

airbnb/aerosolve

A machine learning package built for humans.

mesos/chronos

Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules

mesosphere/marathon

Deploy and manage containers (including Docker) on top of Apache Mesos at scale.

twitter-archive/diffy

Find potential bugs in your services with Diffy

twitter/scalding

A Scala API for Cascading

twitter-archive/flockdb

A distributed, fault-tolerant graph database

Netflix/atlas

In-memory dimensional time series database.

awslabs/deequ

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

twitter-archive/kestrel

simple, distributed message queue system (inactive)

twitter/util

Wonderful reusable code from Twitter

databricks/Spark-The-Definitive-Guide

Spark: The Definitive Guide's Code Repository

twitter/algebird

Abstract Algebra for Scala

twitter/finatra

Fast, testable, Scala services built on TwitterServer and Finagle

twitter-archive/gizzard

[Archived] A flexible sharding framework for creating eventually-consistent distributed datastores

twitter/summingbird

Streaming MapReduce with Scalding and Storm

metarank/metarank

A low code Machine Learning personalized ranking service for articles, listings, search results, recommendations that boosts user engagement. A friendly Learn-to-Rank engine

feathr-ai/feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise

sangria-graphql/sangria

Scala GraphQL implementation

riscv-boom/riscv-boom

SonicBOOM: The Berkeley Out-of-Order Machine

ucb-bar/chipyard

An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more

ThoughtWorksInc/Binding.scala

Reactive data-binding for Scala

twitter/twitter-server

Twitter-Server defines a template from which services at Twitter are built

GravityLabs/goose

Html Content / Article Extractor in Scala - open sourced from Gravity Labs

sryza/aas

Code to accompany Advanced Analytics with Spark from O'Reilly Media

holdenk/spark-testing-base

Base classes to use when writing tests with Spark

combust/mleap

MLeap: Deploy ML Pipelines to Production

pathikrit/better-files

Simple, safe and intuitive Scala I/O

vkostyukov/scalacaster

Purely Functional Algorithms and Data Structures in Scala

paypal/squbs

Akka Streams & Akka HTTP for Large-Scale Production Deployments

mauricio/postgresql-async

Async, Netty based, database drivers for PostgreSQL and MySQL written in Scala

locationtech/geomesa

GeoMesa is a suite of tools for working with big geo-spatial data in a distributed fashion.

mesos/spark

Lightning-fast cluster computing in Java, Scala and Python.

twitter-archive/iago

A load generator, built for engineers

locationtech/geotrellis

GeoTrellis is a geographic data processing engine for high performance applications.

twitter/rsc

Experimental Scala compiler focused on compilation speed

sryza/spark-timeseries

A library for time series analysis on Apache Spark

wavesplatform/Waves

⛓️ Reference Waves Blockchain Node (client) implementation on Scala

databricks/LearningSparkV2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

tumblr/colossus

I/O and Microservice library for Scala

pauljamescleary/scala-pet-store

An implementation of the java pet store using FP techniques in scala

sifive/freedom

Source files for SiFive's Freedom platforms

databricks/spark-csv

CSV Data Source for Apache Spark 1.x

twitter/cassovary

Cassovary is a simple big graph processing library for the JVM

TIBCOSoftware/snappydata

Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in one cluster

lensesio/stream-reactor

A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

twosigma/flint

A Time Series Library for Apache Spark

cloudera/livy

Livy is an open source REST interface for interacting with Apache Spark from anywhere

amplab/shark

Development in Shark has been ended.

broadinstitute/cromwell

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

h2oai/sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster

eaplatanios/tensorflow_scala

TensorFlow API for the Scala Programming Language

wzhe06/SparkCTR

CTR prediction model based on spark(LR, GBDT, DNN)

twitter/twitter-korean-text

Korean tokenizer

precog/matryoshka

Generalized recursion schemes and traversals for Scala.

NVIDIA/spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

ucb-bar/gemmini

Berkeley's Spatial Array Generator

twitter/scrooge

A Thrift parser/generator

twitter-archive/ostrich

A stats collector & reporter for Scala servers (deprecated)

ThoughtWorksInc/DeepLearning.scala

A simple library for creating complex neural networks

databricks/tensorframes

[DEPRECATED] Tensorflow wrapper for DataFrames on Apache Spark

MrPowers/spark-daria

Essential Spark extensions and helper methods ✨😲

gregdurrett/berkeley-doc-summarizer

The Berkeley Document Summarizer is a learning-based, single-document summarization system that extracts source document content, exploits syntactic information to compress it, and uses coreference constraints to ensure clarity.

jdegoes/blueeyes

A lightweight Web 3.0 framework for Scala, featuring a purely asynchronous architecture, extremely high-performance, massive scalability, high usability, and a functional, composable design.

p2t2/figaro

Figaro Programming Language and Core Libraries

airbnb/chronon

Chronon is a data platform for serving for AI/ML applications.

ezhulenev/orderbook-dynamics

Modeling high-frequency limit order book dynamics with support vector machines

sksamuel/avro4s

Avro schema generation and serialization / deserialization for Scala

rchain/rchain

Blockchain (smart contract) platform using CBC-Casper proof of stake + Rholang for concurrent execution.

ucb-bar/riscv-sodor

educational microarchitectures for risc-v isa

actionml/universal-recommender

Highly configurable recommender based on PredictionIO and Mahout's Correlated Cross-Occurrence algorithm

sameeragarwal/blinkdb

BlinkDB: Sub-Second Approximate Queries on Very Large Data.

twitter/bijection

Reversible conversions between types

databricks/reference-apps

Spark reference applications

deanwampler/programming-scala-book-code-examples

The code examples used in Programming Scala, 2nd and 3rd Editions (O'Reilly)

ucb-bar/chisel-tutorial

chisel tutorial exercises and answers

shadaj/slinky

Write Scala.js React apps just like you would in ES6

open-korean-text/open-korean-text

Open Korean Text Processor - An Open-source Korean Text Processor

twitter/chill

Scala extensions for the Kryo serialization library

amplab/SparkNet

Distributed Neural Networks for Spark

databricks/spark-redshift

Redshift data source for Apache Spark

allenai/pdffigures2

Given a scholarly PDF, extract figures, tables, captions, and section titles.

tpolecat/tut

doc/tutorial generator for scala

tumblr/collins

groovy kind of love

enragedginger/akka-quartz-scheduler

Quartz Extension and utilities for cron-style scheduling in Akka

Netflix/edda

AWS API Read Cache

jsuereth/scala-arm

This project aims to be the Scala Incubator project for Automatic-Resource-Management in the scala library

hyperledger-labs/Scorex

Scorex 2.0 Core

databricks/spark-sql-perf

ucb-bar/riscv-mini

Simple RISC-V 3-stage Pipeline in Chisel

databricks/spark-avro

Avro Data Source for Apache Spark

Stratio/sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

outr/scribe

The fastest logging library in the world. Built from scratch in Scala and programmatically configurable.

guardrail-dev/guardrail

Principled code generation from OpenAPI specifications

orbeon/orbeon-forms

Orbeon Forms is an open source web forms solution. It includes an XForms engine, the Form Builder web-based form editor, and the Form Runner runtime.