yilong2001/spark-sql-on-k8s

Stars
17
Rank 1,257,181 (Top 25 %)
Language
Go
Created over 3 years ago
Updated over 1 year ago

yilong2001/spark-sql-on-k8s

yilong2001

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

最简单的 spark sql on kubernetes 生产环境部署方案

yl-netty-rpc

基于 Spark Netty Rpc 框架，重新实现的一个 Netty Rpc 框架 ( scala + java )

yl-spark-sql-on-hbase

一个Spark SQL DataSource on HBase 的实现(在HBase scan时，能完成列裁剪、谓词下推)

go-project

GO高并发实例、GO Web实例

yl-spark-sql

一个Spark SQL方言，增强了批处理、机器学习、模型服务等语义；基于统一的SQL语法，提供了一个ETL、机器学习和推荐系统的框架

yl-hbase-rep

hbase replication/snapshot 实现机制、源码解析、以及 replication peer 的实现

berts.cpp

基于GGML 的 bert 模型家族推理服务，支持分类模型、seq2seq 文本生成模型等等

yl-paxos

Paxos协议的一个工程实现

yl-streaming-kafka-hbase

一个 Spark Streaming SQL Pipline 框架，提供Kafka2HBase/Kafka2Kafka基于SQL的配置化pipline框架

yl-lsmdb

参考hbase(以及 leveldb 等)实现原理，实现一种lsm db(特性:netty rpc、时间索引、固定内存分配)

avro-kafka-strom-hbases

consume Avro data (original from OGG) from kafka into storm, deserialize Avro data into object and save them into hbase tables

akka-rest-with-hbase

http restful with akka and kerberos hbase

SPNEGO-rest-server

kerberos web server support SPENGO and a client(curl --negotiate )

kafkaspout-with-batch

a batched kafkaspout with self-managed offsets in zookeeper