smallnest/kafka-example-in-scala

Stars
152
Rank 244,685 (Top 5 %)
Language
Java
License
Apache License 2.0
Created over 9 years ago
Updated almost 8 years ago

smallnest/kafka-example-in-scala

smallnest

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

a kafka producer and consumer example in scala and java

kafka producer and consumer example in scala and java

you can test with local server.

start zookeeper

if you have installed zookeeper, start it, or run the command:

bin/zookeeper-server-start.sh config/zookeeper.properties

start kafka with default configuration

> bin/kafka-server-start.sh config/server.properties

create a topic

> bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 10 --topic test_topic

package this example

mvn clean package

it will package compiled classes and its dependencies into a jar.

Run the Producer

This example also contains two producers written in Java and in scala. you can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ProducerExample 10000 test_topic localhost:9092

or this for scala

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaProducerExample 10000 test_topic localhost:9092

Run the Consumer

This example contains two consumers written in Java and in scala. You can run this for java:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ConsumerExample localhost:9092 group1 test_topic 10 0

or this for scala:

java -cp kafka_example-0.1.0-SNAPSHOT.jar com.colobu.kafka.ScalaConsumerExample localhost:9092 group1 test_topic 10 0

rpcx

Best microservices framework in Go, like alibaba Dubbo, but with more features, Scale easily. Try it. Test it. If you feel it's better, use it! 𝐉𝐚𝐯𝐚有𝐝𝐮𝐛𝐛𝐨, 𝐆𝐨𝐥𝐚𝐧𝐠有𝐫𝐩𝐜𝐱! build for cloud!

go-web-framework-benchmark

⚡ Go web framework benchmark

1m-go-tcp-server

benchmarks for implementation of servers which support 1 million connections

dive-to-gosync-workshop

深入Go并发编程研讨课

C1000K-Servers

⚡ High performance websocket servers implemented by Spray-can, Netty, undertow, jetty, Vert.x, Grizzly, node.js and Go. It supports 1,200,000 active websocket connections

gen

Converts a database into gorm structs and RESTful api

concurrency-programming-via-rust

chanx

ringbuffer

a thread-safe circular buffer (ring buffer) in Go, implemented io.ReaderWriter interface

gosercomp

⚡ Golang Serializer Benchmark Comparison

gofsm

a featured FSM that can export state images

go-best-practices

resources for go best practices

douban-recommender

基于Spark ML实现的豆瓣电影推荐系统

rpcx-ui

rpcx manager web ui

gotips

Go tips from Phuong Le. Go语言编程技巧

Jax-RS-Performance-Comparison

⚡ Performance Comparison of Jax-RS implementations and embedded containers

weighted

high-performance common weighted algorithm library

ZKRecipesByExample

all examples for ZooKeeper recipes by Curator

go-concurrent-quiz

Go concurrency quizzes

goframe

send/receive framed data via TCP or QUIC

ebooks

制作的电子书越来越多，找个仓库放置，方便下载

rpcx-programming-guide-cn

gitbook Go RPC开发指南 [中文文档]

glean

hotfix for go applications via plugin, supports Linux and MacOS

rpcx-rs

rpcx microservice framework in Rust

queue

lock-free queue and other implementations

goreq

A Simplified Golang Http Client

go_test_workshop

Go Test Workshop

gofer

channels

go channel patterns

resp3

First redis RESP3 protocol library in Go

smallchat

A minimal programming example for a chat server in Go and Rust

epoller

epoll implementation for connections in Linux, MacOS and Windows

rpcx-java

rpcx implementation in Java for server side and client side

grpc-examples

examples for gRPC

exp

Experimental packages not in std and golang.org/exp

distributed

distributed synchronization primitives

leetcode-solutions

leetcode 算法题解精选

FlyRunner

一个记录你地图路线的跑步软件，无需google map支持

rpcxdump

a tcpdump-like tool to capture rpcx tcp packets

hash-bench

go hash benchmark

zhuge

救命用的profile

mping

a multi-targets ping tool, which supports 10,000 packets/second, accurate latency

spring-kafka-demo

Tractor

A Tractor game. (升级，一个在中国非常流行的扑克牌游戏。又叫拖拉机，双扣)。 Developed by C#

network_benchmark

3百万QPS benchmark测试

mping-rs

a multi-targets ping tool and library, which supports 10,000 packets/second, accurate latency

mahout-douban-recommender

基于mahout实现的豆瓣电影推荐系统

RPC-TEST

test performance of gRPC and Thrift. All services are implemented as HelloWorld by Java, Scala and Golang

breakdown

记录国内外互联网公司和电信企业P0级别的重大故障

quick

an encrypted UDP connection between two peers using QUIC

talk-about-go-generics

谈谈Go泛型 - GopherChina 2023 大会分享

concurrency-programming-via-go-code

code of concurrency programming via go

pping-go

使用Go语言实现pping

gitalk

gitalk for colobu

fastjson-jaxrs-json-provider

a JAX-RS entity provider for https://github.com/alibaba/fastjson

redis-bench

a different redis bench tool that is used for test latency at given max throughputs

iprange

check whether a IP is in IP ranges with CIDR format such as 216.249.16.0/20 and 2a01:5a80::/32

rpcxlite

a lite version of rpcx

smallnest.github.io

leetcode

有空就刷题

syncx

more advanced sync primitives in Go

kafka_monitor

A kafka monitor to send alarm emails

rediscopy

copy redis requests to other servers

weighted-rs

A Rust library for weighted balancing algorithm

gomemcached

memcached protocol implementation for memcached server

slog-exp

slog experimental features

rpcx-agent

Agent to invoke rpcx services in C++, Java, Python, C#, Ruby, etc. for rpcx 2.x

gofu

functional go with generic types

libra-wallet

a libra wallet example in go

qianmo

additional network functions

rust-examples

study rust by examples

rpcx-programming-guide-en

rpcx programming guide (english version)

Ember-Lance

Dashboard Bootstrap implemented with sb-admin2, Ember, D3.js and other third-party libraries

DisruptorBootstrap

Example for Disruptor and Spring Reactor

nettrace.bak

explore internal/nettrace in go std lib

go-app-metrics

add system monitor (cpu/load/memory/disk/bandwidth) to go-metrics

blockchain

a general blockchain implementation

go-cheatsheets

go-generics-examples

go generics examples

preallocate

File preallocation library, cloned from https://git.sr.ht/~tslocum/preallocate

pool

a go pool that you don't worry about GC

libp2p

a secure go p2p libary, easy to use. cloned from go-spacemesh

libkv-etcdv3-store

libkv etcd store by client v3 API: https://github.com/docker/libkv

benchpi

rust examples for calculating PI

json-parser-benchmark

json parser benchmark

Java-Memcached-Clients-Benchmark

⚡ Benchmark for Java Memcached clients such as SpyMemcached, XMemcached and folsom

p2p

word

一个命令行中查找英语单词的意思和发音

kafka-go-examples

examples for kafka go clients

golang-tls

golang tls for http/http2 examples

tracert

a special traceroute lib for multiple paths by UDP

awesome-web-templates

record free web templates

concurrency-programming-via-go

Go并发编程勘误页和问题反馈

Scala-Collections-Cookbook

codes for the book "Scala Collections Cookbook"

libra-wallet-rust

libra wallet in rust

batch

batch process or timeout

shorturl

a scalable high performance ShortURL server

go-database-study

study golang database lib

bitcoin

ai_assistant

熊厂内分享，github copilot vs baidu comate