• Stars
    star
    530
  • Rank 83,660 (Top 2 %)
  • Language
    Java
  • License
    Apache License 2.0
  • Created over 12 years ago
  • Updated 8 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A port of Snappy, LZO, LZ4, and Zstandard to Java

Compression in pure Java

Maven Central

This library contains implementations of Zstandard (Zstd), LZ4, Snappy, and LZO written in pure Java. They are typically 10-40% faster than the JNI wrapper for the native libraries.
Additionally implementations of GZIP and Deflate using the Java built-in library, and pure Java BZip2 implementations are provided for ease of integrations with systems that need these algorithms.

Hadoop CompressionCodec

In addition to the raw block encoders, there are implementations of the Hadoop CompressionCodec (Streaming) for each algorithm. They are typically 300% faster than the JNI wrappers.

Requirements

This library requires a Java 1.8+ virtual machine containing the sun.misc.Unsafe interface running on a little endian platform.

Users

This library is used in projects such as Trino (https://trino.io), a distributed SQL engine.

More Repositories

1

airline

Java annotation-based framework for parsing Git like command line structures
Java
848
star
2

airlift

Airlift framework for building REST services
Java
567
star
3

slice

Java library for efficiently working with heap and off-heap memory
Java
498
star
4

drift

An annotation-based Java library for creating Thrift serializable types and services.
Java
235
star
5

jvmkill

Terminate the JVM when resources are exhausted
C
176
star
6

procname

Set process name for Java on Linux
C
96
star
7

codestyle

Code style for Airlift projects
66
star
8

bytecode

High-level Java library for generating JVM bytecode
Java
61
star
9

discovery

Discovery Server
Java
53
star
10

airbase

Base POM for Airlift
47
star
11

airship

Airship is a software deployment and management tool
Java
32
star
12

command

Convenience library for executing external processes
Java
18
star
13

stackfold

Fold related stacks in Java thread dumps
Java
13
star
14

units

Java library for immutable human-friendly units
Java
12
star
15

testing-postgresql-server

Embedded PostgreSQL server for use in tests
Java
9
star
16

testing-mysql-server

Embedded MySQL server for use in tests
Java
7
star
17

astack

Capture JVM thread dumps without requiring safepoints
C++
6
star
18

parameternames

Utility methods for fetching Java method or constructor parameter names
Java
6
star
19

floatingdecimal

Fix monitor contention issues in OpenJDK's FloatingDecimal
Java
5
star
20

resolver

Resolve the dependencies of Maven coordinates or POM file
Java
5
star
21

airlift-rack

Airlift Rack
Ruby
3
star
22

gcwatch

Monitor the JVM for stop-the-world GC pauses
C++
3
star
23

junit-extensions

Extensions for JUnit 5
Java
1
star
24

joda-to-java-time-bridge

Java
1
star