powturbo/Turbo-Base64

Turbo Base64:Fastest Base64 SSE/AVX2/AVX512/Neon/Altivec

Fastest Base64 SIMD Encoding library

• 100% C (C++ headers), as simple as memcpy
• No other base64 library encode or decode faster
• ✨ Scalar can be faster than other SSE or ARM Neon based base64 libraries
• SSE faster than other SSE/AVX/AVX2! base64 library
• Fastest AVX2 implementation
• TurboBase64 AVX2 decoding up to ~2x faster than other AVX2 libs.
• TurboBase64 is 3,5-4 times faster than other libs for short strings
• Fastest ARM Neon base64
• 🆕(2023.04) avx512 - 2x faster than avx2, faster than any other implementation
• 👍 Dynamic CPU detection and JIT scalar/sse/avx/avx2/avx512 switching
• Base64 robust error checking, optimized for long+short strings
• Portable library, 32/64 bits, SSE/AVX/AVX2/AVX512, ARM Neon, Power9 Altivec
• OS:Linux amd64, arm64, Power9, MacOs+Apple M1, s390x. Windows: Mingw, visual c++
• Big endian + Little endian
• Ready and simple to use library, no armada of files, no hassles dependencies
• LICENSE GPL 3 . Commercial license available. Contact us at powturbo [AT] gmail [DOT] com

Download Turbo-Base64 executable benchmark tb64app from releases, extract the files and type "tb64app"

Benchmark incl. the best SIMD Base64 libs:

• Single thread
• Including base64 error checking
• Small file + realistic and practical (no PURE cache) benchmark
• Unlike other benchmarks, the best of the best scalar+simd libraries are included
• all libraries with the latest version

Benchmark AMD CPU: AMD Ryzen 9 7950X @ 4,50 GHz, DDR5 6000 CL30 - gcc-12.2

Benchmark Intel CPU: i7-9700k 3.6GHz gcc 11.2

TurboBase64 vs. Base64 for short strings (incl. checking)

Benchmark ARM Neon: Apple M1 3,5GHz (clang 12.0)

Benchmark ARM Neon: ARMv8 A73-ODROID-N2 1.8GHz (clang 6.0)

• (bold = pareto in category) MB=1.000.000
  
• (E/D) : Encode/Decode
• Timmings are respectively relative to the base64 output/input in encode/decode.

Compile: (Download or clone Turbo Base64 SIMD)

    git clone https://github.com/powturbo/Turbo-Base64.git
    make

Usage: (Benchmark App)

    ./tb64app file 
    or  
    ./tb64app

Function usage:

static inline unsigned turbob64len(unsigned n)
Base64 output length after encoding

unsigned tb64enc(const unsigned char *in, unsigned inlen, unsigned char *out)
Encode binary input 'in' buffer into base64 string 'out'
with automatic cpu detection for simd and switch (sse/avx2/scalar
in : Input buffer to encode
inlen : Length in bytes of input buffer
out : Output buffer
return value: Length of output buffer
Remark : byte 'zero' is not written to end of output stream
Caller must add 0 (out[outlen] = 0) for a null terminated string

unsigned tb64dec(const unsigned char *in, unsigned inlen, unsigned char *out)
Decode base64 input 'in' buffer into binary buffer 'out'
in : input buffer to decode
inlen : length in bytes of input buffer
out : output buffer
return value: >0 output buffer length
0 Error (invalid base64 input or input length = 0)

Environment:

OS/Compiler (32 + 64 bits):

• Windows: Visual C++ (2017)
• Windows: MinGW-w64 makefile
• Linux amd/intel: GNU GCC (>=4.6)
• Linux amd/intel: Clang (>=3.2)
• Linux arm: aarch64 ARMv8 Neon: gcc (>=6.3)
• Linux arm: aarch64 ARMv8 Neon: clang (>=6.0)
• MaxOS: XCode (>=9), apple M1
• PowerPC ppc64le: gcc (>=8.0) incl. SIMD Altivec

References:

• fastbase v2022.02
• base64 v2022.02
• base64simd

* SIMD Base64 publications:

• 📗Faster Base64 Encoding and Decoding Using AVX2 Instructions
• 📗RFC 4648:The Base16, Base32, and Base64 Data Encodings

Last update: 06 AUG 2023