Discover @lemire Open Source projects

Daniel Lemire (@lemire)

lemire

Stars
9,908
Global Rank 2,123 (Top 0.08 %)
Followers 5,497
Following 67
Registered over 13 years ago
Most used languages

C++
26.3 %

C
23.3 %

Java
18.8 %

JavaScript
7.5 %

Python
5.3 %

HTML
4.5 %

Shell
3.0 %

Swift
3.0 %

Go
2.3 %

Others 6.4 %
Location 🇨🇦 Canada
Country Total Rank 88
Country Ranking

C
6

C++
7

Java
20

Cuda 50

Assembly
80

CMake 100

Swift
110

Shell
118

TeX
172

JavaScript
259

C#
293

TypeScript
406

Go
414

HTML
703

Rust
800

Objective-C
913

Python
2,129

FastPFor

The FastPFOR C++ library: Fast integer compression

Code-used-on-Daniel-Lemire-s-blog

This is a repository for the code posted on my blog

fast_double_parser

Fast function to parse strings into double (binary64) floating-point values, enforces the RFC 7159 (JSON standard) grammar: 4x faster than strtod

javaewah

A compressed alternative to the Java BitSet class

JavaFastPFOR

A simple integer compression library in Java

simdcomp

A simple C library for compressing lists of integers using binary packing

EWAHBoolArray

A compressed bitmap class in C++.

SIMDCompressionAndIntersection

A C++ library to compress and intersect sorted lists of integers using SIMD instructions

fastbase64

SIMD-accelerated base64 codecs

streamvbyte

Fast integer compression in C using the StreamVByte codec

FastPriorityQueue.js

a fast heap-based priority queue in JavaScript

fastvalidate-utf-8

header-only library to validate utf-8 strings at high speeds (using SIMD instructions)

fastrange

A fast alternative to the modulo reduction

fastmod

A C/C++ header file for fast 32-bit division remainders (and divisibility tests) on 64-bit hardware.

clhash

C library implementing the ridiculously fast CLHash hashing function

externalsortinginjava

External-Memory Sorting in Java

rollinghashcpp

Rolling Hash C++ Library

FastBitSet.js

Speed-optimized BitSet implementation for modern browsers and JavaScript engines

docker_programming_station

A simple script to help programmers who want to work within Docker

despacer

C library to remove white space from strings as fast as possible

StronglyUniversalStringHashing

Benchmark showing the we can randomly hash strings very quickly with good universality

testingRNG

Testing common random-number generators (RNG)

MaskedVByte

Fast decoder for VByte-compressed integers

cbitset

A simple bitset library in C

lbimproved

Dynamic Time Warping (DTW) library implementing lower bounds (LB_Keogh, LB_Improved...)

dictionary

High-performance dictionary coding

SIMDxorshift

Fast random number generators: Vectorized (SIMD) version of xorshift128+

csharpewah

Compressed bitmaps in C#

fastrand

Fast random number generation in an interval in Python: Up to 10x faster than random.randint.

bloofi

Bloofi: A java implementation of multidimensional Bloom filters

rollinghashjava

Rolling hash functions in Java

LittleIntPacker

C library to pack and unpack short arrays of integers as fast as possible

simdpcg

Vectorized version of the PCG random number generator

TypedFastBitSet.js

Speed-optimized BitSet implementation for modern browsers and JavaScript engines, uses typed arrays

FastIntegerCompression.js

Fast integer compression library in JavaScript

simdprune

Pruning elements in SIMD vectors (i.e., packing left elements)

testingmlp

Testing memory-level parallelism

FastDifferentialCoding

Fast differential coding functions (using SIMD instructions)

multiplatform_simd_recipes

SIMD recipes, for various platforms (collection of code snippets)

runningmaxmin

Fast maximum-minimum filters implemented in C++

fasthashing

A Variable-Length String Hashing Library in C++

fast_division

Simple C++ code to benchmark fast division algorithms

FrameOfReference

C++ library to pack and unpack vectors of integers having a small range of values using a technique called Frame of Reference

validateutf8-experiments

Reproducible experimeents on UTF-8 validation using SIMD instructions

SwiftBitset

A fast Bitset class in Swift

FastShuffleExperiments

How fast can we shuffle values?

programmingishard

Long-term book project

StablePriorityQueue.js

A stable heap-based priority queue in JavaScript

fastscancount

Fast implementations of the scancount algorithm: C++ header-only library

SIMDgameoflife

Vectorized (AVX) version of the game of life

CMemoryUsage

Measuring memory usage in C and C++

CRoaringUnityBuild

Dumps of CRoaring unity builds (for convenience)

SwiftWyhash

Fast random number generator in pure Swift

kodakimagecollection

Set of images made available royalty-free by Kodak

sparsebitmap

A simple sparse bitmap implementation in java

IndexWikipedia

A simple utility to index wikipedia dumps using Lucene.

PiecewiseLinearTimeSeriesApproximation

code from Daniel Lemire, A Better Alternative to Piecewise Linear Time Series Segmentation, SIAM Data Mining 2007, 2007.

Concise

C++ implementation of Concise and WAH compressed bitsets

MemoryLanes

iOS app to test memory-level parallelism

talks

Random material having to do with Daniel Lemire's talks

fastrandom

crackingxoroshiro128plus

How to "crack" xoroshiro128+: from two outputs, derive a possible seed

RealisticTabularDataSets

Some realistic tabular datasets for testing (CSV)

StarSchemaBenchmark

O'Neil et al.'s Star Schema Benchmark: curated code

simplebitmapbenchmark

Simple benchmark between compressed bitmap libraries in Java

vectorclass

Random number generator for large applications using vector instructions

simple_fastfloat_benchmark

zobristhashing

Zobrist hashing in C

BitSliceIndex

Experiments on bit-slice indexing

SIMDIntersections

Vectorized intersections (research code)

microbenchmarks

Private microbenchmarks

backward_multiplication

Multiplying... backward?

pospopcnt_avx512

benchmarking positional population count

costofsafety

Quick experiment to see how expensive safety is in C, for research

constantdivisionbenchmarks

Benchmarks for constant-division problems (not a library! for research only!)

createfasthash

Code from article http://locklessinc.com/articles/fast_hash/

SwiftCallingCHeader

Calling a C header from Swift (example)

arraylayout

Pat Morin's arraylayout

WebAssemblyVSJavaScript

Project to compare the performance of WebAssembly with JavaScript

ComputerLanguageBenchmark

Captured as http://benchmarksgame.alioth.debian.org is closing

rowreorderingcpplibrary

This is a set of row-reordering algorithms and data compression compression schemes implemented in C++.

notesdecours

gobitmapbenchmark

A Go project to benchmark various bitmap implementations (this is not a library!)

gutenberg-headers

Removing Manually-Generated Boilerplate from Project Gutenberg e-Books

iosbitmapdecoding

Experimenting with bitmap decoding on ios

simple_simdjson_python_wrapper

Simple use of simdjson from python (for research purposes)

citationdata

Influential references dataset

fastheap

Fast heap data structures in Go (golang)

pythonmaxmin

Fast minimum-maximal filter in Python

jstypes

Doing C-like arithmetic and logical operations in JavaScript (full 64-bit support)

fast_float_supplemental_tests

Supplemental tests for the fast_float library (credit: Nigel Tao)

HashVSTree

Do hash table use more memory than trees? A case study in Java.

hierarchicalbinbuffering

Hierarchical Bin Buffering C++ Library

RoaringVSConciseBenchmark

A benchmark comparing roaring and concise

DivisionBenchmark

A not-so-exciting benchmark to measure the performance of some division functions

exercices_lucene

Exercises pour s'approprier lucene, le moteur de recherche

jackson-json-bench

A silly benchmark for Jackson (JSON parser)

roaring_rust_benchmark

Basic benchmark to compare different Roaring bitmap implementations in Rust

datasciencebook

viewsizeestimation

Unassuming hashing-based view-size estimation techniques