• Stars
    star
    1,284
  • Rank 36,642 (Top 0.8 %)
  • Language
    C++
  • License
    Apache License 2.0
  • Created over 11 years ago
  • Updated 8 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

A Fast Key-Value Storage Engine Based on Hierarchical B+-Tree Trie

ForestDB

ForestDB is a key-value storage engine developed by Couchbase Caching and Storage Team, and its main index structure is built from Hierarchical B+-Tree based Trie, called HB+-Trie. ForestDB paper has been published in IEEE Transactions on Computers.

Compared with traditional B+-Tree based storage engines, ForestDB shows significantly better read and write performance with less storage overhead. ForestDB has been tested on various server OS environments (Centos, Ubuntu, Mac OS x, Windows) and mobile OSs (iOS, Android). The test coverage stats for ForestDB are available in ForestDB Code Coverage Report.

ForestDB benchmark program is also available for performance comparisons with other key-value storage engines.

Please visit the ForestDB wiki for more details.

Main Features

  • Keys and values are treated as an arbitrary binary.
  • Applications can supply a custom compare function to support a customized key order.
  • A value can be retrieved by its sequence number or disk offset in addition to a key.
  • Write-Ahead Logging (WAL) and its in-memory index are used to reduce the main index lookup / update overhead.
  • Multi-Version Concurrency Control (MVCC) support and append-only storage layer.
  • Multiple snapshot instances can be created from a given ForestDB instance to provide different views of database.
  • Rollback is supported to revert the database to a specific point.
  • Ranged iteration by keys or sequence numbers is supported for a partial or full range lookup operation.
  • Manual or auto compaction can be configured per ForestDB database file.
  • Transactional support with read_committed or read_uncommitted isolation level.

How to build

See INSTALL.MD

How to Use

Please refer to Public APIs and tests/fdb_functional_test.cc in ForestDB source directory.

How to contribute code

  1. Sign the Couchbase Contributor License Agreement
  2. Submit code changes via either a Github PR or via Gerrit (for Gerrit usage, see Instructions from the couchbase-spark-connector project.)

Note regarding master branch

The 'master' git branch of forestdb contains a number of changes which ultimately were not kept for production builds of Couchbase Server. Production builds were kept on an earlier release branch named 'watson' corresponding to Couchbase Server 4.5. Couchbase Server 5.0, 5.1, 5.5, and 6.0 added some bug fixes on branches made from 'watson', namely 'spock' and 'vulcan'. For Couchbase Server 6.5 and forward, a new branch 'cb-master' was created from the then-current 'vulcan' branch.

'cb-master' should be seen as the equivalent of 'master' for all Couchbase Server production build purposes. Any additional production bug fixes will go there, and release-specific branches will be made from there when necessary.

The current 'master' branch is left untouched and unsupported, for use by community users who may depend on the work done there.

More Repositories

1

couchbase-lite-ios

Lightweight, embedded, syncable NoSQL database engine for iOS and MacOS apps.
Objective-C
1,603
star
2

couchbase-lite-android

Lightweight, embedded, syncable NoSQL database engine for Android.
Java
1,173
star
3

moss

moss - a simple, fast, ordered, persistable, key-val storage library for golang
Go
947
star
4

geocouch

GeoCouch, a spatial index for CouchDB
Erlang
513
star
5

vellum

A Go library implementing an FST (finite state transducer)
Go
497
star
6

couchnode

Couchbase Node.js Client Library (Official)
C++
462
star
7

sync_gateway

Manages access and synchronization between Couchbase Lite and Couchbase Server
Go
447
star
8

couchbase-lite-net

A lightweight, document-oriented (NoSQL), syncable database engine for .NET
C#
436
star
9

go-slab

slab allocator in go
Go
364
star
10

gocb

The Couchbase Go SDK
Go
359
star
11

go-couchbase

Couchbase client in Go
Go
318
star
12

fleece

A super-fast, compact, JSON-equivalent binary data format
C++
309
star
13

couchbase-net-client

The official Couchbase SDK for .NET Core and Full Frameworks
C#
271
star
14

couchbase-lite-core

Cross-platform C++ core library for Couchbase Lite
C++
253
star
15

couchbase-java-client

The official Java client for Couchbase Server
Java
252
star
16

couchbase-python-client

Couchbase Python Client Library (Official)
Python
239
star
17

couchbase-elasticsearch-connector

The Official Couchbase Elasticsearch Connector
Java
176
star
18

libcouchbase

The couchbase client for C.
C
173
star
19

docker

Dockerfiles and configuration scripts for the Docker Hub Official Couchbase images
Dockerfile
140
star
20

cbft

Couchbase Full Text server
Go
136
star
21

couchdb

CouchDB
Erlang
129
star
22

kv_engine

Couchbase Key-Value Engine
C++
128
star
23

couchbase-spark-connector

The Official Couchbase Spark Connector
Scala
119
star
24

couchbase-lite-C

C language bindings for the Couchbase Lite embedded NoSQL database engine
C++
112
star
25

nitro

A high performance in-memory index storage engine
Go
107
star
26

couchbase-ruby-client

Couchbase Ruby Client Library (Official)
Ruby
107
star
27

query

Query engine.
Go
103
star
28

kafka-connect-couchbase

Kafka Connect connector for Couchbase Server
Java
70
star
29

couchbase-kafka-connector

Legacy Couchbase to Kafka connector, superseded by Kafka Connect based.
Java
69
star
30

couchbase-lite-java-core

Couchbase Lite Java core library
Java
68
star
31

CouchbaseMock

A Java mock for Couchbase
Java
62
star
32

couchbase-ruby-model

The Active Model implementation for Couchbase Server built on couchbase-ruby-client
Ruby
61
star
33

memcached

Memcached work planned for contribution back to memcached/memcached
C++
56
star
34

couchstore

couchbase storage file library
C
54
star
35

couchbase-lite-java

Portable java version of Couchbase Lite
Java
52
star
36

java-dcp-client

Couchbase Java DCP Client
Java
48
star
37

couchbase-lite-java-ce-root

The root workspace for the Community Editions of the Java language family of products (Java Desktop, Java WebService, and Android)
Shell
47
star
38

ns_server

The Membase Server Superdupervisor.
JavaScript
44
star
39

couchbase-jvm-clients

The Couchbase Monorepo for JVM Clients: Java, Scala, io-core…
Java
44
star
40

kubernetes

Deprecated. Please use the Couchbase Autonomous Operator
Shell
43
star
41

couchbase-cli

Command Line tools for Administering a Couchbase Cluster
Python
39
star
42

moxi

a memcached proxy with energy and pep
C
39
star
43

indexing

Couchbase Indexes
Go
38
star
44

tlm

top level makefile
CMake
35
star
45

docs-site

The Antora playbook project, contributing documentation, and home page for the new Couchbase Docs site.
JavaScript
34
star
46

go_n1ql

N1QL Driver for Go lang's database/sql package
Go
33
star
47

couchbase-jvm-core

The JVM core for Couchbase SDKs.
Java
32
star
48

docs-cb4

Documentation for Couchbase Server 4.x and 5.x GA releases
HTML
28
star
49

ep-engine

Eventually Persistent Couchbase Data Layer.
C++
28
star
50

couchbase-exporter

Couchbase Prometheus Exporter
Go
27
star
51

eventing

Couchbase Eventing Engine
Go
26
star
52

couchbase-lite-android-liteserv

An HTTP (ReST) interface to the Couchbase-Lite database running on the device/emulator
Java
24
star
53

gocbcore

The IO component of gocb
Go
22
star
54

cbgt

The cbgt project provides a generic golang library that manages partitions or data shards across a cluster of servers.
Go
22
star
55

testrunner

The TestRunner (Extracted from carlin).
Python
21
star
56

perfrunner

Performance TAF for Couchbase Server
Python
20
star
57

couchbase-lite-java-native

This is a shared native SQLite library used for Couchbase Lite Android/Java.
C++
20
star
58

couchbase-examples

Ruby
19
star
59

chronicle

Erlang
19
star
60

docs-server

The Couchbase Server documentation source files (in AsciiDoc) used in the Couchbase Docs site.
HTML
18
star
61

service-broker

An Open Service Broker Based Kubernetes Templating Engine
Go
17
star
62

build

jenkins scripts for executing builds, cgi scripts for status and reporting
Shell
17
star
63

goxdcr

Go
16
star
64

phosphor

High performance event tracing
C++
16
star
65

couchbase-fluent-bit

Fast and Lightweight Log processor and forwarder. Based on upstream Fluent Bit, this includes some additional Couchbase specific configuration and support - https://github.com/fluent/fluent-bit
Go
13
star
66

subjson

High performance JSON manipulation library
C++
13
star
67

gperftools

C++
12
star
68

platform

Small library providing a platform layer
C++
12
star
69

docs-ui-old

Produces the UI bundle used by the Couchbase documentation site.
CSS
12
star
70

couchbase-lite-java-listener

Embedded web server to expose Couchbase Lite REST API on an http socket
Java
12
star
71

cbmonitor

cbmonitor
Python
11
star
72

docs-couchbase-lite

Documentation for Couchbase Lite
Java
10
star
73

couchbase-lite-java-javascript

Javascript view engine for Couchbase Lite Android
Java
10
star
74

sg-bucket

Sync Gateway Bucket interface and common code used by all Sync Gateway bucket implementations.
Go
10
star
75

query-ui

The Couchbase query workbench UI for SQL++ / N1QL.
JavaScript
10
star
76

godbc

Golang database connectivity API. This API is more flexible and extensible than golang's built-in database/sql package, because like JDBC, the API uses interfaces instead of concrete types. This allows it to be extended to handle both SQL and NoSQL / JSON data sources.
Go
10
star
77

couchbase-lite-android-ce

The community edition of couchbase lite for android
9
star
78

clog

Couchbase logging for go.
Go
9
star
79

gometa

Go
9
star
80

cbbootstrap

REST API to help bootstrap Couchbase Server clusters
Go
8
star
81

build-infra

Various programs and scripts used by the Build & Release team not directly related to specific software build processes
Dockerfile
7
star
82

gocbmgr

A library for the making Couchbase REST API calls in golang
Go
7
star
83

sigar

System Information Gatherer And Reporter
C++
7
star
84

Android-EmptyApp

The android empty app.
Java
7
star
85

product-metadata

Various configuration files describing products we build
Jinja
6
star
86

go-blip

Go language implementation of BLIP-over-WebSocket protocol
Go
6
star
87

docs-sdk-go

The Go SDK documentation source files used in the new Couchbase Docs site.
Go
5
star
88

build-manifests

Internal build manifests for all products.
5
star
89

tools-common

Go
5
star
90

couchbase-php-client

Couchbase PHP Client Library (Official)
PHP
5
star
91

docs-sdk-java

The Java SDK documentation source files used in the Couchbase Docs site.
Java
5
star
92

couchbase-lite-java-common

Common code for the Java language family of products (Java Desktop, Java WebService, and Android)
Java
5
star
93

server-sandbox

Dockerfiles for couchbase/server-sandbox automated build
Shell
5
star
94

couchbase-hadoop-plugin

A Couchbase to Hadoop (Sqoop) plugin for importing and exporting data
Java
5
star
95

n1k1

n1k1, pronounced "nicky", is a prototype execution compiler and engine for N1QL query plans
Go
4
star
96

gocb-opentelemetry

Go
4
star
97

stellar-gateway

Go
4
star
98

rhmap

robinhood hashmap in golang
Go
4
star
99

spring

Simple Couchbase CRUD-workload generator based on pylibcouchbase
Python
4
star
100

product-texts

Repository for product-specific documents (e.g. READMEs, license files, etc.)
Rich Text Format
3
star