• Stars
    star
    849
  • Rank 53,688 (Top 2 %)
  • Language
    OCaml
  • License
    MIT License
  • Created about 8 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Standard library for OCaml

Base

https://github.com/janestreet/base/actions/workflows/workflow.yml/badge.svg

Base is a standard library for OCaml. It provides a standard set of general purpose modules that are well-tested, performant, and fully-portable across any environment that can run OCaml code. Unlike other standard library projects, Base is meant to be used as a wholesale replacement of the standard library distributed with the OCaml compiler. In particular it makes different choices and doesn’t re-export features that are not fully portable such as I/O, which are left to other libraries.

You also might want to browse the API Documentation.

Installation

Install Base via OPAM:

$ opam install base

Base has no runtime dependencies and is fast to build. Its sole build dependencies are dune, which itself requires nothing more than the compiler, and sexplib0.

Using the OCaml standard library with Base

Base is intended as a full stdlib replacement. As a result, after an open Base, all the modules, values, types, … coming from the OCaml standard library that one normally gets in the default environment are deprecated.

In order to access these values, one must use the Stdlib library, which re-exports them all through the toplevel name Stdlib: Stdlib.String, Stdlib.print_string, …

Differences between Base and the OCaml standard library

Programmers who are used to the OCaml standard library should read through this section to understand major differences between the two libraries that one should be aware of when switching to Base.

Comparison operators

The comparison operators exposed by the OCaml standard library are polymorphic:

val compare : 'a -> 'a -> int
val ( <= ) : 'a -> 'a -> bool
...

What they implement is structural comparison of the runtime representation of values. Since these are often error-prone, i.e. they don’t correspond to what the user expects, they are not exposed directly by Base.

To use polymorphic comparison with Base, one should use the Poly module. The default comparison operators exposed by Base are the integer ones, just like the default arithmetic operators are the integer ones.

The recommended way to compare arbitrary complex data structures is to use the specific compare functions. For instance:

List.compare String.compare x y

The ppx_compare rewriter offers an alternative way to write this:

[%compare: string list] x y

Base and ppx code generators

Base uses a few ppx code generators to implement:

  • reliable and customizable comparison of OCaml values
  • reliable and customizable hash of OCaml values
  • conversions between OCaml values and s-expression

However, it doesn’t need these code generators to build. What it does instead is use ppx as a code verification tool during development. It works in a very similar fashion to expectation tests.

Whenever you see this in the code source:

type t = ... [@@deriving_inline sexp_of]
let sexp_of_t = ...
[@@@end]

the code between the [@@deriving_inline] and the [@@@end] is generated code. The generated code is currently quite big and hard to read, however we are working on making it look like human-written code.

You can put the following elisp code in your ~/.emacs file to hide these blocks:

(defun deriving-inline-forward-sexp (&optional arg)
  (search-forward-regexp "\\[@@@end\\]") nil nil arg)

(defun setup-hide-deriving-inline ()
  (inline)
  (hs-minor-mode t)
  (let ((hs-hide-comments-when-hiding-all nil))
    (hs-hide-all)))

(require 'hideshow)
(add-to-list 'hs-special-modes-alist
             '(tuareg-mode "\\[@@deriving_inline[^]]*\\]" "\\[@@@end\\]" nil
                           deriving-inline-forward-sexp nil))
(add-hook 'tuareg-mode-hook 'setup-hide-deriving-inline)

Things are not yet setup in the git repository to make it convenient to change types and update the generated code, but they will be setup soon.

Base coding rules

There are a few coding rules across the code base that are enforced by lint tools.

These rules are:

  • Opening the Stdlib module is not allowed. Inside Base, the OCaml stdlib is shadowed and accessible through the Stdlib module. We forbid opening Stdlib so that we know exactly where things come from.
  • Stdlib.Foo modules cannot be aliased, one must use Stdlib.Foo explicitly. This is to avoid having to remember a list of aliases at the beginning of each file.
  • For some modules that are both in the OCaml stdlib and Base, such as String, we define a module String0 for common functions that cannot be defined directly in Base.String to avoid creating a circular dependency. Except for String itself, other modules are not allowed to use Stdlib.String and must use either String or String0 instead.
  • Indentation is exactly the one of ocp-indent.
  • A few other coding style rules enforced by ppx_js_style.

The Base specific coding rules are checked by ppx_base_lint, in the lint subfolder. The indentation rules are checked by a wrapper around ocp-indent and the coding style rules are checked by ppx_js_style.

These checks are currently not run by dune, but it will soon get a -dev flag to run them automatically.

Sexp (de-)serializers

Most types in Base have sexp_of_t and t_of_sexp functions for converting between values of that type and their sexp representations.

One pair of functions deserves special attention: String.sexp_of_t and String.t_of_sexp. These functions have the same types as Sexp.of_string and Sexp.to_string but very different behavior.

String.sexp_of_t and String.t_of_sexp are used to encode and decode strings “embedded” in a sexp representation. On the other hand, Sexp.of_string and Sexp.to_string are used to encode and decode the textual form of s-expressions.

The following example demonstrates the two pairs of functions in action:

open! Base
open! Stdio

(* Embed a string in a sexp *)

let example_sexp : Sexp.t = List.sexp_of_t String.sexp_of_t [ "hello"; "world" ]

let () =
  assert (Sexp.equal example_sexp (Sexp.List [ Sexp.Atom "hello"; Sexp.Atom "world" ]))
;;

let () =
  assert (
    List.equal
      String.equal
      [ "hello"; "world" ]
      (List.t_of_sexp String.t_of_sexp example_sexp))
;;

(* Embed a sexp in text (string) *)

let write_sexp_to_file sexp =
  Out_channel.write_all "/tmp/file" ~data:(Sexp.to_string example_sexp)
;;

(* /tmp/file now contains:

   {v
     (hello world)
   v} *)

let () =
  assert (Sexp.equal example_sexp (Sexp.of_string (In_channel.read_all "/tmp/file")))
;;

More Repositories

1

magic-trace

magic-trace collects and displays high-resolution traces of what a process is doing
OCaml
4,420
star
2

core

Jane Street Capital's standard library overlay
OCaml
1,030
star
3

incremental

A library for incremental computations
OCaml
797
star
4

hardcaml

Hardcaml is an OCaml library for designing hardware.
OCaml
558
star
5

learn-ocaml-workshop

Exercises and projects for Jane Street's OCaml Workshop
OCaml
460
star
6

incr_dom

A library for building dynamic webapps, using Js_of_ocaml.
OCaml
360
star
7

bonsai

A library for building dynamic webapps, using Js_of_ocaml
OCaml
340
star
8

ecaml

Writing Emacs plugin in OCaml
OCaml
242
star
9

core_kernel

Jane Street's standard library overlay (kernel)
OCaml
216
star
10

patdiff

File Diff using the Patience Diff algorithm. https://opensource.janestreet.com/patdiff/
OCaml
199
star
11

async

Jane Street Capital's asynchronous execution library
OCaml
183
star
12

iron

Jane Street code review system
149
star
13

vcaml

OCaml bindings for the Neovim API
OCaml
148
star
14

sexplib

Automated S-expression conversion
OCaml
142
star
15

ppx_expect

Cram like framework for OCaml
OCaml
130
star
16

ppx_inline_test

Syntax extension for writing in-line tests in ocaml code
OCaml
124
star
17

ppx_let

Monadic let-bindings
OCaml
108
star
18

pythonlib

A library to help writing wrappers around ocaml code for python
OCaml
94
star
19

install-ocaml

Instructions for setting up an OCaml development environment
OCaml
94
star
20

jenga

Build system
89
star
21

ppx_sexp_conv

Generation of S-expression conversion functions from type definitions
OCaml
78
star
22

torch

OCaml
74
star
23

bin_prot

Binary protocol generator
OCaml
68
star
24

ppx_optcomp

Optional compilation for OCaml
OCaml
62
star
25

memtrace

Streaming client for OCaml's Memprof
OCaml
61
star
26

ocaml_plugin

Automatically build and dynlink ocaml source files
OCaml
60
star
27

ppx_yojson_conv

[@@deriving] plugin to generate Yojson conversion functions
OCaml
58
star
28

async_kernel

Jane Street Capital's asynchronous execution library (core)
OCaml
57
star
29

ppx_fields_conv

Generation of accessor and iteration functions for ocaml records
OCaml
55
star
30

accessor

A library that makes it nicer to work with nested functional data structures
OCaml
51
star
31

opam-repository

Opam repository for the development version of Jane Street packages
51
star
32

virtual_dom

OCaml bindings for the virtual-dom library
OCaml
51
star
33

spawn

Spawning sub-processes
C
48
star
34

rpc_parallel

Type-safe library for building parallel applications, built on top of Async's Rpc module.
OCaml
47
star
35

incremental_kernel

Library for incremental computations depending only on Core_kernel
OCaml
45
star
36

core_bench

Micro-benchmarking library for OCaml
OCaml
44
star
37

sexp

S-expression swiss knife
OCaml
43
star
38

async_smtp

SMTP client and server
OCaml
42
star
39

ppx_variants_conv

Generation of accessor and iteration functions for ocaml variant types
OCaml
40
star
40

re2

OCaml bindings for RE2
C++
39
star
41

higher_kinded

A library with an encoding of higher kinded types in OCaml
OCaml
36
star
42

async_parallel

Distributed computing library
OCaml
35
star
43

ppx_python

[@@deriving] plugin to generate Python conversion functions
OCaml
33
star
44

stdio

Standard IO Library for OCaml
OCaml
33
star
45

parsexp

S-expression parsing library
OCaml
32
star
46

core_extended

Jane Street Capital's standard library overlay
OCaml
32
star
47

async_unix

Jane Street Capital's asynchronous execution library (unix)
OCaml
30
star
48

ocaml_intrinsics

Provides functions to invoke amd64 instructions (such as clz,popcnt,rdtsc,rdpmc) when available, or compatible software implementation on other targets.
OCaml
29
star
49

ppx_string

ppx extension for string interpolation
OCaml
28
star
50

memtrace_viewer

Interactive memory profiler based on Memtrace
OCaml
27
star
51

async_ssl

Async wrappers for ssl
OCaml
27
star
52

incr_map

Helpers for incremental operations on map like data structures.
OCaml
26
star
53

noise-wireguard-ocaml

An implementation of the Noise Protocol, intended to be used as the base for a Wireguard implementation in OCaml.
OCaml
26
star
54

ppx_enumerate

Generate a list containing all values of a finite type
OCaml
24
star
55

ppx_jane

Standard Jane Street ppx rewriters
Makefile
23
star
56

zstandard

OCaml bindings to Zstandard
OCaml
23
star
57

tracing

Tracing library
OCaml
23
star
58

typerep

Runtime types for OCaml (beta version)
OCaml
22
star
59

camlp4-to-ppx

Convert from camlp4 + syntax extensions to regular OCaml + extension points and attributes
OCaml
22
star
60

postgres_async

OCaml/async implementation of the postgres protocol (i.e., does not use C-bindings to libpq)
OCaml
22
star
61

sexp_pretty

S-expression pretty-printer
OCaml
22
star
62

ppx_custom_printf

Printf-style format-strings for user-defined string conversion
OCaml
21
star
63

ppx_compare

Generation of comparison functions from types
OCaml
21
star
64

zarith_stubs_js

Javascripts stubs for the Zarith library
OCaml
21
star
65

fieldslib

OCaml record fields as first class values
Makefile
20
star
66

patience_diff

Tool and library implementing patience diff
OCaml
20
star
67

lwt-async

Lwt with async backend
OCaml
19
star
68

bigdecimal

Arbitrary-precision decimal based on Zarith
OCaml
19
star
69

configurator

Helper library for gathering system configuration
OCaml
19
star
70

ppx_csv_conv

Generate functions to read/write records in csv format
OCaml
19
star
71

janestreet.github.com

Front page
HTML
19
star
72

textutils

OCaml
18
star
73

ocaml-compiler-libs

compiler libraries repackaged
OCaml
18
star
74

universe

Jane Street universe
OCaml
18
star
75

jsonaf

A library for parsing, manipulating, and serializing data structured as JSON.
OCaml
18
star
76

sexplib0

Library containing the definition of S-expressions and some base converters
OCaml
17
star
77

ppx_stable

Stable types conversions generator
OCaml
17
star
78

ppx_css

A ppx that takes in css strings and produces a module for accessing the unique names defined within.
OCaml
16
star
79

core_unix

Unix-specific portions of Core
OCaml
15
star
80

async_extra

Jane Street Capital's asynchronous execution library (extra)
OCaml
15
star
81

hardcaml_of_verilog

Convert Verilog to a Hardcaml design
OCaml
15
star
82

base_quickcheck

Randomized testing framework, designed for compatibility with Base
OCaml
15
star
83

ppx_type_directed_value

Get [@@deriving]-style generation of type-directed values without writing a ppx
OCaml
15
star
84

async_websocket

A library that implements the websocket protocol on top of Async
OCaml
15
star
85

hardcaml_circuits

Hardcaml Circuits
OCaml
14
star
86

redis-async

Redis client for Async applications
OCaml
14
star
87

ppx_hash

A ppx rewriter that generates hash functions from type expressions and definitions
OCaml
14
star
88

file_path

A library for typed manipulation of UNIX-style file paths.
OCaml
14
star
89

merlin-jst

Merlin with support for Jane Street extensions
OCaml
14
star
90

ppx_assert

Assert-like extension nodes that raise useful errors on failure
OCaml
14
star
91

ppx_js_style

Code style checker for Jane Street Packages
OCaml
14
star
92

core_profiler

Profiling library
OCaml
14
star
93

result

Compat result type
OCaml
14
star
94

async_js

A small library that provide Async support for JavaScript platforms
OCaml
13
star
95

topological_sort

Topological sort algorithm
OCaml
13
star
96

hardcaml_verify

Hardcaml Verification Tools
OCaml
13
star
97

ppx_log

Ppx_sexp_message-like extension nodes for lazily rendering log messages
OCaml
13
star
98

toplevel_expect_test

Toplevel expectation test
OCaml
13
star
99

line-up-words

a small cmd line tool to align words in a sequence of lines in a smart way
OCaml
13
star
100

timezone

Time-zone handling
OCaml
12
star