• Stars
    star
    84
  • Rank 389,211 (Top 8 %)
  • Language
    Elixir
  • License
    MIT License
  • Created over 8 years ago
  • Updated almost 4 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Keep your ETS tables running forever using bouncing GenServers

Eternal

Build Status Coverage Status Hex.pm Version Documentation

Eternal is a simple way to monitor an ETS table to ensure that it never dies. It works by using bouncing GenServers to ensure that both an owner and heir are always available, via the use of scheduled monitoring and message passing. The idea is similar to that of the Immortal library, but taking it further to ensure a more bulletproof solution - and removing the need to have a single process dedicated to owning your ETS table.

Installation

Eternal is available on Hex. You can install the package via:

  1. Add eternal to your list of dependencies in mix.exs:

    def deps do
      [{:eternal, "~> 1.2"}]
    end
  2. Ensure eternal is started before your application:

    def application do
      [applications: [:eternal]]
    end

Usage

Manual Startup

The API of Eternal is quite small in order to reduce the risk of potential crashes (as that would cause you to lose your ETS tables). You'll probably just want to use start_link/3 which behaves quite similarly to :ets.new/2. The first two arguments are identical to :ets.new/2, and the latter is just a Keyword List of options to configure Eternal.

It should be noted that the table will always have the :public (for table access) and :named_table (for table naming) arguments passed in, whether specified or not. Both the second and third arguments are optional.

iex> Eternal.start_link(:table1, [ :set, { :read_concurrency, true }])
{ :ok, #PID<0.402.0> }
iex> Eternal.start_link(:table2, [ :set, { :read_concurrency, true }], [ quiet: true ])
{ :ok, #PID<0.406.0> }

For further usage examples, please see the documentation.

Application Supervision

I'd highly recommend setting up an Application and letting Eternal start up inside the Supervision tree this way - just make sure that your strategy is :one_for_one, otherwise a crash in a different child in the tree would restart your ETS table.

defmodule MyApplication do
  # define application
  use Application

  # See http://elixir-lang.org/docs/stable/elixir/Application.html
  # for more information on OTP Applications
  def start(_type, _args) do
    import Supervisor.Spec, warn: false

    # Define workers and child supervisors to be supervised
    children = [
      supervisor(Eternal, [:table, [ :compressed ], [ quiet: true ]])
    ]

    # See http://elixir-lang.org/docs/stable/elixir/Supervisor.html
    # for other strategies and supported options
    opts = [ strategy: :one_for_one ]
    Supervisor.start_link(children, opts)
  end
end

If you need a strategy other than :one_for_one (which is rare), you can simply hoist Eternal to a tree above your main application tree. This is a little more complicated, but ensures your tables are safe. You can do this using something like the following (you can see how Eternal is distanced from your app logic which may cause a restart):

defmodule MyApplication do
  # define application
  use Application

  # See http://elixir-lang.org/docs/stable/elixir/Application.html
  # for more information on OTP Applications
  def start(_type, _args) do
    import Supervisor.Spec, warn: false

    # Note how we create our main application tree separately to our Eternal
    # tree, thus making Eternal resistant to crashes around your application.
    children = [
      supervisor(Eternal, [:table, [ :compressed ], [ quiet: true ]]),
      supervisor(Supervisor, [MyApplication.OneForAllSupervisor, [ ]])
    ]

    # See http://elixir-lang.org/docs/stable/elixir/Supervisor.html
    # for other strategies and supported options
    opts = [ strategy: :one_for_one ]
    Supervisor.start_link(children, opts)
  end
end

defmodule MyApplication.OneForAllSupervisor do
  use Supervisor

  def init([]) do
    children = [ worker(MyModuleWhichMightCrash, []) ]
    supervise(children, strategy: :one_for_all)
  end
end

Contributions

If you feel something can be improved, or have any questions about certain behaviours or pieces of implementation, please feel free to file an issue. Proposed changes should be taken to issues before any PRs to avoid wasting time on code which might not be merged upstream.

Credits

Thanks to the following for the inspiration for this project:

More Repositories

1

cachex

A powerful caching library for Elixir with support for transactions, fallbacks and expirations
Elixir
1,519
star
2

runiq

An efficient way to filter duplicate lines from input, à la uniq.
Rust
203
star
3

local-cluster

Easy local cluster creation for Elixir to aid in unit testing
Elixir
193
star
4

bytelines

Read input lines as byte slices for high efficiency
Rust
61
star
5

jen

A fast utility to generate fake/test documents based on a template
Rust
59
star
6

sleeplocks

BEAM friendly spinlocks for Elixir/Erlang
Erlang
53
star
7

s3-utils

Utilities and tools based around Amazon S3 to provide convenience APIs in a CLI
Rust
53
star
8

stash

A small and user-friendly ETS wrapper for caching in Elixir
Elixir
52
star
9

limber

A simple (but quick) tool for backing up Elasticsearch documents
Rust
50
star
10

retainer

Minimal async cache in Rust with support for key expirations
Rust
49
star
11

s3-meta

Gather metadata about your S3 buckets
Rust
49
star
12

tiny

A small, fast and fully compliant JSON parser in Elixir
Elixir
47
star
13

s3-concat

Concatenate Amazon S3 files remotely using flexible patterns
Rust
38
star
14

usher

Parameterized routing for generic resources in Rust
Rust
36
star
15

efflux

Easy Hadoop Streaming and MapReduce interfaces in Rust
Rust
34
star
16

siphash-java

SipHash in Java; zero-allocation and streaming implementations
Java
29
star
17

expool

Extremely simple Process pooling and task submission in Elixir
Elixir
25
star
18

vessel

Elixir MapReduce interfaces with Hadoop Streaming integration
Elixir
23
star
19

neek

A simple way to filter duplicate lines from a list, à la uniq.
JavaScript
22
star
20

it.each

A Mocha extension allowing for test looping with (a)sync calls
JavaScript
21
star
21

hypex

Fast HyperLogLog implementation for Elixir/Erlang
Elixir
20
star
22

siphash-elixir

An Elixir implementation of the SipHash cryptographic hash family
Elixir
18
star
23

detox

Quickly clean up your development directories before backups
Rust
18
star
24

capture-console

Simple and easy stdio capture for Node.js
JavaScript
16
star
25

RSSDemo

A simple demonstration of an RSS reader for Android.
Java
16
star
26

sentix

A cross-platform file watcher for Elixir based on fswatch.
Elixir
15
star
27

siphash-cpp

A small C++ implementation of SipHash using a streaming algorithm with CLI
C++
12
star
28

dot-notes-js

Simple dot/bracket notation parsing/conversion for JSON
JavaScript
12
star
29

jumper

Jump consistent hash implementation in Elixir (without NIFs)
Elixir
12
star
30

rabbitmq-delimiter-exchange

Performant RabbitMQ exchange with support for multiple routing keys per message
Makefile
12
star
31

unsafe

Generate unsafe (!) bindings for Elixir functions
Elixir
12
star
32

deppie

Elixir's coolest deprecation logger
Elixir
11
star
33

pre_plug

Guarantee your Elixir Plugs execute on every request
Elixir
9
star
34

docker-geoipupdate

Minimal container for updating GeoIP databases on your host system
Shell
8
star
35

global-flags

Write once global flags for Erlang and Elixir.
Erlang
8
star
36

kscrash-converter

Converts KSCrash JSON output to Apple format
JavaScript
7
star
37

dot-notes-elixir

Simple dot/bracket notation parsing/conversion for Maps/Lists
Elixir
7
star
38

gen_delegate

Macro based delegates for GenServer functions
Elixir
7
star
39

andrest

Basic REST protocol implementation for Android.
Java
6
star
40

phoenix_mongo

An example of setting up Phoenix to use the unofficial Mongo Ecto library
CSS
6
star
41

rabbitmq-manager

A RabbitMQ monitoring system written in NodeJS.
JavaScript
6
star
42

elasticsearch-bulk-operator

Elasticsearch Bulk API bindings using the Java REST client
Java
5
star
43

lowdb-titanium-adapter

Titanium SDK adapter for the LowDB embedded database
JavaScript
4
star
44

loki-titanium-adapter

Titanium SDK adapter for the LokiJS embedded database
JavaScript
4
star
45

dot-notes-java

Jackson JSON flattening/iteration/inflation using simple key parsing
Java
4
star
46

siphash-c

A C (89) implementation of the SipHash cryptographic hash family, using a single pass algorithm
C
3
star
47

child-spec-compat

Compatibility macros for Elixir v1.5+ child specifications
Elixir
3
star
48

global-lazy

Lazy global initialization for Elixir, without state
Elixir
3
star
49

argle

Convenient argument shifting because you know you need it
JavaScript
2
star
50

dropwizard-environment-substitutor

Global environment overrides for Dropwizard configuration
Java
2
star
51

native-hashset

A native HashSet implementation for Node.js and io.js.
C++
2
star
52

luger

Handy logging plug for Elixir with IP and status support
Elixir
2
star
53

dottie

A small library for dealing with JSON dot notation.
Java
2
star
54

archive_bundle

A small task to bundle dependencies into an archive build in Elixir
Elixir
1
star
55

dep-validate

Dependency verification for npm packages with Gulp support
JavaScript
1
star
56

granular-logger

A Winston wrapper to allow time-based log files
JavaScript
1
star
57

expansion-js

Simple library for NodeJS to expand (and make it easier to expand) the functionality of objects
JavaScript
1
star
58

neps

Node.js REPL with package installation and automatic loading support
JavaScript
1
star
59

appddl

Extremely small CLI tool used to update agent archives from AppDynamics
Rust
1
star
60

noddle

Simple loading of the current project workspace into a REPL
JavaScript
1
star
61

json-output-format

JSON output formats for Hadoop MapReduce jobs
Java
1
star
62

svn-to-git

Scripts to convert a Subversion repository to Git.
Shell
1
star
63

projects

A collection of notes and whatnot in regards to either planned or existing projects
JavaScript
1
star
64

waterline-express-example

A base MVC layout using Waterline and Express
JavaScript
1
star