stevedore
A docker client for R
Background
What is docker? Docker is a platform for "containerising" applications - running them in isolation from one another, removing differences of how they are built, what they are built from, and what resources they need (disk, ports, users, etc). It's similar conceptually to virtualisation, but much more light weight.
Why would one want to use docker from R? Whenever you need to control external processes from an R script or package, it might be useful to interact with this process from in containers using docker
- package authors might want a clean environment to test their code (similar to travis)
- a developer using an external database in a package or in an analysis script might use docker to create disposable copies of the database, or to create a copy isolated from their production database
- a researcher might use docker to do a reproducible analysis, or preserve the artefacts that were created along with a copy of the environment that created them
These are discussed further in the applications vignette
Usage
The main function in the package is docker_client; this will construct an object with which we can talk with the docker server.
docker <- stevedore::docker_client()
docker## <docker_client>
## config: Manage docker swarm configs
## container: Work with docker containers
## image: Work with docker images
## network: Work with docker networks
## node: Manage docker swarm nodes
## plugin: Work with docker plugins
## secret: Manage docker swarm secrets
## service: Work with docker services
## swarm: Manage the docker swarm
## task: Work with docker tasks
## volume: Work with docker volumes
## types: Methods for building complex docker types
## api_version()
## connection_info()
## cp(src, dest)
## df()
## events(since = NULL, until = NULL, filters = NULL)
## help(help_type = getOption("help_type"))
## info()
## login(username = NULL, password = NULL, email = NULL,
## serveraddress = NULL)
## ping()
## request(verb, path, query = NULL, body = NULL, headers = NULL,
## stream = NULL)
## version()
With this you can run containers:
docker$container$run("alpine:3.1", c("echo", "hello world"))## Unable to find image 'alpine:3.1' locally
## Pulling from library/alpine 3.1
## Pulling fs layer 745c22e975cc
## 745c22e975cc: Downloading 23.94 kB/2.3 MB 1%
## 745c22e975cc: Downloading 1.72 MB/2.3 MB 75%
## 745c22e975cc: Downloading 2.3 MB/2.3 MB 100%
## Verifying Checksum 745c22e975cc
## Download complete 745c22e975cc
## 745c22e975cc: Extracting 32.77 kB/2.3 MB 1%
## 745c22e975cc: Extracting 327.68 kB/2.3 MB 14%
## 745c22e975cc: Extracting 2.3 MB/2.3 MB 100%
## Pull complete 745c22e975cc
## Digest: sha256:46472d54728aa60eafffeb663348dd5f5de048d701d7190030c75098acd1123d
## Status: Downloaded newer image for alpine:3.1
## O> hello world
## <docker_run_output>
## $container:
## <docker_container>
## id: 818942f57514b0856a1c766af260a54ccb7b192223dab442496585b5f78d403c
## name: blissful_borg
##
## $logs:
## O> hello world
Or run containers in the background
docker$container$run("bfirsh/reticulate-splines", detach = TRUE)## Unable to find image 'bfirsh/reticulate-splines:latest' locally
## Pulling from bfirsh/reticulate-splines latest
## Pulling fs layer e110a4a17941
## Pulling fs layer 9cb73a4f4dd9
## Pulling fs layer 544bc6b7ec68
## 544bc6b7ec68: Downloading 251 B/251 B 100%
## Verifying Checksum 544bc6b7ec68
## Download complete 544bc6b7ec68
## 9cb73a4f4dd9: Downloading 252 B/252 B 100%
## Verifying Checksum 9cb73a4f4dd9
## Download complete 9cb73a4f4dd9
## e110a4a17941: Downloading 23.77 kB/2.31 MB 1%
## Verifying Checksum e110a4a17941
## Download complete e110a4a17941
## e110a4a17941: Extracting 32.77 kB/2.31 MB 1%
## e110a4a17941: Extracting 786.43 kB/2.31 MB 34%
## e110a4a17941: Extracting 2.31 MB/2.31 MB 100%
## Pull complete e110a4a17941
## 9cb73a4f4dd9: Extracting 252 B/252 B 100%
## 9cb73a4f4dd9: Extracting 252 B/252 B 100%
## Pull complete 9cb73a4f4dd9
## 544bc6b7ec68: Extracting 251 B/251 B 100%
## 544bc6b7ec68: Extracting 251 B/251 B 100%
## Pull complete 544bc6b7ec68
## Digest: sha256:67cfd7db171e3de3551c209cfa24c7ae3757d54806d6b8191994a917f3e92723
## Status: Downloaded newer image for bfirsh/reticulate-splines:latest
## <docker_container>
## commit(repo = NULL, tag = NULL, author = NULL, changes = NULL,
## comment = NULL, pause = NULL, hostname = NULL, domainname = NULL,
## user = NULL, attach_stdin = NULL, attach_stdout = NULL,
## attach_stderr = NULL, exposed_ports = NULL, tty = NULL,
## open_stdin = NULL, stdin_once = NULL, env = NULL, cmd = NULL,
## healthcheck = NULL, args_escaped = NULL, image = NULL,
## volumes = NULL, working_dir = NULL, entrypoint = NULL,
## network_disabled = NULL, mac_address = NULL, on_build = NULL,
## labels = NULL, stop_signal = NULL, stop_timeout = NULL,
## shell = NULL)
## cp_in(src, dest)
## cp_out(src, dest)
## diff()
## exec(cmd, stdin = NULL, stdout = TRUE, stderr = TRUE,
## detach_keys = NULL, tty = NULL, env = NULL, privileged = NULL,
## user = NULL, working_dir = NULL, detach = FALSE,
## stream = stdout())
## exec_create(cmd, stdin = NULL, stdout = TRUE, stderr = TRUE,
## detach_keys = NULL, tty = NULL, env = NULL, privileged = NULL,
## user = NULL, working_dir = NULL)
## export()
## get_archive(path, dest)
## help(help_type = getOption("help_type"))
## id()
## image()
## inspect(reload = TRUE)
## kill(signal = NULL)
## labels(reload = TRUE)
## logs(follow = NULL, stdout = TRUE, stderr = TRUE, since = NULL,
## until = NULL, timestamps = NULL, tail = NULL, stream = stdout())
## name()
## path_stat(path)
## pause()
## ports(reload = TRUE)
## put_archive(src, path, no_overwrite_dir_non_dir = NULL)
## reload()
## remove(delete_volumes = NULL, force = NULL, link = NULL)
## rename(name)
## resize(h = NULL, w = NULL)
## restart(t = NULL)
## start(detach_keys = NULL)
## stats()
## status(reload = TRUE)
## stop(t = NULL)
## top(ps_args = NULL)
## unpause()
## update(cpu_shares = NULL, memory = NULL, cgroup_parent = NULL,
## blkio_weight = NULL, blkio_weight_device = NULL,
## blkio_device_read_bps = NULL, blkio_device_write_bps = NULL,
## blkio_device_read_iops = NULL, blkio_device_write_iops = NULL,
## cpu_period = NULL, cpu_quota = NULL, cpu_realtime_period = NULL,
## cpu_realtime_runtime = NULL, cpuset_cpus = NULL,
## cpuset_mems = NULL, devices = NULL, device_cgroup_rules = NULL,
## disk_quota = NULL, kernel_memory = NULL,
## memory_reservation = NULL, memory_swap = NULL,
## memory_swappiness = NULL, nano_cpus = NULL,
## oom_kill_disable = NULL, init = NULL, pids_limit = NULL,
## ulimits = NULL, cpu_count = NULL, cpu_percent = NULL,
## io_maximum_iops = NULL, io_maximum_bandwidth = NULL,
## restart_policy = NULL)
## wait(condition = NULL)
You can manage containers
docker$container$list()## id
## 1 f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c
## names
## 1 gallant_....
## image
## 1 sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9
## image_id
## 1 sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9
## command created ports size_rw size_root_fs
## 1 /usr/local/bin/run.sh 1541670175 characte.... NA NA
## labels state status host_config network_settings
## 1 running Up Less than a second default list(bri....
## mounts name
## 1 characte.... gallant_dubinsky
id <- docker$container$list(limit = 1L)$id
container <- docker$container$get(id)
container## <docker_container>
## commit(repo = NULL, tag = NULL, author = NULL, changes = NULL,
## comment = NULL, pause = NULL, hostname = NULL, domainname = NULL,
## user = NULL, attach_stdin = NULL, attach_stdout = NULL,
## attach_stderr = NULL, exposed_ports = NULL, tty = NULL,
## open_stdin = NULL, stdin_once = NULL, env = NULL, cmd = NULL,
## healthcheck = NULL, args_escaped = NULL, image = NULL,
## volumes = NULL, working_dir = NULL, entrypoint = NULL,
## network_disabled = NULL, mac_address = NULL, on_build = NULL,
## labels = NULL, stop_signal = NULL, stop_timeout = NULL,
## shell = NULL)
## cp_in(src, dest)
## cp_out(src, dest)
## diff()
## exec(cmd, stdin = NULL, stdout = TRUE, stderr = TRUE,
## detach_keys = NULL, tty = NULL, env = NULL, privileged = NULL,
## user = NULL, working_dir = NULL, detach = FALSE,
## stream = stdout())
## exec_create(cmd, stdin = NULL, stdout = TRUE, stderr = TRUE,
## detach_keys = NULL, tty = NULL, env = NULL, privileged = NULL,
## user = NULL, working_dir = NULL)
## export()
## get_archive(path, dest)
## help(help_type = getOption("help_type"))
## id()
## image()
## inspect(reload = TRUE)
## kill(signal = NULL)
## labels(reload = TRUE)
## logs(follow = NULL, stdout = TRUE, stderr = TRUE, since = NULL,
## until = NULL, timestamps = NULL, tail = NULL, stream = stdout())
## name()
## path_stat(path)
## pause()
## ports(reload = TRUE)
## put_archive(src, path, no_overwrite_dir_non_dir = NULL)
## reload()
## remove(delete_volumes = NULL, force = NULL, link = NULL)
## rename(name)
## resize(h = NULL, w = NULL)
## restart(t = NULL)
## start(detach_keys = NULL)
## stats()
## status(reload = TRUE)
## stop(t = NULL)
## top(ps_args = NULL)
## unpause()
## update(cpu_shares = NULL, memory = NULL, cgroup_parent = NULL,
## blkio_weight = NULL, blkio_weight_device = NULL,
## blkio_device_read_bps = NULL, blkio_device_write_bps = NULL,
## blkio_device_read_iops = NULL, blkio_device_write_iops = NULL,
## cpu_period = NULL, cpu_quota = NULL, cpu_realtime_period = NULL,
## cpu_realtime_runtime = NULL, cpuset_cpus = NULL,
## cpuset_mems = NULL, devices = NULL, device_cgroup_rules = NULL,
## disk_quota = NULL, kernel_memory = NULL,
## memory_reservation = NULL, memory_swap = NULL,
## memory_swappiness = NULL, nano_cpus = NULL,
## oom_kill_disable = NULL, init = NULL, pids_limit = NULL,
## ulimits = NULL, cpu_count = NULL, cpu_percent = NULL,
## io_maximum_iops = NULL, io_maximum_bandwidth = NULL,
## restart_policy = NULL)
## wait(condition = NULL)
And control containers
container$inspect()$config$image## [1] "sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9"
container$logs()## O> Reticulating spline 1...
container$stop(t = 0)## NULL
container$remove()## NULL
And manage images
head(docker$image$list())## id
## 1 sha256:f36c4228b2c6863208de3a13f2e467476d00ab492416c0aadcfc0e247db1ee03
## 2 sha256:f2aae6ff5d896839bfb8609cb1510bcf36efcb6950683c3bcfb760668b0eefbe
## 3 sha256:65250ab7e8aa2f0887e890436ef1fb99189037b134ba6204cf3d2a366cd237c1
## 4 sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9
## parent_id repo_tags repo_digests created size shared_size
## 1 alpine:3.1 alpine@s.... 1536704412 5046821 -1
## 2 debian:l.... debian@s.... 1536096084 100576015 -1
## 3 richfitz.... richfitz.... 1517994341 4148087 -1
## 4 bfirsh/r.... bfirsh/r.... 1471273134 4799043 -1
## virtual_size labels containers
## 1 5046821 -1
## 2 100576015 -1
## 3 4148087 0.0.1 -1
## 4 4799043 -1
Some of these functions have many arguments, but stevedore includes help inline:
docker$container$create## function(image, cmd = NULL, hostname = NULL, domainname = NULL,
## user = NULL, attach_stdin = NULL, attach_stdout = NULL,
## attach_stderr = NULL, ports = NULL, tty = NULL, open_stdin = NULL,
## stdin_once = NULL, env = NULL, health_check = NULL,
## args_escaped = NULL, volumes = NULL, working_dir = NULL,
## entrypoint = NULL, network_disabled = NULL, mac_address = NULL,
## on_build = NULL, labels = NULL, stop_signal = NULL,
## stop_timeout = NULL, shell = NULL, host_config = NULL,
## network = NULL, name = NULL)
## ----------------------------------------------------------------------
## Create a container. Similar to the cli command `docker create` or
## `docker container create`.
## ----------------------------------------------------------------------
## image: The name of the image to use when creating the container
## cmd: Command to run specified as a string or an array of
## strings.
## hostname: The hostname to use for the container, as a valid RFC
## 1123 hostname.
## domainname: The domain name to use for the container.
## user: The user that commands are run as inside the container.
## attach_stdin: Whether to attach to `stdin`.
## attach_stdout: Whether to attach to `stdout`.
## attach_stderr: Whether to attach to `stderr`.
## ports: An object mapping ports to an empty object in the form:
##
## `{"<port>/<tcp|udp|sctp>": {}}`
## tty: Attach standard streams to a TTY, including `stdin` if it
## is not closed.
## open_stdin: Open `stdin`
## stdin_once: Close `stdin` after one attached client disconnects
## env: A list of environment variables to set inside the container
## in the form `["VAR=value", ...]`. A variable without `=`
## is removed from the environment, rather than to have an
## empty value.
## health_check: A test to perform to check that the container is
## healthy. Construct with `$types$health_config()`
## args_escaped: Command is already escaped (Windows only)
## volumes: An object mapping mount point paths inside the
## container to empty objects.
## working_dir: The working directory for commands to run in.
## entrypoint: The entry point for the container as a string or an
## array of strings.
##
## If the array consists of exactly one empty string (`[""]`)
## then the entry point is reset to system default (i.e., the
## entry point used by docker when there is no `ENTRYPOINT`
## instruction in the `Dockerfile`).
## network_disabled: Disable networking for the container.
## mac_address: MAC address of the container.
## on_build: `ONBUILD` metadata that were defined in the image's
## `Dockerfile`.
## labels: User-defined key/value metadata.
## stop_signal: Signal to stop a container as a string or unsigned
## integer.
## stop_timeout: Timeout to stop a container in seconds.
## shell: Shell for when `RUN`, `CMD`, and `ENTRYPOINT` uses a
## shell.
## host_config: Container configuration that depends on the host we
## are running on
## network: This container's networking configuration.
## name: Assign the specified name to the container. Must match
## `/?[a-zA-Z0-9_-]+`.
as well as via an help() method on each object (e.g., docker$help(), docker$container$help()) which will display help for the API version that you are using.
Approach
The Docker API is versioned and each version includes a machine-readable API specification. Rather than manually write wrappers that fit the output docker gives, stevedore generates an interface directly from the spefification. Currently stevedore supports docker API versions 1.25 to 1.39 (defaulting to 1.29).
This approach means that the output will be type-stable - there is no inference on what to return based on what the server chooses to return. With a given API version, the same fields will always be returned. Some of this information is very rich, for example, for the backgrounded container above:
container$inspect(reload = FALSE)## $id
## [1] "f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c"
##
## $created
## [1] "2018-11-08T09:42:55.7684396Z"
##
## $path
## [1] "/usr/local/bin/run.sh"
##
## $args
## character(0)
##
## $state
## $state$status
## [1] "running"
##
## $state$running
## [1] TRUE
##
## $state$paused
## [1] FALSE
##
## $state$restarting
## [1] FALSE
##
## $state$oom_killed
## [1] FALSE
##
## $state$dead
## [1] FALSE
##
## $state$pid
## [1] 2100
##
## $state$exit_code
## [1] 0
##
## $state$error
## [1] ""
##
## $state$started_at
## [1] "2018-11-08T09:42:56.1686632Z"
##
## $state$finished_at
## [1] "0001-01-01T00:00:00Z"
##
##
## $image
## [1] "sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9"
##
## $resolv_conf_path
## [1] "/var/lib/docker/containers/f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c/resolv.conf"
##
## $hostname_path
## [1] "/var/lib/docker/containers/f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c/hostname"
##
## $hosts_path
## [1] "/var/lib/docker/containers/f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c/hosts"
##
## $log_path
## [1] "/var/lib/docker/containers/f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c/f19bcf663cc3527acc41d2a5b86810be03a9c82ba7043255981e4611405d446c-json.log"
##
## $node
## NULL
##
## $name
## [1] "/gallant_dubinsky"
##
## $restart_count
## [1] 0
##
## $driver
## [1] "overlay2"
##
## $mount_label
## [1] ""
##
## $process_label
## [1] ""
##
## $app_armor_profile
## [1] ""
##
## $exec_ids
## [1] NA
##
## $host_config
## $host_config$cpu_shares
## [1] 0
##
## $host_config$memory
## [1] 0
##
## $host_config$cgroup_parent
## [1] ""
##
## $host_config$blkio_weight
## [1] 0
##
## $host_config$blkio_weight_device
## [1] path weight
## <0 rows> (or 0-length row.names)
##
## $host_config$blkio_device_read_bps
## [1] path rate
## <0 rows> (or 0-length row.names)
##
## $host_config$blkio_device_write_bps
## [1] path rate
## <0 rows> (or 0-length row.names)
##
## $host_config$blkio_device_read_iops
## [1] path rate
## <0 rows> (or 0-length row.names)
##
## $host_config$blkio_device_write_iops
## [1] path rate
## <0 rows> (or 0-length row.names)
##
## $host_config$cpu_period
## [1] 0
##
## $host_config$cpu_quota
## [1] 0
##
## $host_config$cpu_realtime_period
## [1] 0
##
## $host_config$cpu_realtime_runtime
## [1] 0
##
## $host_config$cpuset_cpus
## [1] ""
##
## $host_config$cpuset_mems
## [1] ""
##
## $host_config$devices
## [1] path_on_host path_in_container cgroup_permissions
## <0 rows> (or 0-length row.names)
##
## $host_config$device_cgroup_rules
## character(0)
##
## $host_config$disk_quota
## [1] 0
##
## $host_config$kernel_memory
## [1] 0
##
## $host_config$memory_reservation
## [1] 0
##
## $host_config$memory_swap
## [1] 0
##
## $host_config$memory_swappiness
## [1] NA
##
## $host_config$nano_cpus
## [1] NA
##
## $host_config$oom_kill_disable
## [1] FALSE
##
## $host_config$init
## [1] NA
##
## $host_config$pids_limit
## [1] 0
##
## $host_config$ulimits
## [1] name soft hard
## <0 rows> (or 0-length row.names)
##
## $host_config$cpu_count
## [1] 0
##
## $host_config$cpu_percent
## [1] 0
##
## $host_config$io_maximum_iops
## [1] 0
##
## $host_config$io_maximum_bandwidth
## [1] 0
##
## $host_config$binds
## character(0)
##
## $host_config$container_idfile
## [1] ""
##
## $host_config$log_config
## $host_config$log_config$type
## [1] "json-file"
##
## $host_config$log_config$config
## character(0)
##
##
## $host_config$network_mode
## [1] "default"
##
## $host_config$port_bindings
## NULL
##
## $host_config$restart_policy
## $host_config$restart_policy$name
## [1] ""
##
## $host_config$restart_policy$maximum_retry_count
## [1] 0
##
##
## $host_config$auto_remove
## [1] FALSE
##
## $host_config$volume_driver
## [1] ""
##
## $host_config$volumes_from
## character(0)
##
## $host_config$mounts
## [1] target source type read_only
## [5] consistency bind_options volume_options tmpfs_options
## <0 rows> (or 0-length row.names)
##
## $host_config$cap_add
## character(0)
##
## $host_config$cap_drop
## character(0)
##
## $host_config$dns
## character(0)
##
## $host_config$dns_options
## character(0)
##
## $host_config$dns_search
## character(0)
##
## $host_config$extra_hosts
## character(0)
##
## $host_config$group_add
## character(0)
##
## $host_config$ipc_mode
## [1] "shareable"
##
## $host_config$cgroup
## [1] ""
##
## $host_config$links
## character(0)
##
## $host_config$oom_score_adj
## [1] 0
##
## $host_config$pid_mode
## [1] ""
##
## $host_config$privileged
## [1] FALSE
##
## $host_config$publish_all_ports
## [1] FALSE
##
## $host_config$readonly_rootfs
## [1] FALSE
##
## $host_config$security_opt
## character(0)
##
## $host_config$storage_opt
## NULL
##
## $host_config$tmpfs
## NULL
##
## $host_config$uts_mode
## [1] ""
##
## $host_config$userns_mode
## [1] ""
##
## $host_config$shm_size
## [1] 67108864
##
## $host_config$sysctls
## NULL
##
## $host_config$runtime
## [1] "runc"
##
## $host_config$console_size
## [1] 0 0
##
## $host_config$isolation
## [1] ""
##
##
## $graph_driver
## $graph_driver$name
## [1] "overlay2"
##
## $graph_driver$data
## lower_dir
## "/var/lib/docker/overlay2/11f5db807974ea3d80bc91877f74f88aeb6e601e91f682b447c5d6b92021fb8a-init/diff:/var/lib/docker/overlay2/c8d267ac9c2c791b61defb32ff381584c45699ba427405916713212557d89e1e/diff:/var/lib/docker/overlay2/52c07e23aeaf3bf61741b0e990d956453c8ae1ee7fa704b09f4d81209a7d4615/diff:/var/lib/docker/overlay2/1d11fb00255ff4b13d8bb5ec599d1f706e449001cd4fe4622457c62df0eac3aa/diff"
## merged_dir
## "/var/lib/docker/overlay2/11f5db807974ea3d80bc91877f74f88aeb6e601e91f682b447c5d6b92021fb8a/merged"
## upper_dir
## "/var/lib/docker/overlay2/11f5db807974ea3d80bc91877f74f88aeb6e601e91f682b447c5d6b92021fb8a/diff"
## work_dir
## "/var/lib/docker/overlay2/11f5db807974ea3d80bc91877f74f88aeb6e601e91f682b447c5d6b92021fb8a/work"
##
##
## $size_rw
## [1] NA
##
## $size_root_fs
## [1] NA
##
## $mounts
## [1] type name source destination driver mode
## [7] rw propagation
## <0 rows> (or 0-length row.names)
##
## $config
## $config$hostname
## [1] "f19bcf663cc3"
##
## $config$domainname
## [1] ""
##
## $config$user
## [1] ""
##
## $config$attach_stdin
## [1] FALSE
##
## $config$attach_stdout
## [1] FALSE
##
## $config$attach_stderr
## [1] FALSE
##
## $config$exposed_ports
## NULL
##
## $config$tty
## [1] FALSE
##
## $config$open_stdin
## [1] FALSE
##
## $config$stdin_once
## [1] FALSE
##
## $config$env
## [1] "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
##
## $config$cmd
## [1] "/usr/local/bin/run.sh"
##
## $config$healthcheck
## NULL
##
## $config$args_escaped
## [1] TRUE
##
## $config$image
## [1] "sha256:b1666055931f332541bda7c425e624764de96c85177a61a0b49238a42b80b7f9"
##
## $config$volumes
## NULL
##
## $config$working_dir
## [1] ""
##
## $config$entrypoint
## character(0)
##
## $config$network_disabled
## [1] NA
##
## $config$mac_address
## [1] NA
##
## $config$on_build
## character(0)
##
## $config$labels
## character(0)
##
## $config$stop_signal
## [1] NA
##
## $config$stop_timeout
## [1] NA
##
## $config$shell
## character(0)
##
##
## $network_settings
## $network_settings$bridge
## [1] ""
##
## $network_settings$sandbox_id
## [1] "02dabb4fbb1379e9f8d2b60629e3c48df126a31c75d1b12ee788465227f3cebd"
##
## $network_settings$hairpin_mode
## [1] FALSE
##
## $network_settings$link_local_ipv6_address
## [1] ""
##
## $network_settings$link_local_ipv6_prefix_len
## [1] 0
##
## $network_settings$ports
## list()
##
## $network_settings$sandbox_key
## [1] "/var/run/docker/netns/02dabb4fbb13"
##
## $network_settings$secondary_ipaddresses
## [1] addr prefix_len
## <0 rows> (or 0-length row.names)
##
## $network_settings$secondary_ipv6_addresses
## [1] addr prefix_len
## <0 rows> (or 0-length row.names)
##
## $network_settings$endpoint_id
## [1] "da5987bfa58745c873503e55926d58a29795e914dabbd129f1a927b383951d63"
##
## $network_settings$gateway
## [1] "172.17.0.1"
##
## $network_settings$global_ipv6_address
## [1] ""
##
## $network_settings$global_ipv6_prefix_len
## [1] 0
##
## $network_settings$ip_address
## [1] "172.17.0.2"
##
## $network_settings$ip_prefix_len
## [1] 16
##
## $network_settings$ipv6_gateway
## [1] ""
##
## $network_settings$mac_address
## [1] "02:42:ac:11:00:02"
##
## $network_settings$networks
## $network_settings$networks$bridge
## $network_settings$networks$bridge$ipam_config
## NULL
##
## $network_settings$networks$bridge$links
## character(0)
##
## $network_settings$networks$bridge$aliases
## character(0)
##
## $network_settings$networks$bridge$network_id
## [1] "8bc1cc7ddc2eb36bcb0856854799a26b41549f16ab0ad9b643a632ba146a4b87"
##
## $network_settings$networks$bridge$endpoint_id
## [1] "da5987bfa58745c873503e55926d58a29795e914dabbd129f1a927b383951d63"
##
## $network_settings$networks$bridge$gateway
## [1] "172.17.0.1"
##
## $network_settings$networks$bridge$ip_address
## [1] "172.17.0.2"
##
## $network_settings$networks$bridge$ip_prefix_len
## [1] 16
##
## $network_settings$networks$bridge$ipv6_gateway
## [1] ""
##
## $network_settings$networks$bridge$global_ipv6_address
## [1] ""
##
## $network_settings$networks$bridge$global_ipv6_prefix_len
## [1] 0
##
## $network_settings$networks$bridge$mac_address
## [1] "02:42:ac:11:00:02"
##
## $network_settings$networks$bridge$driver_opts
## NULL
Windows support
Windows support for docker through this package is currently incomplete. The appveyor build tests only the parts of the package that don't actually call docker due to difficult-to-debug issues with container compatibility on that platform.
Current situation
The support for windows is not as comprehensive as for other platforms (but I'm not sure how common using docker is on windows yet). The reason for this is that curl (and the underlying libcurl library) do not support communicating over "named pipes" which is how docker works on windows 10.
The package includes a small wrapper around the python sdk's docker support. On the R side this requires the reticulate package. It also requires that you have a python installation that includes both the docker package and pypiwin32 - once python is installed you can add these packages to python with
pip install docker pypiwin32
(or pip3 instead of pip to use python3).
You can check that everything is configured by running
stevedore:::httppipe_available(verbose = TRUE)which will return TRUE if everything is OK, and otherwise print some information about errors loading the package. In the case of error consult the reticulate documentation (vignette("versions", package = "reticulate") will be especially useful). Improvements to installation documentation and process are welcome!
Limitations
The primary limitation of the httppipe interface is that streaming connections are not supported. This affects the following methods
- container logs with
follow = TRUE: completely unsupported - container run - works completely with
detach = TRUE, and withdetach = FALSEworks but prints output only at the end (not streaming output) - image build - works but information printed only at end of build rather than streaming
- image pull - works but information printed only at end of pull
- exec start - works but information printed only at end of execution
Going forward
The support in this package is a duplicate of the micropackage httppipe. This implements the minimum functionality with windows named pipes to support docker. I would love for someone to help port this to a python-free package. This probably requires a bit of C/C++ and knowledge of the win32 API.
Development and testing
See the development guide if you want to get started developing stevedore - it provides pointers to the core objects.
Package limitations
Endpoints that require "http hijacking" are not fully supported (primarily attach) but the foundations are there to support this - stdin is likely to be a major hassle though and I'm not sure if it's possible from within R's REPL.
Installation
stevedore can be installed from CRAN using
install.packages("stevedore")On windows you will also need reticulate
install.packages("reticulate")You will also need a python installation and the docker and pypiwin32 packages, which can be installed with pip (see above).
Once installed, find out if everything is set up to use docker by running
stevedore::docker_available()## [1] TRUE
To install the development version from GitHub, you can use remotes:
remotes::install_github("richfitz/stevedore", upgrade = FALSE)Licence
MIT Β© Rich FitzJohn.
Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.