• Stars
    star
    774
  • Rank 53,643 (Top 2 %)
  • Language
    R
  • License
    Other
  • Created over 4 years ago
  • Updated 5 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Function-oriented Make-like declarative workflows for R

targets

ropensci JOSS zenodo R Targetopia CRAN status check codecov lint

Pipeline tools coordinate the pieces of computationally demanding analysis projects. The targets package is a Make-like pipeline tool for statistics and data science in R. The package skips costly runtime for tasks that are already up to date, orchestrates the necessary computation with implicit parallel computing, and abstracts files as R objects. If all the current output matches the current upstream code and data, then the whole pipeline is up to date, and the results are more trustworthy than otherwise.

Philosophy

A pipeline is a computational workflow that does statistics, analytics, or data science. Examples include forecasting customer behavior, simulating a clinical trial, and detecting differential expression from genomics data. A pipeline contains tasks to prepare datasets, run models, and summarize results for a business deliverable or research paper. The methods behind these tasks are user-defined R functions that live in R scripts, ideally in a folder called "R/" in the project. The tasks themselves are called “targets”, and they run the functions and return R objects. The targets package orchestrates the targets and stores the output objects to make your pipeline efficient, painless, and reproducible.

Prerequisites

  1. Familiarity with the R programming language, covered in R for Data Science.
  2. Data science workflow management techniques.
  3. How to write functions to prepare data, analyze data, and summarize results in a data analysis project.

Installation

If you are using targets with crew for distributed computing, it is recommended to use crew version 0.4.0 or higher.

install.packages("crew")

There are multiple ways to install the targets package itself, and both the latest release and the development version are available.

Type Source Command
Release CRAN install.packages("targets")
Development GitHub remotes::install_github("ropensci/targets")
Development rOpenSci install.packages("targets", repos = "https://dev.ropensci.org")

Get started in 4 minutes

The 4-minute video at https://vimeo.com/700982360 demonstrates the example pipeline used in the walkthrough and functions chapters of the user manual. Visit https://github.com/wlandau/targets-four-minutes for the code and https://rstudio.cloud/project/3946303 to try out the code in a browser (no download or installation required).

Usage

To create a pipeline of your own:

  1. Write R functions for a pipeline and save them to R scripts (ideally in the "R/" folder of your project).
  2. Call use_targets() to write key files, including the vital _targets.R file which configures and defines the pipeline.
  3. Follow the comments in _targets.R to fill in the details of your specific pipeline.
  4. Check the pipeline with tar_visnetwork(), run it with tar_make(), and read output with tar_read(). More functions are available.

Documentation

Help

Please read the help guide to learn how best to ask for help using targets.

Courses

Recorded talks

English

Español

日本語

Example projects

Apps

Deployment

Extending and customizing targets

Code of conduct

Please note that this package is released with a Contributor Code of Conduct.

Citation

citation("targets")
To cite targets in publications use:

  Landau, W. M., (2021). The targets R package: a dynamic Make-like
  function-oriented pipeline toolkit for reproducibility and
  high-performance computing. Journal of Open Source Software, 6(57),
  2959, https://doi.org/10.21105/joss.02959

A BibTeX entry for LaTeX users is

  @Article{,
    title = {The targets R package: a dynamic Make-like function-oriented pipeline toolkit for reproducibility and high-performance computing},
    author = {William Michael Landau},
    journal = {Journal of Open Source Software},
    year = {2021},
    volume = {6},
    number = {57},
    pages = {2959},
    url = {https://doi.org/10.21105/joss.02959},
  }

More Repositories

1

drake

An R-focused pipeline toolkit for reproducibility and high-performance computing
R
1,331
star
2

skimr

A frictionless, pipeable approach to dealing with summary statistics
HTML
1,087
star
3

rtweet

🐦 R client for interacting with Twitter's [stream and REST] APIs
R
785
star
4

tabulizer

Bindings for Tabula PDF Table Extractor Library
R
512
star
5

pdftools

Text Extraction, Rendering and Converting of PDF Documents
C++
474
star
6

assertr

Assertive programming for R analysis pipelines
R
453
star
7

magick

Magic, madness, heaven, sin
R
439
star
8

visdat

Preliminary Exploratory Visualisation of Data
R
439
star
9

stplanr

Sustainable transport planning with R
R
408
star
10

RSelenium

An R client for Selenium Remote WebDriver
R
332
star
11

rnoaa

R interface to many NOAA data APIs
R
319
star
12

osmdata

R package for downloading OpenStreetMap data
R
295
star
13

charlatan

Create fake data in R
R
280
star
14

software-review

rOpenSci Software Peer Review.
R
265
star
15

iheatmapr

Complex, interactive heatmaps in R
R
259
star
16

taxize

A taxonomic toolbelt for R
R
250
star
17

rrrpkg

Use of an R package to facilitate reproducible research
248
star
18

elastic

R client for the Elasticsearch HTTP API
R
243
star
19

tesseract

Bindings to Tesseract OCR engine for R
R
236
star
20

qualtRics

Download ⬇️ Qualtrics survey data directly into R!
R
204
star
21

git2r

R bindings to the libgit2 library
C
204
star
22

writexl

Portable, light-weight data frame to xlsx exporter for R
C
196
star
23

biomartr

Genomic Data Retrieval with R
R
195
star
24

rnaturalearth

An R package to hold and facilitate interaction with natural earth map data 🌍
R
191
star
25

googleLanguageR

R client for the Google Translation API, Google Cloud Natural Language API and Google Cloud Speech API
HTML
189
star
26

textreuse

Detect text reuse and document similarity
R
188
star
27

tokenizers

Fast, Consistent Tokenization of Natural Language Text
R
179
star
28

rentrez

talk with NCBI entrez using R
R
178
star
29

piggyback

📦 for using large(r) data files on GitHub
R
167
star
30

rcrossref

R client for various CrossRef APIs
R
159
star
31

osmextract

Download and import OpenStreetMap data from Geofabrik and other providers
R
157
star
32

dataspice

🌶️ Create lightweight schema.org descriptions of your datasets
R
155
star
33

tic

Tasks Integrating Continuously: CI-Agnostic Workflow Definitions
R
154
star
34

webchem

Chemical Information from the Web
R
149
star
35

geojsonio

Convert many data formats to & from GeoJSON & TopoJSON
R
148
star
36

MODIStsp

An "R" package for automatic download and preprocessing of MODIS Land Products Time Series
R
147
star
37

DataPackageR

An R package to enable reproducible data processing, packaging and sharing.
R
146
star
38

tsbox

tsbox: Class-Agnostic Time Series in R
R
143
star
39

rgbif

Interface to the Global Biodiversity Information Facility API
R
142
star
40

dev_guide

rOpenSci Packages: Development, Maintenance, and Peer Review
R
141
star
41

jqr

R interface to jq
R
137
star
42

ghql

GraphQL R client
R
136
star
43

osfr

R interface to the Open Science Framework (OSF)
R
135
star
44

osmplotr

Data visualisation using OpenStreetMap objects
R
130
star
45

opencv

R bindings for OpenCV
C++
127
star
46

ssh

Native SSH client in R based on libssh
C
126
star
47

RefManageR

R package RefManageR
R
113
star
48

spocc

Species occurrence data toolkit for R
R
109
star
49

ezknitr

Avoid the typical working directory pain when using 'knitr'
R
107
star
50

hunspell

High-Performance Stemmer, Tokenizer, and Spell Checker for R
C++
106
star
51

crul

R6 based http client for R (made for developers)
R
101
star
52

gistr

Interact with GitHub gists from R
R
101
star
53

spelling

Tools for Spell Checking in R
R
101
star
54

rfishbase

R interface to the fishbase.org database
R
100
star
55

git2rdata

An R package for storing and retrieving data.frames in git repositories.
R
99
star
56

weathercan

R package for downloading weather data from Environment and Climate Change Canada
R
97
star
57

bib2df

Parse a BibTeX file to a tibble
R
97
star
58

ckanr

R client for the CKAN API
R
97
star
59

gutenbergr

Search and download public domain texts from Project Gutenberg
R
94
star
60

rsvg

SVG renderer for R based on librsvg2
C
94
star
61

tarchetypes

Archetypes for targets and pipelines
R
92
star
62

nasapower

API Client for NASA POWER Global Meteorology, Surface Solar Energy and Climatology in R
R
92
star
63

EML

Ecological Metadata Language interface for R: synthesis and integration of heterogenous data
R
92
star
64

cyphr

:shipit: Humane encryption
R
91
star
65

FedData

Functions to Automate Downloading Geospatial Data Available from Several Federated Data Sources
R
87
star
66

UCSCXenaTools

📦 An R package for accessing genomics data from UCSC Xena platform, from cancer multi-omics to single-cell RNA-seq https://cran.r-project.org/web/packages/UCSCXenaTools/
R
87
star
67

mapscanner

R package to print maps, draw on them, and scan them back in
R
85
star
68

tidync

NetCDF exploration and data extraction
R
85
star
69

opencage

🌐 R package for the OpenCage API -- both forward and reverse geocoding 🌐
R
85
star
70

av

Working with Video in R
C
84
star
71

GSODR

API Client for Global Surface Summary of the Day ('GSOD') Weather Data Client in R
R
83
star
72

rzmq

R package for ZMQ
C++
82
star
73

bikedata

🚲 Extract data from public hire bicycle systems
R
79
star
74

historydata

Datasets for Historians
R
78
star
75

arkdb

Archive and unarchive databases as flat text files
R
78
star
76

fingertipsR

R package to interact with Public Health England’s Fingertips data tool
R
78
star
77

smapr

An R package for acquisition and processing of NASA SMAP data
R
77
star
78

vcr

Record HTTP calls and replay them
R
76
star
79

dittodb

dittodb: A Test Environment for DB Queries in R
R
76
star
80

nodbi

Document DBI connector for R
R
75
star
81

opentripplanner

An R package to set up and use OpenTripPlanner (OTP) as a local or remote multimodal trip planner.
R
73
star
82

nlrx

nlrx NetLogo R
R
71
star
83

tidyhydat

An R package to import Water Survey of Canada hydrometric data and make it tidy
R
70
star
84

rebird

Wrapper to the eBird API
R
70
star
85

robotstxt

robots.txt file parsing and checking for R
R
68
star
86

CoordinateCleaner

Automated flagging of common spatial and temporal errors in biological and palaeontological collection data, for the use in conservation, ecology and palaeontology.
HTML
68
star
87

gittargets

Data version control for reproducible analysis pipelines in R with {targets}.
R
67
star
88

tradestatistics

R package to access Open Trade Statistics API
R
65
star
89

roadoi

Use Unpaywall with R
R
64
star
90

unconf17

Website for 2017 rOpenSci Unconf
JavaScript
64
star
91

NLMR

📦 R package to simulate neutral landscape models 🏔
R
63
star
92

rWBclimate

R interface for the World Bank climate data
R
62
star
93

terrainr

Get DEMs and orthoimagery from the USGS National Map, georeference your images and merge rasters, and visualize with Unity 3D
R
62
star
94

slopes

Package to calculate slopes of roads, rivers and trajectories
R
61
star
95

tiler

Generate geographic and non-geographic map tiles from R
R
61
star
96

rb3

A bunch of downloaders and parsers for data delivered from B3
R
60
star
97

codemetar

an R package for generating and working with codemeta
R
59
star
98

parzer

Parse geographic coordinates
R
59
star
99

aRxiv

Programmatic interface to the Arxiv API
R
58
star
100

eph

Herramientas para procesamiento de la base usuaria de la EPH
R
55
star