• Stars
    star
    295
  • Rank 140,902 (Top 3 %)
  • Language
    Fortran
  • License
    Other
  • Created about 6 years ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Collection of builder repositories for BinaryBuilder.jl

Yggdrasil

Build Status: Build status

Yggdrasil

This repository contains recipes for building binaries for Julia packages using BinaryBuilder.jl.

Contributing

To contribute a new recipe, you can either

  • use BinaryBuilder.run_wizard(), which will automatically open a pull request to this repository after a successfull build for all requested platforms
  • Copy another build recipe using it as a template, and then open a manual pull request to this repository

Yggdrasil builds the tarballs using master version of BinaryBuilder.jl, which requires Julia 1.3.0 or later versions. Note that this BinaryBuilder.jl version has some differences compared to v0.1.4 and the builders generated are slightly different. You are welcome to contribute builders written for BinaryBuilder.jl v0.1.4, but they will likely need minor adjustements.

Buildkite CI is used to test that the builders can successfully produce the tarballs.

If you prefer to test your manual buildscript before opening the pull request, we suggest installing BinaryBuilder.jl on Julia 1.3 or any following release and running julia --color=yes build_tarballs.jl --verbose --debug locally. On MacOS, you will need to have docker installed for this to work.

Updating the version of an existing builder

To trigger the build of a new version of the upstream package simply open a pull request to update the builder as necessary. This usually boils down to only updating the version number and the source (e.g., URL and hash for an archive, or the revision for a git repository), but in some cases more changes may be needed.

Using the generated tarballs

JLL packages

The last versions of BinaryBuilder make use of the Artifacts system shipping in Julia 1.3. This means that BinaryBuilder no longer generates build.jl files that are placed into your Julia package's deps/ folder, but instead generates whole Julia packages (known colloquially as "jll" packages) that are placed within the JuliaBinaryWrappers organization. Merged pull requests to Yggdrasil result in new versions of these wrapper packages being generated, uploaded and registered, allowing your client Julia code to simply invoke using LibFoo_jll to get ahold of your binaries with no need for a Pkg.build() step. (This will, of course, only be the case for Julia 1.3+).

We encourage Julia developers to use JLL packages for their libraries. Read the documention of BinaryBuilder to learn how to use them.

Here are a few examples of pull requests of Julia packages switching to using JLL package to provide the prebuilt binaries to the users:

You can read more about the Artifacts system and how it is important for reproducibility in this post on Julia's blog "Pkg + BinaryBuilder -- The Next Generation".

BinaryProvider.jl

We hope we convinced you about why it is important to switch to JLL packages. However, if you really need to support Julia v1.2 or previous versions, you should keep using BinaryProvider.jl. As explained in the previous section, a build.jl file is not generated after the build anymore as that is not used for JLL packages, instead you would need to generate it yourself: In the top-directory of Yggdrasil there is a script to do this: generate_buildjl.jl. It takes three positional arguments:

  • the path to the build_tarballs.jl script
  • the owner/name of the repository where the tarballs have been uploaded. If omitted, this defaults to JuliaBinaryWrappers/BuilderName_jll.jl
  • the tag name where the tarballs have been uploaded. If omitted, this defaults to the latest version of the JLL package in the General registry. If there are no versions of the package in the registry, the script will fail.

For example, to get the build.jl file for the latest version of Zlib you can run the following command:

julia --color=yes generate_buildjl.jl Z/Zlib/build_tarballs.jl

If instead you want to get the build_tarballs.jl file for the tag named Zlib-v1.2.11+6 you have to run the command

julia --color=yes generate_buildjl.jl Z/Zlib/build_tarballs.jl JuliaBinaryWrappers/Zlib_jll.jl Zlib-v1.2.11+6

Note: you have to manually add prefix as the first argument to all Product constructors in the generated build.jl files. This is necessary because the syntax between BinaryBuilder v0.2+ and BinaryProvider has diverged.

Remember that you will also need the build.jl files for all direct and indirect dependencies.

Here are a few examples of packages using this system to install their libraries:

  • FFMPEG.jl;
  • MySQL.jl uses JLL packages for Julia v1.3+ and build.jl scripts with BinaryProvider.jl for previous releases.

More Repositories

1

BinaryBuilder.jl

Binary Dependency Builder for Julia
Julia
387
star
2

Requires.jl

Lazy code loading for Julia
Julia
195
star
3

Preferences.jl

Project Preferences Package
Julia
129
star
4

ArtifactUtils.jl

A tool for package developers for working with artifacts.
Julia
61
star
5

Scratch.jl

Scratch spaces for all your persistent mutable data needs
Julia
58
star
6

BinDeps.jl

Tool for building binary dependencies for Julia modules
Julia
56
star
7

BinaryProvider.jl

A reliable binary provider for Julia
Julia
43
star
8

PkgServer.jl

Julia
42
star
9

RelocatableFolders.jl

Julia
39
star
10

Homebrew.jl

OSX Binary dependency provider for Julia
Julia
27
star
11

JLLPrefixes.jl

Make yourself at home; JLLs are here to stay
Julia
22
star
12

WinRPM.jl

RPM-md processing library
Julia
21
star
13

BinaryBuilder2.jl

BinaryBuilder2 monorepo
Julia
14
star
14

CMake.jl

Julia package to provide access to CMake
Julia
13
star
15

OutputCollectors.jl

Capture subprocess stdout and stderr streams independently, resynthesizing and colorizing the streams appropriately
Julia
13
star
16

PkgServerLogAnalysis.jl

Log analysis prototyping
Julia
12
star
17

BinaryBuilderBase.jl

Julia
11
star
18

CMakeWrapper.jl

Build CMake packages from Julia
Julia
11
star
19

JLLWrappers.jl

Julia
8
star
20

MetadataTools.jl

Functionality to analyze the structure of Julia's METADATA repository
Julia
5
star
21

SimpleBufferStream.jl

What Base.BufferStream should be
Julia
4
star
22

cloneallpackages

Script to clone all registered Julia packages (useful to search for code usage)
Julia
4
star
23

JLLTools.jl

Tools for creating JLL wrappers
Julia
3
star
24

CondaBinDeps.jl

Conda BinDeps provider for Julia
Julia
3
star
25

Archspec.jl

Julia
3
star
26

PkgLicenses.jl

Provides LICENSE texts for common software licenses
Julia
2
star
27

binarybuilder.org

A website for BinaryBuilder.jl
CSS
2
star
28

Nix.jl

Nix package manager for Julia
Julia
1
star
29

PkgServerS3Mirror

PkgServer with an S3Mirror attached
Makefile
1
star
30

Jotunheimr

Testing, miniaturized buildtree 🌴
Shell
1
star
31

Spack.jl

1
star