• Stars
    star
    288
  • Rank 139,137 (Top 3 %)
  • Language
    TypeScript
  • License
    MIT License
  • Created 11 months ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Save 30-50%+ of CI time without any effort or cost. Use Magic Nix Cache, a totally free and zero-configuration binary cache for Nix on GitHub Actions.

Magic Nix Cache

Save 30-50%+ of CI time without any effort or cost. Use Magic Nix Cache, a totally free and zero-configuration binary cache for Nix on GitHub Actions.

Add our GitHub Action after installing Nix, in your workflow, like this:

- uses: DeterminateSystems/magic-nix-cache-action@main

See Usage for a detailed example.

Why use the Magic Nix Cache?

Magic Nix Cache uses the GitHub Actions built-in cache to share builds between Workflow runs, and has many advantages over alternatives.

  1. Totally free: backed by GitHub Actions' cache, there is no additional service to pay for.
  2. Zero configuration: add our action to your workflow. That's it. Everything built in your workflow will be cached.
  3. No secrets: Forks and pull requests benefit from the cache, too.
  4. Secure: Magic Nix Cache follows the same semantics as the GitHub Actions cache, and malicious pull requests cannot pollute your project.
  5. Private: The cache is stored in the GitHub Actions cache, not with an additional third party.

Note: the Magic Nix Cache doesn't offer a publicly available cache. This means the cache is only usable in CI. Zero to Nix has an article on binary caching if you want to share Nix builds with users outside of CI.

Usage

Add it to your Linux and macOS GitHub Actions workflows, like this:

name: CI

on:
  push:
  pull_request:

jobs:
  check:
    runs-on: ubuntu-22.04
    steps:
      - uses: actions/checkout@v3
      - uses: DeterminateSystems/nix-installer-action@main
      - uses: DeterminateSystems/magic-nix-cache-action@main
      - run: nix flake check

That's it. Everything built in your workflow will be cached.

Usage Notes

The GitHub Actions Cache has a rate limit on reads and writes. Occasionally, large projects or large rebuilds may exceed those rate-limits, and you'll see evidence of that in your logs. The error looks like this:

error: unable to download 'http://127.0.0.1:37515/<...>': HTTP error 418
       response body:
       GitHub API error: API error (429 Too Many Requests): StructuredApiError { message: "Request was blocked due to exceeding usage of resource 'Count' in namespace ''." }

The caching daemon and Nix both handle this gracefully, and won't cause your CI to fail. When the rate limit is exceeded while pulling dependencies, your workflow may perform more builds than usual. When the rate limit is exceeded while uploading to the cache, the remainder of those store paths will be uploaded on the next run of the workflow.

Concepts

Upstream cache

When you configure an upstream cache for the Magic Nix Cache, any store paths fetched from that source are not cached because they are known to be fetchable on future workflow runs. The default is https://cache.nixos.org but you can set a different upstream:

- uses: DeterminateSystems/magic-nix-cache-action@main
  with:
    upstream-cache: https://my-binary-cache.com

Action Options

Parameter Description Required Default
diagnostic-endpoint Diagnostic endpoint url where diagnostics and performance data is sent. To disable set this to an empty string. https://install.determinate.systems/magic-nix-cache/perf
listen The host and port to listen on. 127.0.0.1:37515
source-binary Run a version of the cache binary from somewhere already on disk. Conflicts with all other source-* options.
source-branch The branch of magic-nix-cache to use. Conflicts with all other source-* options.
source-pr The PR of magic-nix-cache to use. Conflicts with all other source-* options.
source-revision The revision of nix-magic-nix-cache to use. Conflicts with all other source-* options.
source-tag The tag of magic-nix-cache to use. Conflicts with all other source-* options.
source-url A URL pointing to a magic-nix-cache binary. Overrides all other source-* options.
upstream-cache Your preferred upstream cache. Store paths fetched from this store will not be cached in the GitHub Actions Cache. https://cache.nixos.org

More Repositories

1

nix-installer

Install Nix and flakes with the fast and reliable Determinate Nix Installer, with over 2 million installs.
Rust
1,389
star
2

zero-to-nix

Zero to Nix is your guide to learning Nix and flakes. Created by Determinate Systems.
MDX
781
star
3

riff

Riff automatically provides external dependencies for Rust projects, with support for other languages coming soon.
Rust
486
star
4

update-flake-lock

Automatically refresh your Nix Flakes.
Nix
199
star
5

nix-netboot-serve

Make any NixOS system netbootable with 10s cycle times.
Rust
187
star
6

magic-nix-cache

Save 30-50%+ of CI time without any effort or cost. Use Magic Nix Cache, a totally free and zero-configuration binary cache for Nix on GitHub Actions.
Rust
170
star
7

nuenv

A Nushell environment for Nix
Nushell
166
star
8

flake-checker

Health checks for your Nix flakes
Rust
120
star
9

nix-installer-action

The Github Action for the Determinate Nix Installer
TypeScript
114
star
10

bootspec-secureboot

Rust
92
star
11

fh

The official CLI for FlakeHub: search for flakes, and add new inputs to your Nix flake.
Rust
81
star
12

macos-ephemeral

Scripts and instructions for making ephemeral macOS machines with Mosyle MDM support.
Shell
73
star
13

nix-to-kubernetes

An example of deploying Nix-built Docker images to Kubernetes.Not act
Nix
63
star
14

flake-schemas

Schemas for common flake output types
Nix
56
star
15

terraform-provider-hydra

Declaratively configure your Hydra server with Terraform.
Go
41
star
16

nix-github-actions

An example project showing how to use Nix to replace third-party GitHub Actions
Nix
38
star
17

nixos-vault-service

Nix
36
star
18

flake-checker-action

A GitHub Action that performs health checks for your Nix flake.lock files
Nix
35
star
19

nix-policy

Experiments with Nix and Open Policy Agent
Nix
26
star
20

bonk

Erase macOS machines over Tailscale.
Go
25
star
21

bootspec

Implementation of RFC-0125's datatype and synthesis tooling.
Rust
21
star
22

flakehub-push

Release your Nix flake to FlakeHub.com.
Rust
20
star
23

nix-copy-deploy

An example project for the nix copy utility
Shell
12
star
24

zpool-auto-expand-partitions

Rust
12
star
25

hydra-github-jobsets-generator

Generate declarative jobsets for a project's GitHub repository.
Rust
11
star
26

nixos-example-openstack

An example of building and pushing images for Openstack.
Nix
11
star
27

dhcpv6macd

A DHCPv6 service which assigns IPv6 addresses strictly on MAC address only. Potentially violates RFCs and specs.
Nix
10
star
28

cpiotools

Tools for examining CPIOs.
Rust
8
star
29

hydra-examples

Example files for Hydra.
Nix
8
star
30

nix-cpio-generator

Rust
8
star
31

prometheus-weather-gov

An example Nix project using Python, with a NixOS Module, NixOS test, and Docker image.
Python
7
star
32

nix-wasm-example

Nix
7
star
33

hydra-nixos-org-configuration

A mirror of the project and jobset configurations on hydra.nixos.org.
HCL
6
star
34

nix-config-parser

Rust
6
star
35

asset-tagger

Print asset tags.
Shell
4
star
36

search-detsys-dev

Python
4
star
37

coldsnap.nix

Nix
3
star
38

flakehub-mirror

3
star
39

templates

Ready-made flake templates to get started with Nix
Nix
3
star
40

export

Export arbitrary bytes from Rust to various shells and interpreters.
Rust
3
star
41

hydra-runcommand-logs

Experiments logging to the journal from RunCommand.
Nix
3
star
42

elixir-nix

Nix
2
star
43

hydra-scale-equinix-metal

Scale Equinix Metal builders based on Hydra usage.
Rust
2
star
44

scanoss-nix

Packages for the ScanOSS tool set.
Nix
2
star
45

marp-nix

Nix
2
star
46

install-riff-action

A GitHub Action for installing Riff
Shell
1
star
47

homebrew-riff

A Homebrew formula for Riff
Ruby
1
star
48

karonte-nix

Python
1
star
49

github-actions-oidc-claims

Rust
1
star
50

linear-import-nix

Nix
1
star
51

nix-installer-example

Nix
1
star
52

pickup.nix

Nix
1
star
53

hydra-github-jobsets-example-project

1
star
54

hydra-test-migrate-to-s3

Test migrating a Hydra instance from a local cache to an S3-backed cache.
Nix
1
star
55

buildkite-install-nix-macos

A Buildkite workflow to install Nix on macOS
Shell
1
star
56

update-flake-lock-test-template

A template repository for testing changes to https://github.com/DeterminateSystems/update-flake-lock/
Nix
1
star
57

fh-init-example-project

Python
1
star
58

nix-upgrade

Tracks the fallback paths for Nix, to allow upgrades on our schedule.
Nix
1
star
59

.github

Determinate Systems
1
star
60

ipxe-boot-lab

Local lab for testing iPXE boot in user network namespaces.
Rust
1
star
61

mlnx-workspace

Nix
1
star