• Stars
    star
    91
  • Rank 353,698 (Top 8 %)
  • Language
    Nix
  • License
    MIT License
  • Created about 5 years ago
  • Updated 5 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Support for building npm packages in Nix and lightweight npm registry [maintainer @jtojnar]

Napalm

This project is looking for a new maintainer, see

When faced with a JavaScript codebase, napalm is just what you need.

-- anonymous

Table of contents

Building npm packages in Nix with Napalm

Basic Napalm usage

Use the buildPackage function provided in the default.nix for building npm packages (replace <napalm> with the path to napalm; with niv: niv add nmattia/napalm):

let
    napalm = pkgs.callPackage <napalm> {};
in napalm.buildPackage ./. {}

All executables provided by the npm package will be available in the derivation's bin directory.

NOTE: napalm uses the package's package-lock.json (or npm-shrinkwrap.json) for building a package database. Make sure there is either a package-lock.json or npm-shrinkwrap.json in the source. Alternatively provide the path to the package-lock file:

let
    napalm = pkgs.callPackage <napalm> {};
in napalm.buildPackage ./. { packageLock = <path/to/package-lock>; }

Napalm with Nix flakes

If you want to use Napalm in your flake project, you can do that by adding it to your inputs and either passing napalm.overlays.default to your Nixpkgs instance, or by using the napalm.legacyPackages buildPackage output. To configure the latter's environment, be sure to look at the complicated scenarios and potentially set the nixpkgs input of napalm with follows.

Example flake.nix

{
  inputs.nixpkgs.url = "github:NixOS/nixpkgs/nixpkgs-unstable";
  inputs.napalm.url = "github:nix-community/napalm";

  # NOTE: This is optional, but is how to configure napalm's env
  inputs.napalm.inputs.nixpkgs.follows = "nixpkgs";

  outputs = { self, nixpkgs, napalm }: 
  let
    system = "x86_64-linux";
    pkgs = nixpkgs.legacyPackages."${system}";
  in {
    # Assuming the flake is in the same directory as package-lock.json
    packages."${system}".package-name = napalm.legacyPackages."${system}".buildPackage ./. { };

    devShells."${system}".shell-name = pkgs.mkShell {
      nativeBuildInputs = with pkgs; [ nodejs ];
    };
  };
}

Flake Template

There is also a template that can help you use napalm in your project. You can use it in a new, empty directory by running:

nix flake init -t "github:nix-community/napalm"

Handling complicated scenarios with Napalm

Examples below assume that you have imported napalm in some way.

Custom node.js version

Napalm makes it quite simple to use custom node.js (with npm) version. This is controlled via nodejs argument.

Example 1

Changing node.js version to the one that is supplied in nixpkgs:

{ napalm, nodejs-16_x, ... }:
napalm.buildPackage ./. {
	nodejs = nodejs-16_x;
}

Example 2

Changing node.js version to some custom version (just an idea):

{ napalm, nodejs-12_x, ... }:
let
	nodejs = nodejs-12_x.overrideAttrs (old: rec {
		pname = "nodejs";
		version = "12.19.0";
		sha256 = "1qainpkakkl3xip9xz2wbs74g95gvc6125cc05z6vyckqi2iqrrv";
		name = "${pname}-${version}";

		src = builtins.fetchurl {
			url =
			"https://nodejs.org/dist/v${version}/node-v${version}.tar.xz";
			inherit sha256;
		};
	});
in
napalm.buildPackage ./. {
	inherit nodejs;
}

Pre/Post Npm hooks

Napalm allows to specify commands that are run before and after every npm call. These hooks work also for nested npm calls thanks to npm override mechanism.

Example

Patching some folder with executable scripts containing shebangs (that may be generated by npm script):

{ napalm, ... }:
napalm.buildPackage ./. {
	postNpmHook = ''
	patchShebangs tools
	'';
}

Multiple package locks

Napalms allows to specify multiple package locks. This may be useful for some project which consist of some smaller projects.

Example

{ napalm, ... }:
napalm.buildPackage ./. {
	# package-lock.json that is in the root of the project
	# is not required to be specified in `additionalpackagelocks`
	# If you want to specify it, you can use `packageLock` argument.
	additionalPackageLocks = [
	./frontend/package-lock.json
	./tests/package-lock.json
	];
}

Patching npm packages (before fetching them with npm)

This is very useful for errors like: Invalid interpreter

Napalm has an ability to patch fetched npm packages before serving them to the npm. By default patching fixes shebangs and binaries that are localized and the tarballs. Napalm also updates package-lock.json with new integrity hashes.

Example

To enable patching, just use:

{ napalm, ... }:
napalm.buildPackage ./. {
	patchPackages = true;
}

This will force repacking of all dependencies, though, so you might want to patch only specific dependencies by passing an empty attribute set to the next method.

Customizing patching mechanism of npm packages

Sometimes it is required to manually patch some package. Napalm allows that via customPatchPackages attribute. This attribute is a set of that overrides for packages that will be patched.

Example

{ napalm, ... }:
napalm.buildPackage ./. {
	# Arguments that are passed to the overrider:
	# `pkgs` - Nixpkgs used by Napalm
	# `prev` - Current set that will be passed to mkDerivation
	customPatchPackages = {
		"react-native" = {
			"0.65.0" = pkgs: prev: {
				EXAMPLE_ENV_VAR = "XYZ";
				dontBuild = false;
				buildPhase = ''
				# You can copy some stuff here or run some custom stuff
				'';
			};
		};

		# Version is not required. When it is not specified it
		# applies override to all packages with that name.
		"node-gyp-builder" = pkgs: prev: { };
	};
}

How does Napalm work ?

These are general steps that Napalm makes when building packages (if you want to learn more, see source code of default.nix):

  1. Napalm loads all package-lock.json files and parses them. Then it fetches all specified packages into the Nix Store.
  2. (optional) Napalm patches npm packages and stores their output in new location. Then uses this location as default package location in Nix Store.
  3. Napalm creates snapshot that consists of packages names, version and paths to locations in Nix Store that contain them.
  4. (optional) Napalm patches package-lock.json integrity if the packages were patched, so that they will work with npm install.
  5. Napalm sets up napalm-registry which as a main argument accepts snapshot of npm packages and them serves them as if it was npm registry server.
  6. Napalm sets up npm so that it thinks napalm-registry server is default npm registry server.
  7. Napalm overrides npm which allows using custom npm hooks (every time it is called) as well as some other default patching activities.
  8. Napalm calls all the npm commands.
  9. Napalm installs everything automatically or based on what was specified in installPhase.

Napalm - a lightweight npm registry

Under the hood napalm uses its own package registry. The registry is available in default.nix as napalm-registry.

Usage: napalm-registry [-v|--verbose] [--endpoint ARG] [--port ARG] --snapshot ARG

Available options:
  -v,--verbose             Print information about requests
  --endpoint ARG           The endpoint of this server, used in the Tarball URL
  --port ARG               The to serve on, also used in the Tarball URL
  --snapshot ARG           Path to the snapshot file. The snapshot is a JSON
                           file. The top-level keys are the package names. The
                           top-level values are objects mapping from version to
                           the path of the package tarball. Example: { "lodash":
                           { "1.0.0": "/path/to/lodash-1.0.0.tgz" } }
  -h,--help                Show this help text

Similar projects

More Repositories

1

home-manager

Manage a user environment using Nix [maintainer=@rycee]
Nix
5,937
star
2

awesome-nix

😎 A curated list of the best resources in the Nix community [maintainer=@cyntheticfox]
2,546
star
3

nixos-generators

Collection of image builders [maintainer=@Lassulus]
Nix
1,338
star
4

NixOS-WSL

NixOS on WSL(2) [maintainer=@nzbr]
Nix
1,236
star
5

disko

Declarative disk partitioning and formatting using nix [maintainer=@Lassulus]
Nix
1,232
star
6

nix-direnv

A fast, persistent use_nix/use_flake implementation for direnv [maintainer=@Mic92 / @bbenne10]
Nix
1,170
star
7

nixvim

Configure Neovim with Nix! [maintainer=@pta2002, @traxys, @GaetanLepage]
Nix
1,060
star
8

nix-on-droid

Nix-enabled environment for your Android device. [maintainers=@t184256,@Gerschtli]
Nix
1,038
star
9

nixos-anywhere

install nixos everywhere via ssh [maintainer=@numtide]
Shell
1,029
star
10

NUR

Nix User Repository: User contributed nix packages [maintainer=@Mic92]
Python
882
star
11

impermanence

Modules to help you handle persistent state on systems with ephemeral root storage [maintainer=@talyz]
Nix
882
star
12

dream2nix

Simplified nix packaging for various programming language ecosystems [maintainer=@DavHau]
Nix
839
star
13

comma

Comma runs software without installing it. [maintainers=@Artturin,@burke,@DavHau]
Rust
831
star
14

rnix-lsp

WIP Language Server for Nix! [maintainer=@aaronjanse]
Rust
701
star
15

poetry2nix

Convert poetry projects to nix automagically [maintainer=@adisbladis]
Nix
693
star
16

nix-init

Generate Nix packages from URLs with hash prefetching, dependency inference, license detection, and more [maintainer=@figsoda]
Rust
692
star
17

nix-index

Quickly locate nix packages with specific files [maintainers=@bennofs @figsoda @raitobezarius]
Rust
681
star
18

naersk

Build Rust projects in Nix - no configuration, no code generation, no IFD, sandbox friendly.
Nix
641
star
19

nixd

Nix language server, based on nix libraries [maintainer=@inclyc]
C++
619
star
20

lanzaboote

Secure Boot for NixOS [maintainers=@blitz @raitobezarius @nikstur]
Rust
584
star
21

lorri

Your project’s nix-env [maintainer=@Profpatsch,@nyarly]
Rust
576
star
22

nixGL

A wrapper tool for nix OpenGL application [maintainer=@guibou]
Nix
564
star
23

robotnix

Build Android (AOSP) using Nix [maintainer=@danielfullmer,@Atemu]
Nix
558
star
24

fenix

Rust toolchains and rust-analyzer nightly for Nix [maintainer=@figsoda]
Nix
547
star
25

nixpkgs-fmt

Nix code formatter for nixpkgs [maintainer=@zimbatm]
Rust
503
star
26

nixpkgs-wayland

Automated, pre-built packages for Wayland (sway/wlroots) tools for NixOS. [maintainers=@colemickens, @Artturin]
Nix
467
star
27

emacs-overlay

Bleeding edge emacs overlay [maintainer=@adisbladis]
Nix
451
star
28

vulnix

Vulnerability (CVE) scanner for Nix/NixOS.
Python
378
star
29

nurl

Generate Nix fetcher calls from repository URLs [maintainer=@figsoda]
Rust
360
star
30

rnix-parser

A Nix parser written in Rust [maintainer=@oberblastmeister]
Nix
328
star
31

nixos-vscode-server

Visual Studio Code Server support in NixOS
Nix
316
star
32

crate2nix

rebuild only changed crates in CI with crate2nix and nix
Nix
311
star
33

terraform-nixos

A set of Terraform modules that are designed to deploy NixOS [maintainer=@adrian-gierakowski]
HCL
304
star
34

srvos

NixOS profiles for servers [maintainer=@numtide]
Nix
297
star
35

nixbox

NixOS Vagrant boxes [maintainer=@zimbatm]
HCL
276
star
36

neovim-nightly-overlay

[maintainer=@Kranzes]
Nix
267
star
37

vscode-nix-ide

Nix language support for VSCode editor [maintainer: @jnoortheen]
TypeScript
248
star
38

nix-user-chroot

Install & Run nix without root permissions [maintainer=@Mic92]
Rust
243
star
39

haumea

Filesystem-based module system for Nix [maintainer=@figsoda]
Nix
235
star
40

trustix

Trustix: Distributed trust and reproducibility tracking for binary caches [maintainer=@adisbladis]
Go
234
star
41

NixNG

A linux distribution based on Nix [maintainer=@MagicRB]
Nix
210
star
42

nix-zsh-completions

ZSH Completions for Nix
Shell
208
star
43

nix-index-database

Weekly updated nix-index database [maintainer=@Mic92]
Nix
205
star
44

noogle

https://noogle.dev - nix function exploring. [maintainer=@hsjobeki]
Nix
194
star
45

nix-melt

A ranger-like flake.lock viewer [maintainer=@figsoda]
Rust
190
star
46

pypi2nix

Abandoned! Generate Nix expressions for Python packages
Python
189
star
47

gomod2nix

Convert applications using Go modules to Nix expressions [maintainer=@adisbladis]
Nix
186
star
48

todomvc-nix

Example on how to nixify a project [maintainer=@Rizary]
Nix
160
star
49

nix-environments

Repository to maintain out-of-tree shell.nix files (maintainer=@mic92)
Nix
156
star
50

pip2nix

Freeze pip-installable packages into Nix expressions [maintainer=@datakurre]
Python
152
star
51

docker-nixpkgs

docker images from nixpkgs [maintainer=@zimbatm]
Nix
137
star
52

linuxkit-nix

An easy to use Linux builder for macOS [maintainer=@nicknovitski]
Nix
133
star
53

nix-vscode-extensions

Nix expressions for VSCode and OpenVSX extensions [maintainers: @deemp, @AmeerTaweel]
Haskell
132
star
54

tree-sitter-nix

Nix grammar for tree-sitter [maintainer=@cstrahan]
JavaScript
129
star
55

npmlock2nix

nixify npm based packages [maintainer=@andir]
Nix
125
star
56

yarn2nix

Generate nix expressions from a yarn.lock file [maintainer=???]
Nix
123
star
57

nixos-install-scripts

collection of one-shot scripts to install NixOS on various server hosters and other hardware. [maintainer=@happysalada]
Shell
122
star
58

nix-eval-jobs

Parallel nix evaluator with a streamable json output [maintainers @Mic92, @adisbladis]
C++
119
star
59

flakelight

Framework for simplifying flake setup [maintainer=@accelbread]
Nix
114
star
60

nixdoc

Tool to generate documentation for Nix library functions [maintainer=@infinisil]
Nix
113
star
61

nixago

Generate configuration files using Nix [maintainer=@jmgilman]
Nix
112
star
62

nix-unstable-installer

A place to host Nix unstable releases [maintainer=@lilyinstarlight]
Ruby
105
star
63

wiki

Nixos wiki [maintainer=@samueldr]
104
star
64

go-nix

Elements of Nix re-implemented as Go libraries [maintainer=@flokli]
Go
102
star
65

nixpkgs-lint

A fast semantic linter for Nix using tree-sitter 🌳 + ❄️. [maintainers=@Artturin,@siraben]
Rust
101
star
66

namaka

Snapshot testing for Nix based on haumea [maintainer=@figsoda]
Rust
96
star
67

dns.nix

A Nix DSL for DNS zone files
Nix
93
star
68

nur-combined

A repository of NUR that combines all repositories [maintainer=@Mic92]
Nix
92
star
69

nixos-images

Automatically build (netboot) images for NixOS [maintainer=@Mic92]
Nix
90
star
70

vgo2nix

Convert go.mod files to nixpkgs buildGoPackage compatible deps.nix files [maintainer=@adisbladis]
Nix
89
star
71

nixt

Simple unit-testing for Nix [maintainer=@Lord-Valen]
TypeScript
87
star
72

nur-packages-template

A template for NUR repositories: [maintainer=@fgaz]
Nix
84
star
73

pnpm2nix

Load pnpm lock files into nix :) [maintainer=@adisbladis]
Nix
82
star
74

mineflake

Declarative Minecraft server in NixOS [unmaintained]
Rust
75
star
75

infra

nix-community infrastructure [maintainer=@Mic92]
Nix
74
star
76

kde2nix

Provisional, experimental Plasma 6 (and friends) pre-release packaging [maintainer=@K900]
Nix
69
star
77

nix-data-science

Standard set of packages and overlays for data-scientists [maintainer=@tbenst]
Nix
68
star
78

pyproject.nix

A collection of Nix utilities to work with Python projects [maintainer=@adisbladis]
Nix
65
star
79

ethereum.nix

Nix packages and NixOS modules for the Ethereum ecosystem. [maintainers=@aldoborrero,@brianmcgee,@selfuryon]
Nix
65
star
80

setup.nix

Nixpkgs based build tools for declarative Python packages [maintainer=@datakurre]
Nix
64
star
81

nixpkgs.lib

nixpkgs lib for cheap instantiation [maintainer=@github-action] (with initial help from @blaggacao)
Nix
63
star
82

nix-installers

Nix installers for legacy distributions (rpm & deb & pacman) [maintainer=@adisbladis]
Nix
62
star
83

hydra-check

check hydra for the build status of a package [maintainer=@makefu,@Artturin]
Python
60
star
84

zon2nix

Convert the dependencies in `build.zig.zon` to a Nix expression [maintainer=@figsoda]
Zig
58
star
85

redoxpkgs

Cross-compile to Redox using Nix [maintainer=@aaronjanse]
Nix
51
star
86

nix-github-actions

A library to turn Nix Flake attribute sets into Github Actions matrices [maintainer=@adisbladis]
Nix
49
star
87

nix-ld-rs

Run unpatched dynamic binaries on NixOS [maintainer=@zhaofengli @Mic92]
Rust
47
star
88

patsh

A command-line tool for patching shell scripts inspired by resholve [maintainer=@figsoda]
Rust
46
star
89

mavenix

Deterministic Maven builds using Nix [maintainer=@icetan]
Nix
45
star
90

nixpkgs-pytools

Tools for removing the tedious nature of creating nixpkgs derivations [maintainer=@costrouc]
Python
42
star
91

nix-unit

Unit testing for Nix code [maintainer=@adisbladis]
C++
41
star
92

docker-nix

Docker image for nix [maintainer=@zimbatm] [status=deprecated]
Dockerfile
38
star
93

nix-ts-mode

An Emacs major mode for editing Nix expressions, powered by tree-sitter.
Emacs Lisp
37
star
94

builtwithnix.org

Share the love of Nix [maintainer=@zimbatm]
HTML
37
star
95

nixpkgs-terraform-providers-bin

auto-updating terraform providers for nix [maintainer=@zimbatm]
Nix
35
star
96

nixops-libvirtd

NixOps libvirtd backend plugin [maintainer=@AmineChikhaoui]
Python
34
star
97

flake-nimble

Nimble packages Nix flake [maintainer=?]
Nix
33
star
98

authentik-nix

Nix flake with package, NixOS module and basic VM test for authentik. Trying to provide an alternative deployment mode to the officially supported docker-compose approach. Not affiliated with or officially supported by the authentik project [maintainer=@willibutz]
Nix
31
star
99

flake-firefox-nightly

this provides an auto-updating flake for firefox-nightly-bin from nixpkgs-mozilla [maintainer=@colemickens, @Artturin]
Nix
27
star
100

dreampkgs

A collection of software packages managed with dream2nix [maintainer=@DavHau]
Nix
26
star