• Stars
    star
    178
  • Rank 213,332 (Top 5 %)
  • Language
    Zig
  • License
    MIT License
  • Created almost 2 years ago
  • Updated 6 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Access the JS host environment from Zig compiled to WebAssembly.

zig-js

zig-js is a Zig library (and accompanying JS glue) that enables Zig running in a WebAssembly environment to interact with a JavaScript-based host.

Note this makes it particularly easy for Zig to call into JS. This doesn't help for JS calling into Zig. This is more akin to Go's syscall/js package and not like Rust's wasm-bindgen.

Note: the main branch of this repository attempts to remain compatible with the latest nightly release of Zig, and therefore may not be compatible with official Zig releases.

Example

// Get and set objects and properties
const document = try js.global.get(js.Object, "document");
defer document.deinit();

const title = try document.getAlloc(js.String, alloc, "title");
defer alloc.free(title);
std.log.info("the title is: {s}", .{str});

try document.set("title", js.string("A new title."));

// Call functions
js.global.call(void, "alert", .{js.string("Hello from Zig!")});

The code is a bit verbose with the error handling but since JS is a dynamic language there are potential invalid types at every step of the way. Additionally, deinit calls are necessary to dereference garbage-collected values on the host side.

Under the covers, this is hiding a lot of complexity since the JS/WASM ABI only allows passing numeric types and sharing memory.

Usage

To use this library, you must integrate a component in both the Zig and JS environment. For Zig, vendor this repository and add the package. For example in your build.zig:

const js = @import("zig-js");

pub fn build(b: *std.build.Builder) !void {
  // ... other stuff

  exe.addPackage(js.pkg);
}

From JS, install and import the package in the js/ directory (in the future this will be published to npm). A TypeScript example is shown below but JS could just as easily be used:

import { ZigJS } from 'zig-js-glue';

// Initialize the stateful zigjs class. You should use one per wasm instance.
const zigjs = new ZigJS();

fetch('my-wasm-file.wasm').then(response =>
  response.arrayBuffer()
).then(bytes =>
  // When creating your Wasm instance, pass along the zigjs import
  // object. You can merge this import object with your own since zigjs
  // uses its own namespace.
  WebAssembly.instantiate(bytes, zigjs.importObject())
).then(results => {
  const { memory, my_func } = results.instance.exports;

  // Set the memory since zigjs interfaces with memory.
  zigjs.memory = memory;

  // Run any of your exported functions!
  my_func();
});

WARNING: The zig-js version used in your Zig code and JS code must match. I'm not promising any protocol stability right now so pin your versions appropriately. To determine what version is compatible, look up the tagged version in this repository and the corresponding commits.

Internals

The fundamental idea in this is based on the Go syscall/js package. The implementation is relatively diverged since Zig doesn't have a runtime or garbage collection, but the fundamental idea of sharing "refs" and the format of those refs is based on Go's implementation.

The main idea is that Zig communicates to JS what values it would like to request, such as the "global" object. JS generates a "ref" for this object (a unique 64-bit numeric value) and sends that to Zig. This ref now uniquely identifies the value for future calls such as "give me the 'document' property on this ref."

The ref itself is a 64-bit value. For numeric types, the ref is the value. We take advantage of the fact that all numbers in JavaScript are IEEE 754 encoded 64-bit floats and use NaN as a way to send non-numeric values to Zig (NaN-boxing).

NaN in IEEE 754 encoding is 0111_1111_1111_<anything but all 0s> in binary. We use a common NaN value of 0111_1111_1111_1000_0000... so that we can use the bottom (least-significant) 49 bits to store type information and a 32-bit ID.

The 32-bit ID is just an index into an array on the JS side. A simple scheme is used to reuse IDs after they're dereferenced.

Performance

Usage of this package causes the WASM/JS boundary to be crossed a LOT and this is generally not very fast and not an optimal way to use wasm. The optimal way to use WASM is more like a GPU: have the host (or wasm module) preload a bunch of work into a byte buffer and send it over in one single call. However, this approach is pretty painful. This packge makes interfacing with JS very, very easy. Consider the tradeoffs and choose what is best for you.

More Repositories

1

mapstructure

Go library for decoding generic map values into native Go structures and vice versa.
Go
7,685
star
2

gox

A dead simple, no frills Go cross compile tool
Go
4,594
star
3

vagrant-aws

Use Vagrant to manage your EC2 and VPC instances.
Ruby
2,609
star
4

nixos-config

My NixOS configurations.
Nix
1,791
star
5

cli

A Go library for implementing command-line interfaces.
Go
1,724
star
6

libxev

libxev is a cross-platform, high-performance event loop that provides abstractions for non-blocking IO, timers, events, and more and works on Linux (io_uring or epoll), macOS (kqueue), and Wasm + WASI. Available as both a Zig and C API.
Zig
1,589
star
7

gon

Sign, notarize, and package macOS CLI tools and applications written in any language. Available as both a CLI and a Go library.
Go
1,461
star
8

go-ps

Find, list, and inspect processes from Go (golang).
Go
1,449
star
9

go-homedir

Go library for detecting and expanding the user's home directory without cgo.
Go
1,390
star
10

go-server-timing

Go (golang) library for creating and consuming HTTP Server-Timing headers
Go
861
star
11

hashstructure

Get hash values for arbitrary values in Go (golang).
Go
745
star
12

goamz

Golang Amazon Library
Go
673
star
13

golicense

Scan and analyze OSS dependencies and licenses from compiled Go binaries
Go
666
star
14

ioprogress

Go (golang) package for progress bars around io.Reader/Writers.
Go
502
star
15

go-mruby

Go (golang) bindings to mruby.
Go
468
star
16

panicwrap

panicwrap is a Go library for catching and handling panics in Go applications.
Go
443
star
17

advent-2021-sql

Advent of Code 2021 using SQL (PostgreSQL-flavored)
PLpgSQL
436
star
18

boot2docker-vagrant-box

Packer scripts to build a Vagrant-compatible boot2docker box.
Smarty
424
star
19

copystructure

Go (golang) library for deep copying values in Go.
Go
345
star
20

vagrant-google

Vagrant provider for GCE.
Ruby
334
star
21

go-glint

Component-based UI-framework for command-line tools. Easily create highly dynamic CLI interfaces using shared, easily testable components.
Go
311
star
22

go-vnc

VNC client and server library for Go.
Go
283
star
23

colorstring

Go (golang) library for colorizing strings for terminal output.
Go
276
star
24

reflectwalk

reflectwalk is a Go library for "walking" complex structures, similar to walking a filesystem.
Go
274
star
25

virtualbox

[ABANDONED] Create and modify virtual machines in VirtualBox using pure ruby.
Ruby
244
star
26

vagrant-rackspace

Use Vagrant to manage Rackspace Cloud instances.
Ruby
234
star
27

protoc-gen-go-json

Protobuf compiler plugin to generate Go JSON Marshal/Unmarshal implementations for messages using jsonpb.
Go
225
star
28

pointerstructure

Go library for addressing and reading/writing a specific value within any Go structure using a string syntax.
Go
214
star
29

zig-overlay

Nix flake for the Zig compiler.
Nix
195
star
30

dotfiles

My personal dotfiles.
Batchfile
176
star
31

protostructure

Encode and decode Go (golang) struct types via protocol buffers.
Go
172
star
32

consulstructure

Decode Consul data into Go (Golang) structures and watch for updates
Go
172
star
33

packer-ubuntu-12.04-docker

Packer template that builds images that are Docker-ready on Ubuntu 12.04.
Shell
157
star
34

zig-libgc

Zig-friendly library for interfacing with libgc (bdwgc) -- the Boehm-Demers-Weiser conservative garbage collector
Zig
156
star
35

zig-objc

Objective-C runtime bindings for Zig (Zig calling ObjC).
Zig
153
star
36

libflightplan

A library for reading and writing flight plans in various formats. Available as both a C and Zig library.
Zig
153
star
37

terraform-provider-multispace

Terraform Provider for cascading runs across multiple workspaces.
Go
147
star
38

multistep

multistep is a Go library for building up complex actions using discrete steps.
Go
146
star
39

go-z3

Go (golang) bindings to the Z3 SMT Solver
Go
138
star
40

go-sat

SAT solver written in Go (golang).
Go
134
star
41

go-wordwrap

A Go (golang) library for wrapping words in a string.
Go
107
star
42

vim-misc

My Vim configuration files.
Vim Script
99
star
43

middleware

Generalized middleware implementation for Ruby.
Ruby
94
star
44

go-fs

Filesystem library for Go, implementing FAT filesystems so far.
Go
88
star
45

zig-graph

Directed graph data structure for Zig
Zig
86
star
46

go-grpc-net-conn

Turn any gRPC stream into a Go `net.Conn` implementation.
Go
80
star
47

zig-libxml2

libxml2 built using Zig build system
Zig
76
star
48

lightcloud

Library for accessing Plurk's LightCloud distributed key-value store for Ruby
Ruby
75
star
49

tree-sitter-hcl

A tree-sitter grammar for HCL (HashiCorp Configuration Language), used by projects such as Terraform.
C
69
star
50

go-linereader

Golang package that reads lines from an io.Reader and puts them onto a channel.
Go
66
star
51

veewee-to-packer

A tool for converting Veewee templates into Packer templates.
Ruby
65
star
52

tree-sitter-proto

A tree-sitter grammar for protocol buffer files (proto3).
C
63
star
53

vagrant-rake

A Vagrant plugin to execute `rake` commands from the host in the VM
Ruby
62
star
54

libvirt-rb

[ABANDONED] A ruby client library providing an interface to libvirt via FFI.
Ruby
59
star
55

go-testing-interface

Go (golang) library to expose *testing.T as an interface.
Go
58
star
56

patchstructure

Go library for representing and applying patches to modify existing Go structures
Go
55
star
57

squire

Go
55
star
58

go-libucl

Bindings to libucl from Go (golang).
Go
54
star
59

go-finger

Finger protocol library
Go
54
star
60

go-bnet

Go (golang) client for the Battle.net API
Go
52
star
61

libssh2-ruby

libssh2 bindings for Ruby
Ruby
47
star
62

iochan

A Go library for turning `io.Reader` into channels.
Go
43
star
63

prefixedio

Golang library that demultiplexes line-oriented data from an io.Reader into multiple io.Readers based on a prefix.
Go
42
star
64

flask-nix-example

Dockerfile
36
star
65

tlaplus-radix-tree

TLA+ modules, specifications, and models for Radix trees.
TLA
33
star
66

caststructure

A Go library that provides functions for downcasting types, composing values dynamically, and more.
Go
32
star
67

virtuoso

Dead simple virtual machine management over many hypervisors.
Ruby
30
star
68

hash_ring

Consistent hashing in Ruby. Ported from Amir Sailhefendic's hash_ring python library.
Ruby
28
star
69

terraform-aws-dynamic-keys

Terraform module that dynamically generates a public/private keypair.
HCL
26
star
70

go-spdx

Golang library for listing and looking up licenses using SPDX IDs.
Go
23
star
71

ruburple

A ruby interface to libpurple. Copied for git.
C
20
star
72

iorpc

Golang io interfaces across an RPC connection.
Go
18
star
73

fusion-m1-514-repro

Makefile
17
star
74

zig-build-macos-sdk

macOS SDK package for Zig build.
C
15
star
75

omniconfig

Flexible configuration for your Ruby applications and libraries.
Ruby
14
star
76

zig-libuv

Zig bindings for libuv. Also a build script to build libuv from scratch using only Zig (for easy cross-compilation, integration with Zig, etc.).
Zig
13
star
77

terraform-aws-fastai

Terraform module to create Fast.ai course instance.
HCL
12
star
78

radar

Easily report errors in your libraries and applications any way you want!
Ruby
12
star
79

zig-build-libxml2

The libxml2 library built and packaged for the Zig build system. These are not Zig language bindings to the library.
C
11
star
80

tiad-demo

Demo for The Incredible Automation Day in Paris.
Shell
10
star
81

waypoint-helm

WIP
Smarty
9
star
82

boto-route53

Route53 API built on top of Boto
Python
8
star
83

fogli

An efficient, simple, and intuitive Facebook Open Graph library
Ruby
8
star
84

minitest-mark

Proof of concept minitest extension to add test marking.
Ruby
7
star
85

vagrant-downloads

The Vagrant downloads website.
Ruby
7
star
86

minitest-parallel

Proof of concept to run your minitest tests in parallel.
Ruby
6
star
87

goconf

This is a copy of http://code.google.com/p/goconf/
Go
6
star
88

packer-go-bootcamp

Packer templates for the Go Bootcamp images.
Shell
6
star
89

larubyconf-vagrant-examples

Examples of using Vagrant from LARubyConf
Ruby
6
star
90

bintray-download-site

Simple Rack app for creating easy downloads for your Bintray packages.
Ruby
5
star
91

xidl

Parses XIDL files into Ruby objects.
Ruby
5
star
92

terraform-aws-vpc

Temporary, testing something, ignore this.
HCL
5
star
93

minitest-speed

Proof of concept speed tests using minitest.
Ruby
5
star
94

zig-build-xcode-frameworks

Exposing hexops/xcode-frameworks to the Zig package manager to work around some bugs.
Zig
5
star
95

homebrew-gon

Homebrew Tap for Gon (github.com/mitchellh/gon)
Ruby
4
star
96

osext

Copy of https://bitbucket.org/kardianos/osext
Go
4
star
97

minitest-funcarg

Proof of concept showing funcargs (style of DI) in minitest.
Ruby
4
star
98

go-bootcamp-remotecmds

My solution for the remotecmds problem for the Go Bootcamp I'm helping to instruct.
Go
4
star
99

lifeguard-random

Data source plugin for Lifeguard that generates random numbers.
Shell
4
star
100

lifeguard-graphite

Data source plugin for Lifeguard to query data from Graphite.
Shell
4
star