This is a low-abstraction, high-performance Vulkan API with interfaces for JavaScript and TypeScript.
Platforms:
nvk comes with pre-built N-API binaries for the following platforms:
Examples:
Real-Time RTX Ray Tracer |
---|
Why Vulkan in JavaScript?
- Vulkan is a binding friendly API
- Less overhead than WebGL/OpenGL
- Essential features like Compute, Geometry and Tesselation shaders
- Support for Real-Time Ray Tracing, Mesh shaders, ...
- Supports Multithreading
- Low-level memory control using ArrayBuffers
This project is a thin layer on top of native Vulkan, built with simplicity and performance in mind. Native memory for Vulkan gets constructed entirely within JavaScript to reduce trampolining overhead.
Bounding checks and type validations are enabled by default, but can be disabled using the --disable-validation-checks
flag.
- Installation
- Example
- TypeScript
- Syntactic Sugar
- Project Structure
- Binding Code Generator
- Linking
- Build Instructions
- CLI
- RenderDoc
- TODOs
Installation:
npm install nvk
Example:
In most cases the bindings match the C99 style of Vulkan. This allows you to follow existing C/C++ tutorials, but write the implementation itself with nvk. Note that both interfaces end up with a similar amount of code. Optionally you can use some syntactic sugar to write things quicker.
JavaScript/TypeScript:
let instance = new VkInstance();
let appInfo = new VkApplicationInfo();
appInfo.sType = VK_STRUCTURE_TYPE_APPLICATION_INFO;
appInfo.pApplicationName = "App";
appInfo.applicationVersion = VK_MAKE_VERSION(1, 0, 0);
appInfo.pEngineName = "Engine";
appInfo.engineVersion = VK_MAKE_VERSION(1, 0, 0);
appInfo.apiVersion = VK_API_VERSION_1_2;
let validationLayers = [
"VK_LAYER_KHRONOS_validation"
];
let instanceInfo = new VkInstanceCreateInfo();
instanceInfo.sType = VK_STRUCTURE_TYPE_INSTANCE_CREATE_INFO;
instanceInfo.pApplicationInfo = appInfo;
instanceInfo.ppEnabledLayerNames = validationLayers;
instanceInfo.enabledLayerCount = validationLayers.length;
vkCreateInstance(instanceInfo, null, instance);
C++:
VkInstance instance;
VkApplicationInfo appInfo = {};
appInfo.sType = VK_STRUCTURE_TYPE_APPLICATION_INFO;
appInfo.pApplicationName = "App";
appInfo.applicationVersion = VK_MAKE_VERSION(1, 0, 0);
appInfo.pEngineName = "Engine";
appInfo.engineVersion = VK_MAKE_VERSION(1, 0, 0);
appInfo.apiVersion = VK_API_VERSION_1_2;
const std::vector<const char*> validationLayers = {
"VK_LAYER_KHRONOS_validation"
};
VkInstanceCreateInfo instanceInfo = {};
instanceInfo.sType = VK_STRUCTURE_TYPE_INSTANCE_CREATE_INFO;
instanceInfo.pApplicationInfo = &appInfo;
instanceInfo.ppEnabledLayerNames = validationLayers.data();
instanceInfo.enabledLayerCount = static_cast<uint32_t>(validationLayers.size());
vkCreateInstance(&instanceInfo, nullptr, &instance);
TypeScript:
To use the TypeScript definition file, simply follow the installation steps above or use this example as a reference. Afterwards in your .ts
file, import and use nvk as follows:
import * as nvk from "nvk";
Object.assign(global, nvk);
let win = new VulkanWindow({
width: 480,
height: 320,
title: "typescript-example"
});
let appInfo = new VkApplicationInfo({
pApplicationName: "Hello!",
applicationVersion: VK_MAKE_VERSION(1, 0, 0),
pEngineName: "No Engine",
engineVersion: VK_MAKE_VERSION(1, 0, 0),
apiVersion: VK_API_VERSION_1_2
});
Also note, that it is recommended to enable the --strict
mode in the TS compiler options and use the latest version of the TS compiler.
Syntactic Sugar:
The API gives you some sugar to write things quicker, but still gives you the option to write everything explicitly
sType auto-filling
sType
members get auto-filled, but you can still set them yourself
let appInfo = new VkApplicationInfo();
appInfo.sType = VK_STRUCTURE_TYPE_APPLICATION_INFO;
Becomes:
let appInfo = new VkApplicationInfo(); // sType auto-filled
Structure creation shortcut
Instead of:
let offset = new VkOffset2D();
offset.x = 0;
offset.y = 0;
let extent = new VkExtent2D();
extent.width = 640;
extent.height = 480;
let renderArea = new VkRect2D();
renderArea.offset = offset;
renderArea.extent = extent;
You can write:
let renderArea = new VkRect2D({
offset: new VkOffset2D({ x: 0, y: 0 }),
extent: new VkExtent2D({ width: 640, height: 480 })
});
Nested Structures
nvk allows to use nested structures to improve memory usage and performance. A nested structure is pre-allocated automatically and shares the native memory of it's top-level structure.
You can use the --enable-shared-memory-hints
flag, to get hints where you could've used a nested structure in your code.
Instead of:
let scissor = new VkRect2D();
scissor.offset = new VkOffset2D();
scissor.extent = new VkExtent2D();
scissor.offset.x = 0;
scissor.offset.y = 0;
scissor.extent.width = 480;
scissor.extent.height = 320;
You can write:
let scissor = new VkRect2D();
scissor.offset.x = 0;
scissor.offset.y = 0;
scissor.extent.width = 480;
scissor.extent.height = 320;
Cached Structures
To reduce GC pressure, nvk allows to use cached structures. Instead of having to allocate a structure every time on the heap, nvk allows to use a caching mechanism to mimic stack allocation.
Imagine the following situation:
let commandBuffers = [...Array(8)].map(() => new VkCommandBuffer());
for (let ii = 0; ii < commandBuffers.length; ++ii) {
let commandBufferBeginInfo = new VkCommandBufferBeginInfo();
vkBeginCommandBuffer(commandBuffers[ii], cmdBufferBeginInfo);
...
};
This results in 8 allocations of VkCommandBufferBeginInfo
structures. When this code gets executed in frequently used code sections, the heap pressure will be high.
Now nvk has a mechanism to simulate stack allocation:
let commandBuffers = [...Array(8)].map(() => new VkCommandBuffer());
for (let ii = 0; ii < commandBuffers.length; ++ii) {
let commandBufferBeginInfo = VkCommandBufferBeginInfo("0x0");
vkBeginCommandBuffer(commandBuffers[ii], cmdBufferBeginInfo);
...
};
On the first iteration of the loop, a VkCommandBufferBeginInfo
structure is allocated on the heap but also gets cached internally. Based on the String id 0x0
you have added, nvk uses this id to identify this structure and return a cached one whenever this code gets executed again.
Obviously, you don't want to add your own ids to each structure by hand. There is a rollup plugin, which detects nvk structure calls (when invoked without new
) and inserts a unique id automatically. You can find the rollup plugin here and a project example here.
Project Structure:
docs
: generated vulkan documentation filesgenerator
: code for binding generationgenerated
: the generated binding codeexamples
: ready-to-run exampleslib
: required third party libssrc
: classes for e.g. window creation
This tool uses a new JavaScript type called BigInt
to represent memory addresses returned by Vulkan. The BigInt
type was recently added, so make sure you use a recent node.js version.
Binding Code Generator:
The Generator generates code based on a vk.xml
specification file. It first converts the XML file into an AST, which is then used by the code generator. Currently more than ~300.000
lines of code get generated, where ~60.000
lines are JavaScript, ~50.000
lines are TypeScript, ~40.000
lines are C++ code and the rest code for the documentation and AST.
Starting from version 0.5.0
, nvk now uses a concept called Hybrid bindings, which reduces the overhead of JavaScript<->C++ context switching. Structures tend to have many members, where each member has to be a getter/setter function. Before this change, these getters/setters were written in C++, so there were many tiny context switches. Now the native memory of Structures and Handles just get filled entirely within JavaScript (see the file here), resulting in much less overhead and much simpler binding and generator code.
Linking:
This section is of interest, if you have an existing C++ project and want to link against this one.
This project mostly doesn't requires to be linked against. All structures and handles have properties to access the underlying memory directly. For example, see VkApplicationInfo (#Default Properties).
Structures and handles come with these 3 properties:
- .memoryBuffer: Reference to the underlying native memory, wrapped inside an ArrayBuffer
- .memoryAddress: Native address (BigInt) of memoryBuffer. To convert BigInt into a native type, see e.g. this document
- .byteLength: Total native bytelength of the structure/handle
Build Instructions:
Warning: You may want to skip this section, as nvk uses N-API and ships pre-compiled binaries. This section is only of interest if you want to generate and build the bindings yourself, which is likely not your intention!
This project requires two-pass compilation which means, after initially compiling the bindings, a second compilation is required. This is necessary, because this project constructs Vulkan memory entirely from within JavaScript.
- At the first compilation, memory layouts of vulkan structures get stored inside a JSON file
- At the second pass, these memory layout then get used to inline memory offsets inside the JavaScript binding code
Requirements:
- node.js >= v10.9.0 recommended
Windows:
If you already have Visual Studio >= 15 installed, then just make sure to have Python 2.7.x
installed.
If you don't have Visual Studio, then install the following package:
npm install --global --production windows-build-tools
Now install the corresponding Vulkan SDK version from here.
Next, clone this repository.
To generate and compile the bindings, run:
npm run generate --vkversion=x
npm run build --vkversion=x
Linux:
Download and setup the corresponding Vulkan SDK version from here.
Follow the guide on how to correctly setup the SDK.
Make sure that the environment variables are correctly set, e.g. echo $VULKAN_SDK
.
Next, clone this repository.
To generate and compile the bindings, run:
npm run generate --vkversion=x
npm run build --vkversion=x
MacOS:
Download and setup the corresponding Vulkan SDK version from here.
Follow the guide on how to correctly setup the SDK.
Make sure that the environment variables are correctly set, e.g. echo $VULKAN_SDK
.
Next, clone this repository.
To generate and compile the bindings, run:
npm run generate --vkversion=x
npm run build --vkversion=x
Releasing:
When updating the bindings to a newer Vulkan version, or other drastic changes were made:
- Update the package.json:
- Add the previously used Vulkan version to
config.OUTDATED
- Add the new Vulkan version to
config.POST_DEFAULT_BINDING_VERSION
- Edit the TS type reference lines at the beginning of index.js to contain the new Vulkan version
- Add the previously used Vulkan version to
- Update the .npmignore
- Make sure that the
config.OUTDATED
section in package.json matches the content in there, so previous/outdated Vulkan bindings dont't get included in the npm package
- Make sure that the
- Update the README.md to contain links to the new Vulkan version
- Update the Website link of the repository
Publishing:
When a new version of this project should be published (e.g. to npm), consider the following steps:
- Update the package.json:
- Update the npm package version (if necessary)
- Make sure that the bindings for all platforms were generated with:
- The
--docs
flag enabled, to include a documentation - The
--disable-minification
flag not enabled
- The
- Before running
npm init & npm publish
, you should preview the files which will land into the package. This can be done using the commandnpm pack --dry-run
CLI:
Syntax:
npm run [script] [flag] [value]
Usage:
General:
[--disable-validation-checks]: Disables type and bounding checks for better performance
[--enable-shared-memory-hints]: Enables console hints, reporting to use nested structures when possible - useful for performance optimization
Generating:
You can generate bindings with:
npm run generate --vkversion=1.2.162
The generated bindings can then be found in generated/{vkversion}/${platform}
- Make sure the specified version to generate bindings for can be found here
- The binding specification file gets auto-downloaded and is stored in
generate/specifications/{vkversion}.xml
--incremental
flag should only be used if you're a developer of nvk
Flags:
[--vkversion]: The Vulkan version to generate bindings for
[--fake-platform]: Allows to specify a fake platform to generate bindings for. Only use this when the native bindings don't have to be recompiled! A useful but dangerous flag
[--disable-minification]: Disables code minification of the JavaScript interfaces
[--incremental]: Enables incremental builds when building the bindings
[--docs]: Generates HTML-based documentation, also used for TypeScript type annotations
Building:
You can build the generated bindings with:
npm run build --vkversion=1.2.162
The compiled bindings can then be found in generated/{vkversion}/build
Flags:
[--vkversion]: The Vulkan version to build bindings for
[--msvsversion]: The Visual Studio version to build the bindings with
RenderDoc:
Using RenderDoc is simple. Open RenderDoc and in the Launch Application tab, enter e.g.:
- Executable Path:
C:\Program Files\nodejs\node.exe
- Command-line Arguments:
--experimental-modules C:\GitHub\nvk-examples\triangle\index.mjs