• Stars
    star
    6,182
  • Rank 6,496 (Top 0.2 %)
  • Language
    JavaScript
  • License
    MIT License
  • Created over 6 years ago
  • Updated about 1 month ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An HTTP/1.1 client, written from scratch for Node.js

undici

Node CI js-standard-style npm version codecov

An HTTP/1.1 client, written from scratch for Node.js.

Undici means eleven in Italian. 1.1 -> 11 -> Eleven -> Undici. It is also a Stranger Things reference.

Have a question about using Undici? Open a Q&A Discussion or join our official OpenJS Slack channel.

Install

npm i undici

Benchmarks

The benchmark is a simple hello world example using a number of unix sockets (connections) with a pipelining depth of 10 running on Node 20.6.0.

Connections 1

Tests Samples Result Tolerance Difference with slowest
http - no keepalive 15 5.32 req/sec ± 2.61 % -
http - keepalive 10 5.35 req/sec ± 2.47 % + 0.44 %
undici - fetch 15 41.85 req/sec ± 2.49 % + 686.04 %
undici - pipeline 40 50.36 req/sec ± 2.77 % + 845.92 %
undici - stream 15 60.58 req/sec ± 2.75 % + 1037.72 %
undici - request 10 61.19 req/sec ± 2.60 % + 1049.24 %
undici - dispatch 20 64.84 req/sec ± 2.81 % + 1117.81 %

Connections 50

Tests Samples Result Tolerance Difference with slowest
undici - fetch 30 2107.19 req/sec ± 2.69 % -
http - no keepalive 10 2698.90 req/sec ± 2.68 % + 28.08 %
http - keepalive 10 4639.49 req/sec ± 2.55 % + 120.17 %
undici - pipeline 40 6123.33 req/sec ± 2.97 % + 190.59 %
undici - stream 50 9426.51 req/sec ± 2.92 % + 347.35 %
undici - request 10 10162.88 req/sec ± 2.13 % + 382.29 %
undici - dispatch 50 11191.11 req/sec ± 2.98 % + 431.09 %

Quick Start

import { request } from 'undici'

const {
  statusCode,
  headers,
  trailers,
  body
} = await request('http://localhost:3000/foo')

console.log('response received', statusCode)
console.log('headers', headers)

for await (const data of body) {
  console.log('data', data)
}

console.log('trailers', trailers)

Body Mixins

The body mixins are the most common way to format the request/response body. Mixins include:

Example usage:

import { request } from 'undici'

const {
  statusCode,
  headers,
  trailers,
  body
} = await request('http://localhost:3000/foo')

console.log('response received', statusCode)
console.log('headers', headers)
console.log('data', await body.json())
console.log('trailers', trailers)

Note: Once a mixin has been called then the body cannot be reused, thus calling additional mixins on .body, e.g. .body.json(); .body.text() will result in an error TypeError: unusable being thrown and returned through the Promise rejection.

Should you need to access the body in plain-text after using a mixin, the best practice is to use the .text() mixin first and then manually parse the text to the desired format.

For more information about their behavior, please reference the body mixin from the Fetch Standard.

Common API Methods

This section documents our most commonly used API methods. Additional APIs are documented in their own files within the docs folder and are accessible via the navigation list on the left side of the docs site.

undici.request([url, options]): Promise

Arguments:

  • url string | URL | UrlObject
  • options RequestOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0

Returns a promise with the result of the Dispatcher.request method.

Calls options.dispatcher.request(options).

See Dispatcher.request for more details.

undici.stream([url, options, ]factory): Promise

Arguments:

  • url string | URL | UrlObject
  • options StreamOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0
  • factory Dispatcher.stream.factory

Returns a promise with the result of the Dispatcher.stream method.

Calls options.dispatcher.stream(options, factory).

See Dispatcher.stream for more details.

undici.pipeline([url, options, ]handler): Duplex

Arguments:

  • url string | URL | UrlObject
  • options PipelineOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0
  • handler Dispatcher.pipeline.handler

Returns: stream.Duplex

Calls options.dispatch.pipeline(options, handler).

See Dispatcher.pipeline for more details.

undici.connect([url, options]): Promise

Starts two-way communications with the requested resource using HTTP CONNECT.

Arguments:

  • url string | URL | UrlObject
  • options ConnectOptions
  • callback (err: Error | null, data: ConnectData | null) => void (optional)

Returns a promise with the result of the Dispatcher.connect method.

Calls options.dispatch.connect(options).

See Dispatcher.connect for more details.

undici.fetch(input[, init]): Promise

Implements fetch.

Only supported on Node 16.8+.

Basic usage example:

import { fetch } from 'undici'


const res = await fetch('https://example.com')
const json = await res.json()
console.log(json)

You can pass an optional dispatcher to fetch as:

import { fetch, Agent } from 'undici'

const res = await fetch('https://example.com', {
  // Mocks are also supported
  dispatcher: new Agent({
    keepAliveTimeout: 10,
    keepAliveMaxTimeout: 10
  })
})
const json = await res.json()
console.log(json)

request.body

A body can be of the following types:

  • ArrayBuffer
  • ArrayBufferView
  • AsyncIterables
  • Blob
  • Iterables
  • String
  • URLSearchParams
  • FormData

In this implementation of fetch, request.body now accepts Async Iterables. It is not present in the Fetch Standard.

import { fetch } from 'undici'

const data = {
  async *[Symbol.asyncIterator]() {
    yield 'hello'
    yield 'world'
  },
}

await fetch('https://example.com', { body: data, method: 'POST', duplex: 'half' })

request.duplex

  • half

In this implementation of fetch, request.duplex must be set if request.body is ReadableStream or Async Iterables. And fetch requests are currently always be full duplex. More detail refer to Fetch Standard.

response.body

Nodejs has two kinds of streams: web streams, which follow the API of the WHATWG web standard found in browsers, and an older Node-specific streams API. response.body returns a readable web stream. If you would prefer to work with a Node stream you can convert a web stream using .fromWeb().

import { fetch } from 'undici'
import { Readable } from 'node:stream'

const response = await fetch('https://example.com')
const readableWebStream = response.body
const readableNodeStream = Readable.fromWeb(readableWebStream)

Specification Compliance

This section documents parts of the Fetch Standard that Undici does not support or does not fully implement.

Garbage Collection

The Fetch Standard allows users to skip consuming the response body by relying on garbage collection to release connection resources. Undici does not do the same. Therefore, it is important to always either consume or cancel the response body.

Garbage collection in Node is less aggressive and deterministic (due to the lack of clear idle periods that browsers have through the rendering refresh rate) which means that leaving the release of connection resources to the garbage collector can lead to excessive connection usage, reduced performance (due to less connection re-use), and even stalls or deadlocks when running out of connections.

// Do
const headers = await fetch(url)
  .then(async res => {
    for await (const chunk of res.body) {
      // force consumption of body
    }
    return res.headers
  })

// Do not
const headers = await fetch(url)
  .then(res => res.headers)

However, if you want to get only headers, it might be better to use HEAD request method. Usage of this method will obviate the need for consumption or cancelling of the response body. See MDN - HTTP - HTTP request methods - HEAD for more details.

const headers = await fetch(url, { method: 'HEAD' })
  .then(res => res.headers)
Forbidden and Safelisted Header Names

The Fetch Standard requires implementations to exclude certain headers from requests and responses. In browser environments, some headers are forbidden so the user agent remains in full control over them. In Undici, these constraints are removed to give more control to the user.

undici.upgrade([url, options]): Promise

Upgrade to a different protocol. See MDN - HTTP - Protocol upgrade mechanism for more details.

Arguments:

  • url string | URL | UrlObject
  • options UpgradeOptions
  • callback (error: Error | null, data: UpgradeData) => void (optional)

Returns a promise with the result of the Dispatcher.upgrade method.

Calls options.dispatcher.upgrade(options).

See Dispatcher.upgrade for more details.

undici.setGlobalDispatcher(dispatcher)

  • dispatcher Dispatcher

Sets the global dispatcher used by Common API Methods.

undici.getGlobalDispatcher()

Gets the global dispatcher used by Common API Methods.

Returns: Dispatcher

undici.setGlobalOrigin(origin)

  • origin string | URL | undefined

Sets the global origin used in fetch.

If undefined is passed, the global origin will be reset. This will cause Response.redirect, new Request(), and fetch to throw an error when a relative path is passed.

setGlobalOrigin('http://localhost:3000')

const response = await fetch('/api/ping')

console.log(response.url) // http://localhost:3000/api/ping

undici.getGlobalOrigin()

Gets the global origin used in fetch.

Returns: URL

UrlObject

  • port string | number (optional)
  • path string (optional)
  • pathname string (optional)
  • hostname string (optional)
  • origin string (optional)
  • protocol string (optional)
  • search string (optional)

Specification Compliance

This section documents parts of the HTTP/1.1 specification that Undici does not support or does not fully implement.

Expect

Undici does not support the Expect request header field. The request body is always immediately sent and the 100 Continue response will be ignored.

Refs: https://tools.ietf.org/html/rfc7231#section-5.1.1

Pipelining

Undici will only use pipelining if configured with a pipelining factor greater than 1.

Undici always assumes that connections are persistent and will immediately pipeline requests, without checking whether the connection is persistent. Hence, automatic fallback to HTTP/1.0 or HTTP/1.1 without pipelining is not supported.

Undici will immediately pipeline when retrying requests after a failed connection. However, Undici will not retry the first remaining requests in the prior pipeline and instead error the corresponding callback/promise/stream.

Undici will abort all running requests in the pipeline when any of them are aborted.

Manual Redirect

Since it is not possible to manually follow an HTTP redirect on the server-side, Undici returns the actual response instead of an opaqueredirect filtered one when invoked with a manual redirect. This aligns fetch() with the other implementations in Deno and Cloudflare Workers.

Refs: https://fetch.spec.whatwg.org/#atomic-http-redirect-handling

Workarounds

Network address family autoselection.

If you experience problem when connecting to a remote server that is resolved by your DNS servers to a IPv6 (AAAA record) first, there are chances that your local router or ISP might have problem connecting to IPv6 networks. In that case undici will throw an error with code UND_ERR_CONNECT_TIMEOUT.

If the target server resolves to both a IPv6 and IPv4 (A records) address and you are using a compatible Node version (18.3.0 and above), you can fix the problem by providing the autoSelectFamily option (support by both undici.request and undici.Agent) which will enable the family autoselection algorithm when establishing the connection.

Collaborators

Releasers

License

MIT

More Repositories

1

node

Node.js JavaScript runtime ✨🐢🚀✨
JavaScript
97,973
star
2

node-v0.x-archive

Moved to https://github.com/nodejs/node
34,533
star
3

node-gyp

Node.js native addon build tool
Python
9,275
star
4

docker-node

Official Docker Image for Node.js 🐳 🐢 🚀
Dockerfile
7,872
star
5

http-parser

http request/response parser for c
C
6,223
star
6

nodejs.org

The Node.js® Website
TypeScript
6,020
star
7

Release

Node.js Release Working Group
3,803
star
8

nan

Native Abstractions for Node.js
C++
3,277
star
9

corepack

Zero-runtime-dependency package acting as bridge between Node projects and their package managers
TypeScript
2,542
star
10

node-addon-examples

Node.js C++ addon examples from http://nodejs.org/docs/latest/api/addons.html
C++
2,332
star
11

nodejs.dev

A redesign of Nodejs.org built using Gatsby.js with React.js, TypeScript, and Remark.
TypeScript
2,293
star
12

node-addon-api

Module for using Node-API from C++
C++
2,162
star
13

node-chakracore

Node.js on ChakraCore ✨🐢🚀✨
JavaScript
1,921
star
14

node-convergence-archive

Archive for node/io.js convergence work pre-3.0.0
JavaScript
1,837
star
15

llhttp

Port of http_parser to llparse
TypeScript
1,665
star
16

help

✨ Need help with Node.js? File an Issue here. 🚀
1,473
star
17

llnode

An lldb plugin for Node.js and V8, which enables inspection of JavaScript states for insights into Node.js processes and their core dumps.
C++
1,151
star
18

readable-stream

Node-core streams for userland
JavaScript
1,003
star
19

examples

A repository of runnable Node.js examples that go beyond "hello, world!"
JavaScript
652
star
20

TSC

The Node.js Technical Steering Committee
JavaScript
592
star
21

llparse

Generating parsers in LLVM IR
TypeScript
586
star
22

mentorship

Node.js Mentorship Program Initiative
585
star
23

citgm

Canary in the Gold Mine
JavaScript
567
star
24

http2

Working on an HTTP/2 implementation for Node.js Core
JavaScript
520
star
25

diagnostics

Node.js Diagnostics Working Group
513
star
26

security-wg

Node.js Ecosystem Security Working Group
JavaScript
495
star
27

next-10

Repository for discussion on strategic directions for next 10 years of Node.js
480
star
28

build

Better build and test infra for Node.
Shell
469
star
29

node-eps

Node.js Enhancement Proposals for discussion on future API additions/changes to Node core
442
star
30

education

A place to discover and contribute to education initiatives in Node.js
417
star
31

node-v8

Experimental Node.js mirror on V8 lkgr ✨🐢🚀✨
Shell
416
star
32

modules

Node.js Modules Team
413
star
33

package-maintenance

Repository for work for discussion of helping with maintenance of key packages in the ecosystem.
407
star
34

nodejs-zh-CN

node.js 中文化 & 中文社区
SCSS
395
star
35

performance

Node.js team focusing on performance
Shell
376
star
36

node-inspect

Code that's now part of node, previously `node debug` for `node --inspect`
JavaScript
340
star
37

node-report

Delivers a human-readable diagnostic summary, written to file.
C++
326
star
38

single-executable

This team aims to advance the state of the art in packaging Node.js applications as single standalone executables (SEAs) on all supported operating systems.
306
star
39

quic

This repository is no longer active.
JavaScript
301
star
40

github-bot

@nodejs-github-bot's heart and soul
JavaScript
267
star
41

community-committee

The Node.js Community Committee (aka CommComm)
263
star
42

nodejs-ko

node.js 한국 커뮤니티
Stylus
263
star
43

amaro

Node.js TypeScript wrapper
JavaScript
261
star
44

node-core-utils

CLI tools for Node.js Core collaborators
JavaScript
253
star
45

unofficial-builds

Unofficial binaries for Node.js
Shell
252
star
46

evangelism

Letting the world know how awesome Node.js is and how to get involved!
242
star
47

abi-stable-node

Repository used by the Node-API team to manage work related to Node-API and node-addon-api
JavaScript
241
star
48

abi-stable-node-addon-examples

Node Add-on Examples with PoC ABI stable API for native modules
C++
237
star
49

changelog-maker

A git log to CHANGELOG.md tool
JavaScript
230
star
50

uvwasi

WASI syscall API built atop libuv
C
228
star
51

cjs-module-lexer

Fast lexer to extract named exports via analysis from CommonJS modules
JavaScript
226
star
52

iojs.org

JavaScript
219
star
53

installer

Electron based installer for Node.js.
JavaScript
194
star
54

getting-started

Getting started in Node.js!
193
star
55

postject

Easily inject arbitrary read-only resources into executable formats (Mach-O, PE, ELF) and use it at runtime.
JavaScript
186
star
56

web-server-frameworks

A place for Node.js Web-Server Framework authors and users to collaborate
182
star
57

repl

REPL rewrite for Node.js ✨🐢🚀✨
JavaScript
178
star
58

tooling

Advancing Node.js as a framework for writing great tools
170
star
59

snap

Node.js snap source and updater
Shell
168
star
60

code-and-learn

A series of workshop sprints for Node.js.
Dockerfile
164
star
61

benchmarking

Node.js Benchmarking Working Group
Shell
161
star
62

admin

Administrative space for policies of the TSC
JavaScript
157
star
63

docker-iojs

Official Docker images from the io.js project
Shell
156
star
64

full-icu-npm

convenience loader for 'small-icu' node builds
JavaScript
152
star
65

i18n

The Node.js Internationalization Working Group – A Community Committee initiative.
150
star
66

roadmap

This repository and working group has been retired.
135
star
67

gyp-next

A fork of the GYP build system for use in the Node.js projects
Python
131
star
68

loaders

ECMAScript Modules Loaders
128
star
69

nodejs-pt

Internacionalização & tradução para português referente ao site nodejs.org
108
star
70

dev-policy

node-foundation dev policy **draft**
108
star
71

promises

Promises Working Group Repository
107
star
72

nodejs-zh-TW

Node.js zh-TW
CSS
107
star
73

NG

Next Generation JavaScript IO Platform
103
star
74

nodejs-ja

Node.js 日本語ローカリゼーション
101
star
75

nodejs.org-archive

[DEPRECATED] Website repository for the Node.js project
Nginx
101
star
76

website-redesign

Facilitating the redesign of the nodejs.org website
99
star
77

node-core-test

Node 18's node:test, as an npm package
JavaScript
95
star
78

worker

Figuring out native (Web?)Worker support for Node
JavaScript
87
star
79

post-mortem

This WG is in the process of being folded into the Diagnostics WG.
85
star
80

typescript

TypeScript support in Node.js core
83
star
81

inclusivity

Improving inclusivity in the node community
80
star
82

CTC

Node.js Core Technical Committee & Collaborators
80
star
83

nodejs-ru

Перевод io.js на русский язык
JavaScript
79
star
84

ecmascript-modules

A fork of Node.js to hash out ideas related to ESModules
JavaScript
73
star
85

docs

A place for documentation. (this repository is inactive)
71
star
86

webcrypto

This repository has been archived. The WebCrypto API has been implemented in recent versions of Node.js and does not require additional packages.
JavaScript
69
star
87

import-in-the-middle

Like `require-in-the-middle`, but for ESM import
JavaScript
67
star
88

automation

Better automation for the Node.js project
66
star
89

api

API WG
61
star
90

email

MX server management for iojs.org (and eventually nodejs.org)
JavaScript
60
star
91

user-feedback

Node.js User Feedback Initiative
56
star
92

loaders-test

Examples demonstrating the Node.js ECMAScript Modules Loaders API
JavaScript
54
star
93

core-validate-commit

Validate commit messages for Node.js core
JavaScript
52
star
94

board

The Node Foundation Board of Directors
JavaScript
52
star
95

branch-diff

A tool to list print the commits on one git branch that are not on another using loose comparison
JavaScript
52
star
96

logos

Logo ideas
51
star
97

promise-use-cases

Short lived repository in order to discuss Node.js promise use cases in Collaborator Summit Berlin 2018
JavaScript
50
star
98

open-standards

Node.js Open Standards Team
43
star
99

version-management

Discussion Group for Version Management
42
star
100

hardware

Hardware Working Group
42
star