• Stars
    star
    5,782
  • Rank 6,688 (Top 0.2 %)
  • Language
    JavaScript
  • License
    MIT License
  • Created almost 6 years ago
  • Updated 3 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

An HTTP/1.1 client, written from scratch for Node.js

undici

Node CI js-standard-style npm version codecov

An HTTP/1.1 client, written from scratch for Node.js.

Undici means eleven in Italian. 1.1 -> 11 -> Eleven -> Undici. It is also a Stranger Things reference.

Have a question about using Undici? Open a Q&A Discussion or join our official OpenJS Slack channel.

Install

npm i undici

Benchmarks

The benchmark is a simple hello world example using a number of unix sockets (connections) with a pipelining depth of 10 running on Node 20.6.0.

Connections 1

Tests Samples Result Tolerance Difference with slowest
http - no keepalive 15 5.32 req/sec ± 2.61 % -
http - keepalive 10 5.35 req/sec ± 2.47 % + 0.44 %
undici - fetch 15 41.85 req/sec ± 2.49 % + 686.04 %
undici - pipeline 40 50.36 req/sec ± 2.77 % + 845.92 %
undici - stream 15 60.58 req/sec ± 2.75 % + 1037.72 %
undici - request 10 61.19 req/sec ± 2.60 % + 1049.24 %
undici - dispatch 20 64.84 req/sec ± 2.81 % + 1117.81 %

Connections 50

Tests Samples Result Tolerance Difference with slowest
undici - fetch 30 2107.19 req/sec ± 2.69 % -
http - no keepalive 10 2698.90 req/sec ± 2.68 % + 28.08 %
http - keepalive 10 4639.49 req/sec ± 2.55 % + 120.17 %
undici - pipeline 40 6123.33 req/sec ± 2.97 % + 190.59 %
undici - stream 50 9426.51 req/sec ± 2.92 % + 347.35 %
undici - request 10 10162.88 req/sec ± 2.13 % + 382.29 %
undici - dispatch 50 11191.11 req/sec ± 2.98 % + 431.09 %

Quick Start

import { request } from 'undici'

const {
  statusCode,
  headers,
  trailers,
  body
} = await request('http://localhost:3000/foo')

console.log('response received', statusCode)
console.log('headers', headers)

for await (const data of body) {
  console.log('data', data)
}

console.log('trailers', trailers)

Body Mixins

The body mixins are the most common way to format the request/response body. Mixins include:

Example usage:

import { request } from 'undici'

const {
  statusCode,
  headers,
  trailers,
  body
} = await request('http://localhost:3000/foo')

console.log('response received', statusCode)
console.log('headers', headers)
console.log('data', await body.json())
console.log('trailers', trailers)

Note: Once a mixin has been called then the body cannot be reused, thus calling additional mixins on .body, e.g. .body.json(); .body.text() will result in an error TypeError: unusable being thrown and returned through the Promise rejection.

Should you need to access the body in plain-text after using a mixin, the best practice is to use the .text() mixin first and then manually parse the text to the desired format.

For more information about their behavior, please reference the body mixin from the Fetch Standard.

Common API Methods

This section documents our most commonly used API methods. Additional APIs are documented in their own files within the docs folder and are accessible via the navigation list on the left side of the docs site.

undici.request([url, options]): Promise

Arguments:

  • url string | URL | UrlObject
  • options RequestOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0

Returns a promise with the result of the Dispatcher.request method.

Calls options.dispatcher.request(options).

See Dispatcher.request for more details.

undici.stream([url, options, ]factory): Promise

Arguments:

  • url string | URL | UrlObject
  • options StreamOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0
  • factory Dispatcher.stream.factory

Returns a promise with the result of the Dispatcher.stream method.

Calls options.dispatcher.stream(options, factory).

See Dispatcher.stream for more details.

undici.pipeline([url, options, ]handler): Duplex

Arguments:

  • url string | URL | UrlObject
  • options PipelineOptions
    • dispatcher Dispatcher - Default: getGlobalDispatcher
    • method String - Default: PUT if options.body, otherwise GET
    • maxRedirections Integer - Default: 0
  • handler Dispatcher.pipeline.handler

Returns: stream.Duplex

Calls options.dispatch.pipeline(options, handler).

See Dispatcher.pipeline for more details.

undici.connect([url, options]): Promise

Starts two-way communications with the requested resource using HTTP CONNECT.

Arguments:

  • url string | URL | UrlObject
  • options ConnectOptions
  • callback (err: Error | null, data: ConnectData | null) => void (optional)

Returns a promise with the result of the Dispatcher.connect method.

Calls options.dispatch.connect(options).

See Dispatcher.connect for more details.

undici.fetch(input[, init]): Promise

Implements fetch.

Only supported on Node 16.8+.

Basic usage example:

import { fetch } from 'undici'


const res = await fetch('https://example.com')
const json = await res.json()
console.log(json)

You can pass an optional dispatcher to fetch as:

import { fetch, Agent } from 'undici'

const res = await fetch('https://example.com', {
  // Mocks are also supported
  dispatcher: new Agent({
    keepAliveTimeout: 10,
    keepAliveMaxTimeout: 10
  })
})
const json = await res.json()
console.log(json)

request.body

A body can be of the following types:

  • ArrayBuffer
  • ArrayBufferView
  • AsyncIterables
  • Blob
  • Iterables
  • String
  • URLSearchParams
  • FormData

In this implementation of fetch, request.body now accepts Async Iterables. It is not present in the Fetch Standard.

import { fetch } from 'undici'

const data = {
  async *[Symbol.asyncIterator]() {
    yield 'hello'
    yield 'world'
  },
}

await fetch('https://example.com', { body: data, method: 'POST', duplex: 'half' })

request.duplex

  • half

In this implementation of fetch, request.duplex must be set if request.body is ReadableStream or Async Iterables. And fetch requests are currently always be full duplex. More detail refer to Fetch Standard.

response.body

Nodejs has two kinds of streams: web streams, which follow the API of the WHATWG web standard found in browsers, and an older Node-specific streams API. response.body returns a readable web stream. If you would prefer to work with a Node stream you can convert a web stream using .fromWeb().

import { fetch } from 'undici'
import { Readable } from 'node:stream'

const response = await fetch('https://example.com')
const readableWebStream = response.body
const readableNodeStream = Readable.fromWeb(readableWebStream)

Specification Compliance

This section documents parts of the Fetch Standard that Undici does not support or does not fully implement.

Garbage Collection

The Fetch Standard allows users to skip consuming the response body by relying on garbage collection to release connection resources. Undici does not do the same. Therefore, it is important to always either consume or cancel the response body.

Garbage collection in Node is less aggressive and deterministic (due to the lack of clear idle periods that browsers have through the rendering refresh rate) which means that leaving the release of connection resources to the garbage collector can lead to excessive connection usage, reduced performance (due to less connection re-use), and even stalls or deadlocks when running out of connections.

// Do
const headers = await fetch(url)
  .then(async res => {
    for await (const chunk of res.body) {
      // force consumption of body
    }
    return res.headers
  })

// Do not
const headers = await fetch(url)
  .then(res => res.headers)

However, if you want to get only headers, it might be better to use HEAD request method. Usage of this method will obviate the need for consumption or cancelling of the response body. See MDN - HTTP - HTTP request methods - HEAD for more details.

const headers = await fetch(url, { method: 'HEAD' })
  .then(res => res.headers)
Forbidden and Safelisted Header Names

The Fetch Standard requires implementations to exclude certain headers from requests and responses. In browser environments, some headers are forbidden so the user agent remains in full control over them. In Undici, these constraints are removed to give more control to the user.

undici.upgrade([url, options]): Promise

Upgrade to a different protocol. See MDN - HTTP - Protocol upgrade mechanism for more details.

Arguments:

  • url string | URL | UrlObject
  • options UpgradeOptions
  • callback (error: Error | null, data: UpgradeData) => void (optional)

Returns a promise with the result of the Dispatcher.upgrade method.

Calls options.dispatcher.upgrade(options).

See Dispatcher.upgrade for more details.

undici.setGlobalDispatcher(dispatcher)

  • dispatcher Dispatcher

Sets the global dispatcher used by Common API Methods.

undici.getGlobalDispatcher()

Gets the global dispatcher used by Common API Methods.

Returns: Dispatcher

undici.setGlobalOrigin(origin)

  • origin string | URL | undefined

Sets the global origin used in fetch.

If undefined is passed, the global origin will be reset. This will cause Response.redirect, new Request(), and fetch to throw an error when a relative path is passed.

setGlobalOrigin('http://localhost:3000')

const response = await fetch('/api/ping')

console.log(response.url) // http://localhost:3000/api/ping

undici.getGlobalOrigin()

Gets the global origin used in fetch.

Returns: URL

UrlObject

  • port string | number (optional)
  • path string (optional)
  • pathname string (optional)
  • hostname string (optional)
  • origin string (optional)
  • protocol string (optional)
  • search string (optional)

Specification Compliance

This section documents parts of the HTTP/1.1 specification that Undici does not support or does not fully implement.

Expect

Undici does not support the Expect request header field. The request body is always immediately sent and the 100 Continue response will be ignored.

Refs: https://tools.ietf.org/html/rfc7231#section-5.1.1

Pipelining

Undici will only use pipelining if configured with a pipelining factor greater than 1.

Undici always assumes that connections are persistent and will immediately pipeline requests, without checking whether the connection is persistent. Hence, automatic fallback to HTTP/1.0 or HTTP/1.1 without pipelining is not supported.

Undici will immediately pipeline when retrying requests after a failed connection. However, Undici will not retry the first remaining requests in the prior pipeline and instead error the corresponding callback/promise/stream.

Undici will abort all running requests in the pipeline when any of them are aborted.

Manual Redirect

Since it is not possible to manually follow an HTTP redirect on the server-side, Undici returns the actual response instead of an opaqueredirect filtered one when invoked with a manual redirect. This aligns fetch() with the other implementations in Deno and Cloudflare Workers.

Refs: https://fetch.spec.whatwg.org/#atomic-http-redirect-handling

Workarounds

Network address family autoselection.

If you experience problem when connecting to a remote server that is resolved by your DNS servers to a IPv6 (AAAA record) first, there are chances that your local router or ISP might have problem connecting to IPv6 networks. In that case undici will throw an error with code UND_ERR_CONNECT_TIMEOUT.

If the target server resolves to both a IPv6 and IPv4 (A records) address and you are using a compatible Node version (18.3.0 and above), you can fix the problem by providing the autoSelectFamily option (support by both undici.request and undici.Agent) which will enable the family autoselection algorithm when establishing the connection.

Collaborators

Releasers

License

MIT

More Repositories

1

node

Node.js JavaScript runtime ✨🐢🚀✨
JavaScript
97,973
star
2

node-v0.x-archive

Moved to https://github.com/nodejs/node
34,533
star
3

node-gyp

Node.js native addon build tool
Python
9,275
star
4

docker-node

Official Docker Image for Node.js 🐳 🐢 🚀
Dockerfile
7,872
star
5

http-parser

http request/response parser for c
C
6,223
star
6

nodejs.org

The Node.js® Website
TypeScript
5,819
star
7

Release

Node.js Release Working Group
3,803
star
8

nan

Native Abstractions for Node.js
C++
3,245
star
9

node-addon-examples

Node.js C++ addon examples from http://nodejs.org/docs/latest/api/addons.html
C++
2,332
star
10

nodejs.dev

A redesign of Nodejs.org built using Gatsby.js with React.js, TypeScript, and Remark.
TypeScript
2,297
star
11

corepack

Zero-runtime-dependency package acting as bridge between Node projects and their package managers
TypeScript
2,150
star
12

node-addon-api

Module for using Node-API from C++
C++
1,999
star
13

node-chakracore

Node.js on ChakraCore ✨🐢🚀✨
JavaScript
1,919
star
14

node-convergence-archive

Archive for node/io.js convergence work pre-3.0.0
JavaScript
1,837
star
15

llhttp

Port of http_parser to llparse
TypeScript
1,552
star
16

help

✨ Need help with Node.js? File an Issue here. 🚀
1,427
star
17

llnode

An lldb plugin for Node.js and V8, which enables inspection of JavaScript states for insights into Node.js processes and their core dumps.
C++
1,140
star
18

readable-stream

Node-core streams for userland
JavaScript
1,003
star
19

examples

A repository of runnable Node.js examples that go beyond "hello, world!"
JavaScript
589
star
20

mentorship

Node.js Mentorship Program Initiative
587
star
21

llparse

Generating parsers in LLVM IR
TypeScript
567
star
22

TSC

The Node.js Technical Steering Committee
JavaScript
557
star
23

citgm

Canary in the Gold Mine
JavaScript
539
star
24

http2

Working on an HTTP/2 implementation for Node.js Core
JavaScript
520
star
25

diagnostics

Node.js Diagnostics Working Group
513
star
26

security-wg

Node.js Ecosystem Security Working Group
JavaScript
482
star
27

build

Better build and test infra for Node.
Shell
469
star
28

next-10

Repository for discussion on strategic directions for next 10 years of Node.js
462
star
29

node-eps

Node.js Enhancement Proposals for discussion on future API additions/changes to Node core
446
star
30

education

A place to discover and contribute to education initiatives in Node.js
417
star
31

modules

Node.js Modules Team
413
star
32

package-maintenance

Repository for work for discussion of helping with maintenance of key packages in the ecosystem.
403
star
33

nodejs-zh-CN

node.js 中文化 & 中文社区
SCSS
395
star
34

node-v8

Experimental Node.js mirror on V8 lkgr ✨🐢🚀✨
Shell
392
star
35

performance

Node.js team focusing on performance
363
star
36

node-inspect

Code that's now part of node, previously `node debug` for `node --inspect`
JavaScript
339
star
37

node-report

Delivers a human-readable diagnostic summary, written to file.
C++
327
star
38

quic

This repository is no longer active.
JavaScript
298
star
39

nodejs-ko

node.js 한국 커뮤니티
Stylus
262
star
40

single-executable

This team aims to advance the state of the art in packaging Node.js applications as single standalone executables (SEAs) on all supported operating systems.
260
star
41

community-committee

The Node.js Community Committee (aka CommComm)
259
star
42

github-bot

@nodejs-github-bot's heart and soul
JavaScript
259
star
43

evangelism

Letting the world know how awesome Node.js is and how to get involved!
242
star
44

abi-stable-node

Repository used by the Node-API team to manage work related to Node-API and node-addon-api
JavaScript
239
star
45

abi-stable-node-addon-examples

Node Add-on Examples with PoC ABI stable API for native modules
C++
238
star
46

node-core-utils

CLI tools for Node.js Core collaborators
JavaScript
228
star
47

changelog-maker

A git log to CHANGELOG.md tool
JavaScript
225
star
48

iojs.org

JavaScript
219
star
49

uvwasi

WASI syscall API built atop libuv
C
217
star
50

unofficial-builds

Unofficial binaries for Node.js
Shell
215
star
51

cjs-module-lexer

Fast lexer to extract named exports via analysis from CommonJS modules
JavaScript
210
star
52

installer

Electron based installer for Node.js.
JavaScript
194
star
53

getting-started

Getting started in Node.js!
187
star
54

web-server-frameworks

A place for Node.js Web-Server Framework authors and users to collaborate
179
star
55

repl

REPL rewrite for Node.js ✨🐢🚀✨
JavaScript
170
star
56

snap

Node.js snap source and updater
Shell
166
star
57

tooling

Advancing Node.js as a framework for writing great tools
164
star
58

code-and-learn

A series of workshop sprints for Node.js.
Dockerfile
163
star
59

benchmarking

Node.js Benchmarking Working Group
Shell
161
star
60

docker-iojs

Official Docker images from the io.js project
Shell
156
star
61

i18n

The Node.js Internationalization Working Group – A Community Committee initiative.
150
star
62

full-icu-npm

convenience loader for 'small-icu' node builds
JavaScript
150
star
63

postject

Easily inject arbitrary read-only resources into executable formats (Mach-O, PE, ELF) and use it at runtime.
JavaScript
148
star
64

admin

Administrative space for policies of the TSC
146
star
65

roadmap

This repository and working group has been retired.
135
star
66

gyp-next

A fork of the GYP build system for use in the Node.js projects
Python
120
star
67

nodejs-pt

Internacionalização & tradução para português referente ao site nodejs.org
108
star
68

dev-policy

node-foundation dev policy **draft**
108
star
69

promises

Promises Working Group Repository
107
star
70

loaders

ECMAScript Modules Loaders
107
star
71

nodejs-zh-TW

Node.js zh-TW
CSS
107
star
72

NG

Next Generation JavaScript IO Platform
103
star
73

nodejs-ja

Node.js 日本語ローカリゼーション
101
star
74

nodejs.org-archive

[DEPRECATED] Website repository for the Node.js project
Nginx
101
star
75

website-redesign

Facilitating the redesign of the nodejs.org website
99
star
76

node-core-test

Node 18's node:test, as an npm package
JavaScript
90
star
77

worker

Figuring out native (Web?)Worker support for Node
JavaScript
87
star
78

post-mortem

This WG is in the process of being folded into the Diagnostics WG.
85
star
79

inclusivity

Improving inclusivity in the node community
80
star
80

CTC

Node.js Core Technical Committee & Collaborators
80
star
81

nodejs-ru

Перевод io.js на русский язык
JavaScript
79
star
82

ecmascript-modules

A fork of Node.js to hash out ideas related to ESModules
JavaScript
72
star
83

docs

A place for documentation. (this repository is inactive)
71
star
84

webcrypto

This repository has been archived. The WebCrypto API has been implemented in recent versions of Node.js and does not require additional packages.
JavaScript
68
star
85

automation

Better automation for the Node.js project
66
star
86

api

API WG
61
star
87

email

MX server management for iojs.org (and eventually nodejs.org)
JavaScript
59
star
88

user-feedback

Node.js User Feedback Initiative
56
star
89

board

The Node Foundation Board of Directors
JavaScript
52
star
90

logos

Logo ideas
51
star
91

promise-use-cases

Short lived repository in order to discuss Node.js promise use cases in Collaborator Summit Berlin 2018
JavaScript
50
star
92

branch-diff

A tool to list print the commits on one git branch that are not on another using loose comparison
JavaScript
49
star
93

loaders-test

Examples demonstrating the Node.js ECMAScript Modules Loaders API
JavaScript
48
star
94

core-validate-commit

Validate commit messages for Node.js core
JavaScript
48
star
95

open-standards

Node.js Open Standards Team
43
star
96

version-management

Discussion Group for Version Management
42
star
97

hardware

Hardware Working Group
42
star
98

security-advisories

Security advisories for Node.js and the JavaScript ecosystem.
JavaScript
41
star
99

whatwg-stream

WIP Official support for WHATWG Stream in Node.js
37
star
100

vm

Repository for Discussion / Working on Multi-VM Related Issues and Ideas for Node.js
35
star