• Stars
    star
    157
  • Rank 238,399 (Top 5 %)
  • Language
    JavaScript
  • License
    MIT License
  • Created about 7 years ago
  • Updated almost 2 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Fastify compression utils

@fastify/compress

CI NPM version js-standard-style

Adds compression utils to the Fastify reply object and a hook to decompress requests payloads. Supports gzip, deflate, and brotli.

Important note: since @fastify/compress version 4.x payloads that are compressed using the zip algorithm are not automatically uncompressed anymore. @fastify/compress main feature is to provide response compression mechanism to your server, however the zip format does not appear in the IANA maintained Table of Content Encodings and thus such behavior was out of the scope of this plugin.

Install

npm i @fastify/compress

Usage - Compress replies

This plugin adds two functionalities to Fastify: a compress utility and a global compression hook.

Currently, the following encoding tokens are supported, using the first acceptable token in this order:

  1. br
  2. gzip
  3. deflate
  4. * (no preference — @fastify/compress will use gzip)
  5. identity (no compression)

If an unsupported encoding is received or if the 'accept-encoding' header is missing, it will not compress the payload. If an unsupported encoding is received and you would like to return an error, provide an onUnsupportedEncoding option.

The plugin automatically decides if a payload should be compressed based on its content-type; if no content type is present, it will assume application/json.

Global hook

The global compression hook is enabled by default. To disable it, pass the option { global: false }:

await fastify.register(
  import('@fastify/compress'),
  { global: false }
)

Remember that thanks to the Fastify encapsulation model, you can set a global compression, but run it only in a subset of routes if you wrap them inside a plugin.

Important note! If you are using @fastify/compress plugin together with @fastify/static plugin, you must register the @fastify/compress (with global hook) before registering @fastify/static.

Per Route options

You can specify different options for compression per route by passing in the compress options on the route's configuration.

await fastify.register(
  import('@fastify/compress'),
  { global: false }
)

// only compress if the payload is above a certain size and use brotli
fastify.get('/custom-route', {
  compress: {
    inflateIfDeflated: true,
    threshold: 128,
    zlib: {
      createBrotliCompress: () => createYourCustomBrotliCompress(),
      createGzip: () => createYourCustomGzip(),
      createDeflate: () => createYourCustomDeflate()
    }
  }, (req, reply) => {
    // ...
  })

Note: Setting compress = false on any route will disable compression on the route even if global compression is enabled.

reply.compress

This plugin adds a compress method to reply that accepts a stream or a string, and compresses it based on the accept-encoding header. If a JS object is passed in, it will be stringified to JSON. Note that the compress method is configured with either the per route parameters if the route has a custom configuration or with the global parameters if the the route has no custom parameters but the plugin was defined as global.

import fs from 'fs'
import fastify from 'fastify'

const app = fastify()
await app.register(import('@fastify/compress'), { global: false })

app.get('/', (req, reply) => {
  reply
    .type('text/plain')
    .compress(fs.createReadStream('./package.json'))
})

await app.listen({ port: 3000 })

Compress Options

threshold

The minimum byte size for a response to be compressed. Defaults to 1024.

await fastify.register(
  import('@fastify/compress'),
  { threshold: 2048 }
)

customTypes

mime-db is used to determine if a content-type should be compressed. You can compress additional content types via regular expression or by providing a function.

await fastify.register(
  import('@fastify/compress'),
  { customTypes: /x-protobuf$/ }
)

or

await fastify.register(
  import('@fastify/compress'),
  { customTypes: contentType => contentType.endsWith('x-protobuf') }
)

onUnsupportedEncoding

When the encoding is not supported, a custom error response can be sent in place of the uncompressed payload by setting the onUnsupportedEncoding(encoding, request, reply) option to be a function that can modify the reply and return a string | Buffer | Stream | Error payload.

await fastify.register(
  import('@fastify/compress'),
  {
    onUnsupportedEncoding: (encoding, request, reply) => {
      reply.code(406)
      return 'We do not support the ' + encoding + ' encoding.'
    }
  }
)

Disable compression by header

You can selectively disable response compression by using the x-no-compression header in the request.

Inflate pre-compressed bodies for clients that do not support compression

Optional feature to inflate pre-compressed data if the client does not include one of the supported compression types in its accept-encoding header.

await fastify.register(
  import('@fastify/compress'),
  { inflateIfDeflated: true }
)

fastify.get('/file', (req, reply) =>
  // will inflate the file  on the way out for clients
  // that indicate they do not support compression
  reply.send(fs.createReadStream('./file.gz')))

Customize encoding priority

By default, @fastify/compress prioritizes compression as described at the beginning of §Usage - Compress replies. You can change that by passing an array of compression tokens to the encodings option:

await fastify.register(
  import('@fastify/compress'),
  // Only support gzip and deflate, and prefer deflate to gzip
  { encodings: ['deflate', 'gzip'] }
)

brotliOptions and zlibOptions

You can tune compression by setting the brotliOptions and zlibOptions properties. These properties are passed directly to native node zlib methods, so they should match the corresponding class definitions.

  server.register(fastifyCompress, {
    brotliOptions: {
      params: {
        [zlib.constants.BROTLI_PARAM_MODE]: zlib.constants.BROTLI_MODE_TEXT, // useful for APIs that primarily return text
        [zlib.constants.BROTLI_PARAM_QUALITY]: 4, // default is 11, max is 11, min is 0
      },
    },
    zlibOptions: {
      level: 6, // default is typically 6, max is 9, min is 0
    }
  });

Manage Content-Length header removal with removeContentLengthHeader

By default, @fastify/compress removes the reply Content-Length header. You can change that by setting the removeContentLengthHeader to false either on a global scope or on a route specific scope.

  // Global plugin scope
  await server.register(fastifyCompress, { global: true, removeContentLengthHeader: false });

  // Route specific scope
  fastify.get('/file', {
    compress: { removeContentLengthHeader: false }
  }, (req, reply) =>
    reply.compress(fs.createReadStream('./file.gz'))
  )

Usage - Decompress request payloads

This plugin adds a preParsing hook that decompress the request payload according to the content-encoding request header.

Currently, the following encoding tokens are supported:

  1. br
  2. gzip
  3. deflate

If an unsupported encoding or and invalid payload is received, the plugin will throw an error.

If the request header is missing, the plugin will not do anything and yield to the next hook.

Global hook

The global request decompression hook is enabled by default. To disable it, pass the option { global: false }:

await fastify.register(
  import('@fastify/compress'),
  { global: false }
)

Remember that thanks to the Fastify encapsulation model, you can set a global decompression, but run it only in a subset of routes if you wrap them inside a plugin.

Per Route options

You can specify different options for decompression per route by passing in the decompress options on the route's configuration.

await fastify.register(
  import('@fastify/compress'),
  { global: false }
)

// Always decompress using gzip
fastify.get('/custom-route', {
  decompress: {
    forceRequestEncoding: 'gzip',
    zlib: {
      createBrotliDecompress: () => createYourCustomBrotliDecompress(),
      createGunzip: () => createYourCustomGunzip(),
      createInflate: () => createYourCustomInflate()
    }
  }
}, (req, reply) => {
    // ...
  })

requestEncodings

By default, @fastify/compress accepts all encodings specified at the beginning of §Usage - Decompress request payloads. You can change that by passing an array of compression tokens to the requestEncodings option:

await fastify.register(
  import('@fastify/compress'),
  // Only support gzip
  { requestEncodings: ['gzip'] }
)

forceRequestEncoding

By default, @fastify/compress chooses the decompressing algorithm by looking at the content-encoding header, if present.

You can force one algorithm and ignore the header at all by providing the forceRequestEncoding option.

Note that if the request payload is not compressed, @fastify/compress will try to decompress, resulting in an error.

onUnsupportedRequestEncoding

When the request payload encoding is not supported, you can customize the response error by setting the onUnsupportedEncoding(request, encoding) option to be a function that returns an error.

await fastify.register(
  import('@fastify/compress'),
  {
     onUnsupportedRequestEncoding: (request, encoding) => {
      return {
        statusCode: 415,
        code: 'UNSUPPORTED',
        error: 'Unsupported Media Type',
        message: 'We do not support the ' + encoding + ' encoding.'
      }
    }
  }
)

onInvalidRequestPayload

When the request payload cannot be decompressed using the detected algorithm, you can customize the response error setting the onInvalidRequestPayload(request, encoding) option to be a function that returns an error.

await fastify.register(
  import('@fastify/compress'),
  {
    onInvalidRequestPayload: (request, encoding, error) => {
      return {
        statusCode: 400,
        code: 'BAD_REQUEST',
        error: 'Bad Request',
        message: 'This is not a valid ' + encoding + ' encoded payload: ' + error.message
      }
    }
  }
)

Note

Please note that in large-scale scenarios, you should use a proxy like Nginx to handle response compression.

Acknowledgements

Past sponsors:

License

Licensed under MIT.

More Repositories

1

fastify

Fast and low overhead web framework, for Node.js
JavaScript
31,474
star
2

fast-json-stringify

2x faster than JSON.stringify()
JavaScript
3,463
star
3

fastify-dx

Archived
JavaScript
901
star
4

fastify-vite

Fastify plugin for Vite integration
JavaScript
882
star
5

fastify-cli

Run a Fastify application with one command!
JavaScript
644
star
6

fastify-swagger

Swagger documentation generator for Fastify
JavaScript
643
star
7

benchmarks

Fast and low overhead web framework fastify benchmarks.
JavaScript
502
star
8

aws-lambda-fastify

Insipired by aws-serverless-express to work with Fastify with inject functionality.
JavaScript
497
star
9

fluent-json-schema

A fluent API to generate JSON schemas
JavaScript
496
star
10

fastify-nextjs

React server side rendering support for Fastify with Next
JavaScript
450
star
11

fastify-sensible

Defaults for Fastify that everyone can agree on
JavaScript
448
star
12

fastify-static

Plugin for serving static files as fast as possible
JavaScript
420
star
13

avvio

Asynchronous bootstrapping of Node applications
JavaScript
407
star
14

fastify-multipart

Multipart support for Fastify
JavaScript
343
star
15

fastify-jwt

JWT utils for Fastify
JavaScript
340
star
16

fastify-rate-limit

A low overhead rate limiter for your routes
JavaScript
335
star
17

fastify-http-proxy

Proxy your http requests to another server, with hooks.
JavaScript
332
star
18

fastify-helmet

Important security headers for Fastify
JavaScript
305
star
19

fastify-websocket

basic websocket support for fastify
JavaScript
290
star
20

fastify-cors

Fastify CORS
JavaScript
276
star
21

point-of-view

Template rendering plugin for Fastify
JavaScript
272
star
22

fastify-example-twitter

Fastify example - clone twitter
JavaScript
270
star
23

fastify-auth

Run multiple auth functions in Fastify
JavaScript
268
star
24

docs-chinese

Fastify 中文文档
259
star
25

fastify-passport

Use passport strategies for authentication within a fastify application
TypeScript
248
star
26

fastify-cookie

A Fastify plugin to add cookies support
JavaScript
243
star
27

light-my-request

Fake HTTP injection library
JavaScript
243
star
28

fastify-oauth2

Enable to perform login using oauth2 protocol
JavaScript
243
star
29

fastify-autoload

Require all plugins in a directory
JavaScript
242
star
30

under-pressure

Measure process load with automatic handling of "Service Unavailable" plugin for Fastify.
JavaScript
234
star
31

middie

Middleware engine for Fastify.
JavaScript
206
star
32

fastify-mongodb

Fastify MongoDB connection plugin
JavaScript
200
star
33

fastify-env

Fastify plugin to check environment variables
JavaScript
194
star
34

fastify-express

Express compatibility layer for Fastify
JavaScript
190
star
35

fastify-caching

A Fastify plugin to facilitate working with cache headers
JavaScript
181
star
36

secure-json-parse

JSON.parse() drop-in replacement with prototype poisoning protection
JavaScript
176
star
37

fast-proxy

Node.js framework agnostic library that enables you to forward an http request to another HTTP server. Supported protocols: HTTP, HTTPS, HTTP2
JavaScript
162
star
38

fastify-plugin

Plugin helper for Fastify
JavaScript
159
star
39

env-schema

Validate your env variable using Ajv and dotenv
JavaScript
154
star
40

github-action-merge-dependabot

This action automatically approves and merges dependabot PRs.
JavaScript
152
star
41

fastify-type-provider-typebox

A Type Provider for Typebox
TypeScript
151
star
42

fastify-redis

Plugin to share a common Redis connection across Fastify.
JavaScript
151
star
43

fastify-reply-from

fastify plugin to forward the current http request to another server
JavaScript
149
star
44

fastify-bearer-auth

A Fastify plugin to require bearer Authorization headers
JavaScript
148
star
45

fastify-request-context

Request-scoped storage support, based on Asynchronous Local Storage (with fallback to cls-hooked)
JavaScript
146
star
46

fastify-secure-session

Create a secure stateless cookie session for Fastify
JavaScript
145
star
47

fastify-postgres

Fastify PostgreSQL connection plugin
JavaScript
145
star
48

csrf-protection

A fastify csrf plugin.
JavaScript
144
star
49

fastify-swagger-ui

Serve Swagger-UI for Fastify
JavaScript
129
star
50

fastify-formbody

A Fastify plugin to parse x-www-form-urlencoded bodies
JavaScript
127
star
51

fastify-circuit-breaker

A low overhead circuit breaker for your routes
JavaScript
113
star
52

session

Session plugin for fastify
JavaScript
104
star
53

create-fastify

Rapidly generate a Fastify project
JavaScript
98
star
54

example

Runnable examples of Fastify
JavaScript
96
star
55

fastify-routes

Decorates fastify instance with a map of routes
JavaScript
91
star
56

fastify-awilix

Dependency injection support for fastify
JavaScript
90
star
57

fastify-schedule

Fastify plugin for scheduling periodic jobs.
JavaScript
88
star
58

restartable

Restart Fastify without losing a request
JavaScript
86
star
59

busboy

A streaming parser for HTML form data for node.js
JavaScript
76
star
60

fastify-error

JavaScript
74
star
61

fastify-funky

Make fastify functional! Plugin, adding support for fastify routes returning functional structures, such as Either, Task or plain parameterless function.
JavaScript
74
star
62

fast-uri

Dependency free RFC 3986 URI toolbox
JavaScript
74
star
63

fastify-hotwire

Use the Hotwire pattern with Fastify
JavaScript
74
star
64

website-metalsmith

This project is used to build the website for fastify web framework and publish it online.
HTML
73
star
65

fastify-etag

Automatically generate etags for HTTP responses, for Fastify
JavaScript
69
star
66

fastify-accepts

Add accepts parser to fastify
JavaScript
67
star
67

fastify-mysql

JavaScript
66
star
68

fastify-example-todo

A Simple Fastify REST API Example
JavaScript
64
star
69

help

Need help with Fastify? File an Issue here.
61
star
70

fastify-basic-auth

Fastify basic auth plugin
JavaScript
59
star
71

fastify-url-data

A plugin to provide access to the raw URL components
JavaScript
57
star
72

releasify

A tool to release in a simpler way your module
JavaScript
55
star
73

fastify-kafka

Fastify plugin to interact with Apache Kafka.
JavaScript
52
star
74

fastify-routes-stats

provide stats for routes using perf_hooks, for fastify
JavaScript
45
star
75

fastify-elasticsearch

Fastify plugin for Elasticsearch
JavaScript
41
star
76

deepmerge

Merges the enumerable properties of two or more objects deeply. Fastest implementation of deepmerge
JavaScript
39
star
77

fastify-response-validation

A simple plugin that enables response validation for Fastify.
JavaScript
36
star
78

fastify-type-provider-json-schema-to-ts

A Type Provider for json-schema-to-ts
TypeScript
36
star
79

skeleton

Template repository to create standardized Fastify plugins.
35
star
80

fastify-accepts-serializer

Serializer according to the accept header
JavaScript
25
star
81

website

JavaScript
24
star
82

fastify-flash

Flash message plugin for Fastify
TypeScript
24
star
83

tsconfig

Shared TypeScript configuration for fastify projects
22
star
84

fastify-leveldb

Plugin to share a common LevelDB connection across Fastify.
JavaScript
21
star
85

docs-korean

19
star
86

process-warning

A small utility for creating warnings and emitting them.
JavaScript
19
star
87

fastify-diagnostics-channel

Plugin to deal with diagnostics_channel on Fastify
JavaScript
19
star
88

one-line-logger

JavaScript
18
star
89

ajv-compiler

Build and manage the AJV instances for the fastify framework
JavaScript
17
star
90

fastify-early-hints

Draft plugin of the HTTP 103 implementation
JavaScript
17
star
91

vite-plugin-blueprint

Vite plugin for shadowing files from a blueprint folder.
JavaScript
17
star
92

fastify-throttle

Throttle the download speed of a request
JavaScript
15
star
93

fastify-bankai

Bankai assets compiler for Fastify
JavaScript
15
star
94

csrf

CSRF utilities for fastify
JavaScript
13
star
95

.github

Default community health files
13
star
96

any-schema-you-like

Save multiple schemas and decide which one to use to serialize the payload
JavaScript
13
star
97

docs-portuguese

Portuguese docs for Fastify
11
star
98

fastify-typescript-extended-sample

This project is supposed to be a large, fake Fastify & TypeScript app. It is meant to be a reference as well as a pseudo-sandbox for Fastify TypeScript changes.
TypeScript
11
star
99

fastify-soap-client

Fastify plugin for a SOAP client
JavaScript
10
star
100

workflows

Reusable workflows for use in the Fastify organization
9
star