• Stars
    star
    512
  • Rank 83,009 (Top 2 %)
  • Language
    TypeScript
  • License
    Apache License 2.0
  • Created almost 7 years ago
  • Updated 7 days ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Node.js client for Google Cloud Pub/Sub: Ingest event streams from anywhere, at any scale, for simple, reliable, real-time stream analytics.

Google Cloud Platform logo

Google Cloud Pub/Sub: Node.js Client

release level npm version

Cloud Pub/Sub is a fully-managed real-time messaging service that allows you to send and receive messages between independent applications.

This document contains links to an API reference, samples, and other resources useful to developing Node.js applications. For additional help developing Pub/Sub applications, in Node.js and other languages, see our Pub/Sub quickstart, publisher, and subscriber guides.

A comprehensive list of changes in each version may be found in the CHANGELOG.

Read more about the client libraries for Cloud APIs, including the older Google APIs Client Libraries, in Client Libraries Explained.

Table of contents:

Quickstart

Before you begin

  1. Select or create a Cloud Platform project.
  2. Enable billing for your project.
  3. Enable the Google Cloud Pub/Sub API.
  4. Set up authentication with a service account so you can access the API from your local workstation.

Installing the client library

npm install @google-cloud/pubsub

Using the client library

// Imports the Google Cloud client library
const {PubSub} = require('@google-cloud/pubsub');

async function quickstart(
  projectId = 'your-project-id', // Your Google Cloud Platform project ID
  topicNameOrId = 'my-topic', // Name for the new topic to create
  subscriptionName = 'my-sub' // Name for the new subscription to create
) {
  // Instantiates a client
  const pubsub = new PubSub({projectId});

  // Creates a new topic
  const [topic] = await pubsub.createTopic(topicNameOrId);
  console.log(`Topic ${topic.name} created.`);

  // Creates a subscription on that new topic
  const [subscription] = await topic.createSubscription(subscriptionName);

  // Receive callbacks for new messages on the subscription
  subscription.on('message', message => {
    console.log('Received message:', message.data.toString());
    process.exit(0);
  });

  // Receive callbacks for errors on the subscription
  subscription.on('error', error => {
    console.error('Received error:', error);
    process.exit(1);
  });

  // Send a message to the topic
  topic.publishMessage({data: Buffer.from('Test message!')});
}

Running gRPC C++ bindings

For some workflows and environments it might make sense to use the C++ gRPC implementation, instead of the default one (see: #770):

To configure @google-cloud/pubsub to use an alternative grpc transport:

  1. npm install grpc, adding grpc as a dependency.

  2. instantiate @google-cloud/pubsub with grpc:

    const {PubSub} = require('@google-cloud/pubsub');
    const grpc = require('grpc');
    const pubsub = new PubSub({grpc});

Samples

Samples are in the samples/ directory. Each sample's README.md has instructions for running its sample.

Sample Source Code Try it
Create an Avro based Schema source code Open in Cloud Shell
Create BigQuery Subscription source code Open in Cloud Shell
Create a Proto based Schema source code Open in Cloud Shell
Create Push Subscription source code Open in Cloud Shell
Create Subscription source code Open in Cloud Shell
Create Subscription With Dead Letter Policy source code Open in Cloud Shell
Create an exactly-once delivery subscription source code Open in Cloud Shell
Create Subscription With Filtering source code Open in Cloud Shell
Create Subscription with ordering enabled source code Open in Cloud Shell
Create Subscription With Retry Policy source code Open in Cloud Shell
Create Topic source code Open in Cloud Shell
Create Topic With Schema source code Open in Cloud Shell
Delete a previously created schema source code Open in Cloud Shell
Delete Subscription source code Open in Cloud Shell
Delete Topic source code Open in Cloud Shell
Detach Subscription source code Open in Cloud Shell
Get a previously created schema source code Open in Cloud Shell
Get Subscription source code Open in Cloud Shell
Get Subscription Policy source code Open in Cloud Shell
Get Topic Policy source code Open in Cloud Shell
List All Topics source code Open in Cloud Shell
List schemas on a project source code Open in Cloud Shell
List Subscriptions source code Open in Cloud Shell
List Subscriptions On a Topic source code Open in Cloud Shell
Listen For Avro Records source code Open in Cloud Shell
Listen For Errors source code Open in Cloud Shell
Listen For Messages source code Open in Cloud Shell
Listen with exactly-once delivery source code Open in Cloud Shell
Listen For Protobuf Messages source code Open in Cloud Shell
Listen For Messages With Custom Attributes source code Open in Cloud Shell
Modify Push Configuration source code Open in Cloud Shell
OpenTelemetry Tracing source code Open in Cloud Shell
Publish Avro Records to a Topic source code Open in Cloud Shell
Publish Batched Messages source code Open in Cloud Shell
Publish Message source code Open in Cloud Shell
Publish Message With Custom Attributes source code Open in Cloud Shell
Publish Ordered Message source code Open in Cloud Shell
Publish Protobuf Messages to a Topic source code Open in Cloud Shell
Publish with flow control source code Open in Cloud Shell
Publish With Retry Settings source code Open in Cloud Shell
Quickstart source code Open in Cloud Shell
Remove Dead Letter Policy source code Open in Cloud Shell
Resume Publish source code Open in Cloud Shell
Set Subscription IAM Policy source code Open in Cloud Shell
Set Topic IAM Policy source code Open in Cloud Shell
Subscribe With Flow Control Settings source code Open in Cloud Shell
Synchronous Pull source code Open in Cloud Shell
Synchronous Pull with delivery attempt. source code Open in Cloud Shell
Synchronous Pull With Lease Management source code Open in Cloud Shell
Test Subscription Permissions source code Open in Cloud Shell
Test Topic Permissions source code Open in Cloud Shell
Update Dead Letter Policy source code Open in Cloud Shell
Validate a schema definition source code Open in Cloud Shell

The Google Cloud Pub/Sub Node.js Client API Reference documentation also contains samples.

Supported Node.js Versions

Our client libraries follow the Node.js release schedule. Libraries are compatible with all current active and maintenance versions of Node.js. If you are using an end-of-life version of Node.js, we recommend that you update as soon as possible to an actively supported LTS version.

Google's client libraries support legacy versions of Node.js runtimes on a best-efforts basis with the following warnings:

  • Legacy versions are not tested in continuous integration.
  • Some security patches and features cannot be backported.
  • Dependencies cannot be kept up-to-date.

Client libraries targeting some end-of-life versions of Node.js are available, and can be installed through npm dist-tags. The dist-tags follow the naming convention legacy-(version). For example, npm install @google-cloud/pubsub@legacy-8 installs client libraries for versions compatible with Node.js 8.

Versioning

This library follows Semantic Versioning.

This library is considered to be stable. The code surface will not change in backwards-incompatible ways unless absolutely necessary (e.g. because of critical security issues) or with an extensive deprecation period. Issues and requests against stable libraries are addressed with the highest priority.

More Information: Google Cloud Platform Launch Stages

Contributing

Contributions welcome! See the Contributing Guide.

Please note that this README.md, the samples/README.md, and a variety of configuration files in this repository (including .nycrc and tsconfig.json) are generated from a central template. To edit one of these files, make an edit to its templates in directory.

License

Apache Version 2.0

See LICENSE

More Repositories

1

google-api-nodejs-client

Google's officially supported Node.js client library for accessing Google APIs. Support for authorization and authentication with OAuth 2.0, API Keys and JWT (Service Tokens) is included.
TypeScript
11,170
star
2

google-api-php-client

A PHP client library for accessing Google APIs
PHP
8,706
star
3

google-api-python-client

๐Ÿ The official Python client library for Google's discovery based APIs.
Python
6,858
star
4

googleapis

Public interface definitions of Google APIs.
Starlark
6,512
star
5

google-cloud-python

Google Cloud Client Library for Python
Python
4,324
star
6

release-please

generate release PRs based on the conventionalcommits.org spec
TypeScript
4,099
star
7

google-api-go-client

Auto-generated Google APIs for Go.
Go
3,572
star
8

google-cloud-go

Google Cloud Client Libraries for Go.
Go
3,361
star
9

google-api-ruby-client

REST client for Google APIs
Ruby
2,679
star
10

google-cloud-node

Google Cloud Client Library for Node.js
TypeScript
2,654
star
11

google-cloud-java

Google Cloud Client Library for Java
Java
1,773
star
12

google-auth-library-nodejs

๐Ÿ”‘ Google Auth Library for Node.js
TypeScript
1,549
star
13

google-http-java-client

Google HTTP Client Library for Java
Java
1,342
star
14

google-api-dotnet-client

Google APIs Client Library for .NET
C#
1,304
star
15

google-api-java-client

Google APIs Client Library for Java
Java
1,300
star
16

google-cloud-ruby

Google Cloud Client Library for Ruby
Ruby
1,293
star
17

google-auth-library-php

Google Auth Library for PHP
PHP
1,287
star
18

google-api-php-client-services

PHP
1,179
star
19

google-cloud-php

Google Cloud Client Library for PHP
PHP
1,060
star
20

google-cloud-dotnet

Google Cloud Client Libraries for .NET
C#
914
star
21

nodejs-storage

Node.js client for Google Cloud Storage: unified object storage for developers and enterprises, from live data serving to data analytics/ML to data archiving.
TypeScript
828
star
22

oauth2client

This is a Python library for accessing resources protected by OAuth 2.0.
Python
795
star
23

nodejs-dialogflow

Node.js client for Dialogflow: Design and integrate a conversational user interface into your applications and devices.
JavaScript
793
star
24

elixir-google-api

Elixir client libraries for accessing Google APIs.
Elixir
748
star
25

google-auth-library-python

Google Auth Python Library
Python
744
star
26

python-bigquery

Python
708
star
27

gaxios

An HTTP request client that provides an axios like interface over top of node-fetch. Super lightweight. Supports proxies and all sorts of other stuff.
TypeScript
692
star
28

nodejs-speech

This repository is deprecated. All of its content and history has been moved to googleapis/google-cloud-node.
684
star
29

nodejs-firestore

Node.js client for Google Cloud Firestore: a NoSQL document database built for automatic scaling, high performance, and ease of application development.
JavaScript
612
star
30

google-oauth-java-client

Google OAuth Client Library for Java
Java
601
star
31

aip

API Improvement Proposals. https://aip.dev/
Shell
593
star
32

go-genproto

Generated code for Google Cloud client libraries.
Go
558
star
33

repo-automation-bots

A collection of bots, based on probot, for performing common maintenance tasks across the open-source repos managed by Google on GitHub.
TypeScript
545
star
34

api-linter

A linter for APIs defined in protocol buffers.
Go
540
star
35

python-aiplatform

A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.
Python
524
star
36

nodejs-translate

Node.js client for Google Cloud Translate: Dynamically translate text between thousands of language pairs.
JavaScript
514
star
37

google-cloud-cpp

C++ Client Libraries for Google Cloud Services
C++
508
star
38

nodejs-vision

Node.js client for Google Cloud Vision: Derive insight from images.
TypeScript
497
star
39

google-api-java-client-services

Generated Java code for Google APIs
497
star
40

nodejs-bigquery

Node.js client for Google Cloud BigQuery: A fast, economical and fully-managed enterprise data warehouse for large-scale data analytics.
TypeScript
420
star
41

python-bigquery-pandas

Google BigQuery connector for pandas
Python
418
star
42

google-auth-library-ruby

Google Auth Library for Ruby
Ruby
417
star
43

python-bigquery-sqlalchemy

SQLAlchemy dialect for BigQuery
Python
411
star
44

google-auth-library-java

Open source Auth client library for Java
Java
400
star
45

python-dialogflow

This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dialogflow
397
star
46

python-pubsub

Python
370
star
47

signet

Signet is an OAuth 1.0 / OAuth 2.0 implementation.
Ruby
364
star
48

nodejs-text-to-speech

Node.js client for Google Cloud Text-to-Speech
JavaScript
355
star
49

python-speech

This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-speech
355
star
50

python-storage

Python
339
star
51

google-cloud-php-storage

PHP
317
star
52

google-cloud-php-core

PHP
309
star
53

gapic-generator

Tools for generating API client libraries from API Service Configuration descriptions.
Java
303
star
54

cloud-trace-nodejs

Node.js agent for Cloud Trace: automatically gather latency data about your application
TypeScript
272
star
55

gapic-generator-go

Generate Go API client libraries from Protocol Buffers.
Go
236
star
56

gax-php

Google API Extensions for PHP
PHP
226
star
57

api-common-protos

A standard library for use in specifying protocol buffer APIs.
Starlark
221
star
58

google-cloud-datastore

Low-level, Protobuf-based Java and Python client libraries for Cloud Datastore. Check out google-cloud-java and google-cloud-python first!
Python
212
star
59

python-firestore

Python
205
star
60

nodejs-datastore

Node.js client for Google Cloud Datastore: a highly-scalable NoSQL database for your web and mobile applications.
TypeScript
196
star
61

google-cloud-rust

Rust
183
star
62

google-cloud-php-translate

PHP
182
star
63

github-repo-automation

A set of tools to automate multiple GitHub repository management.
TypeScript
172
star
64

cloud-debug-nodejs

Node.js agent for Google Cloud Debugger: investigate your codeโ€™s behavior in production
TypeScript
169
star
65

google-cloud-php-firestore

PHP
168
star
66

gapic-showcase

An API that demonstrates Generated API Client (GAPIC) features and common API patterns used by Google.
Go
165
star
67

java-bigtable-hbase

Java libraries and HBase client extensions for accessing Google Cloud Bigtable
Java
165
star
68

gax-java

This library has moved to https://github.com/googleapis/sdk-platform-java/tree/main/gax-java.
162
star
69

python-vision

This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-vision
160
star
70

google-auth-library-python-oauthlib

Python
160
star
71

nodejs-logging

Node.js client for Stackdriver Logging: Store, search, analyze, monitor, and alert on log data and events from Google Cloud Platform and Amazon Web Services (AWS).
TypeScript
156
star
72

python-bigquery-dataframes

BigQuery DataFrames
Python
146
star
73

nodejs-tasks

Node.js client for Google Cloud Tasks: A fully managed service that allows you to manage the execution, dispatch and delivery of a large number of distributed tasks.
TypeScript
144
star
74

python-ndb

Python
144
star
75

common-protos-php

PHP protocol buffer classes generated from https://github.com/googleapis/api-common-protos
PHP
132
star
76

artman

Artifact Manager, a build and packaging tool for Google API client libraries.
Python
132
star
77

proto-plus-python

Beautiful, idiomatic protocol buffers in Python
Python
132
star
78

googleapis.github.io

The GitHub pages site for the googleapis organization.
HTML
131
star
79

nodejs-language

Node.js client for Google Cloud Natural Language: Derive insights from unstructured text using Google machine learning.
JavaScript
131
star
80

google-cloudevents

Types for CloudEvents issued by Google
JavaScript
130
star
81

python-analytics-data

Python
125
star
82

google-auth-library-swift

Auth client library for Swift command-line tools and cloud services. Supports OAuth1, OAuth2, and Google Application Default Credentials.
Swift
122
star
83

java-pubsub

Java
118
star
84

gapic-generator-python

Generate Python API client libraries from Protocol Buffers.
Python
116
star
85

nodejs-compute

Node.js client for Google Compute Engine: Scalable, High-Performance Virtual Machines
JavaScript
115
star
86

python-texttospeech

Python
111
star
87

nodejs-spanner

Node.js client for Google Cloud Spanner: the worldโ€™s first fully managed relational database service to offer both strong consistency and horizontal scalability.
TypeScript
111
star
88

python-translate

This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-translate
108
star
89

node-gtoken

๐Ÿ”‘ Google Auth Service Account Tokens for Node.js
TypeScript
108
star
90

python-api-core

Python
107
star
91

java-bigquery

Java
105
star
92

google-cloud-php-vision

PHP
101
star
93

gax-nodejs

Google API Extensions for Node.js
TypeScript
100
star
94

nodejs-logging-winston

Node.js client integration between Stackdriver Logging and Winston.
TypeScript
100
star
95

python-logging

Python
99
star
96

go-sql-spanner

Google Cloud Spanner driver for Go's database/sql package.
Go
98
star
97

java-firestore

Java
96
star
98

java-storage

Java
95
star
99

nodejs-bigtable

Node.js client for Google Cloud Bigtable: Google's NoSQL Big Data database service.
TypeScript
91
star
100

nodejs-secret-manager

A cloud-hosted service that provides a secure and convenient tool for storing API keys, passwords, certificates, and other sensitive data.
JavaScript
89
star