• Stars
    star
    8,422
  • Rank 4,358 (Top 0.09 %)
  • Language
    Go
  • License
    MIT License
  • Created over 11 years ago
  • Updated about 1 year ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

PostgreSQL driver and toolkit for Go

Go Reference Build Status

pgx - PostgreSQL Driver and Toolkit

pgx is a pure Go driver and toolkit for PostgreSQL.

The pgx driver is a low-level, high performance interface that exposes PostgreSQL-specific features such as LISTEN / NOTIFY and COPY. It also includes an adapter for the standard database/sql interface.

The toolkit component is a related set of packages that implement PostgreSQL functionality such as parsing the wire protocol and type mapping between PostgreSQL and Go. These underlying packages can be used to implement alternative drivers, proxies, load balancers, logical replication clients, etc.

Example Usage

package main

import (
	"context"
	"fmt"
	"os"

	"github.com/jackc/pgx/v5"
)

func main() {
	// urlExample := "postgres://username:password@localhost:5432/database_name"
	conn, err := pgx.Connect(context.Background(), os.Getenv("DATABASE_URL"))
	if err != nil {
		fmt.Fprintf(os.Stderr, "Unable to connect to database: %v\n", err)
		os.Exit(1)
	}
	defer conn.Close(context.Background())

	var name string
	var weight int64
	err = conn.QueryRow(context.Background(), "select name, weight from widgets where id=$1", 42).Scan(&name, &weight)
	if err != nil {
		fmt.Fprintf(os.Stderr, "QueryRow failed: %v\n", err)
		os.Exit(1)
	}

	fmt.Println(name, weight)
}

See the getting started guide for more information.

Features

  • Support for approximately 70 different PostgreSQL types
  • Automatic statement preparation and caching
  • Batch queries
  • Single-round trip query mode
  • Full TLS connection control
  • Binary format support for custom types (allows for much quicker encoding/decoding)
  • COPY protocol support for faster bulk data loads
  • Tracing and logging support
  • Connection pool with after-connect hook for arbitrary connection setup
  • LISTEN / NOTIFY
  • Conversion of PostgreSQL arrays to Go slice mappings for integers, floats, and strings
  • hstore support
  • json and jsonb support
  • Maps inet and cidr PostgreSQL types to netip.Addr and netip.Prefix
  • Large object support
  • NULL mapping to pointer to pointer
  • Supports database/sql.Scanner and database/sql/driver.Valuer interfaces for custom types
  • Notice response handling
  • Simulated nested transactions with savepoints

Choosing Between the pgx and database/sql Interfaces

The pgx interface is faster. Many PostgreSQL specific features such as LISTEN / NOTIFY and COPY are not available through the database/sql interface.

The pgx interface is recommended when:

  1. The application only targets PostgreSQL.
  2. No other libraries that require database/sql are in use.

It is also possible to use the database/sql interface and convert a connection to the lower-level pgx interface as needed.

Testing

See CONTRIBUTING.md for setup instructions.

Architecture

See the presentation at Golang Estonia, PGX Top to Bottom for a description of pgx architecture.

Supported Go and PostgreSQL Versions

pgx supports the same versions of Go and PostgreSQL that are supported by their respective teams. For Go that is the two most recent major releases and for PostgreSQL the major releases in the last 5 years. This means pgx supports Go 1.20 and higher and PostgreSQL 12 and higher. pgx also is tested against the latest version of CockroachDB.

Version Policy

pgx follows semantic versioning for the documented public API on stable releases. v5 is the latest stable major version.

PGX Family Libraries

pglogrepl provides functionality to act as a client for PostgreSQL logical replication.

pgmock offers the ability to create a server that mocks the PostgreSQL wire protocol. This is used internally to test pgx by purposely inducing unusual errors. pgproto3 and pgmock together provide most of the foundational tooling required to implement a PostgreSQL proxy or MitM (such as for a custom connection pooler).

tern is a stand-alone SQL migration system.

pgerrcode contains constants for the PostgreSQL error codes.

Adapters for 3rd Party Types

Adapters for 3rd Party Tracers

Adapters for 3rd Party Loggers

These adapters can be used with the tracelog package.

3rd Party Libraries with PGX Support

pgxmock is a mock library implementing pgx interfaces. pgxmock has one and only purpose - to simulate pgx behavior in tests, without needing a real database connection.

Library for scanning data from a database into Go structs and more.

A carefully designed SQL client for making using SQL easier, more productive, and less error-prone on Golang.

Adds GSSAPI / Kerberos authentication support.

Explicit data mapping and scanning library for Go structs and slices.

Type safe and flexible package for scanning database data into Go types. Supports, structs, maps, slices and custom mapping functions.

Code first migration library for native pgx (no database/sql abstraction).

More Repositories

1

tern

The SQL Fan's Migrator
Go
656
star
2

tod

Time of day and shift types for Ruby
Ruby
415
star
3

surus

PostgreSQL extensions for ActiveRecord
Ruby
395
star
4

sqlfmt

SQL Formatter
Yacc
337
star
5

pglogrepl

PostgreSQL logical replication library for Go.
Go
325
star
6

pgtype

Go
308
star
7

puddle

Generic resource pool for Go
Go
294
star
8

pgconn

Go
180
star
9

pgproto3

Go
160
star
10

pgerrcode

Package pgerrcode contains constants for PostgreSQL error codes.
Go
148
star
11

pgmock

Go
119
star
12

edge

Edge provides graph functionality to ActiveRecord.
Ruby
89
star
13

mat-view-strat-pg

Materialized View Strategies Using PostgreSQL
PLpgSQL
61
star
14

go_db_bench

Benchmarks for database/drivers from Go
Go
52
star
15

json_api_bench

Benchmark of Rails and PostgreSQL JSON generation techniques
Ruby
32
star
16

pgxlisten

pgxlisten provides higher level PostgreSQL LISTEN / NOTIFY tooling built on pgx.
Go
29
star
17

tpr

The Pithy Reader - a fast, simple, and lightweight feed aggregator and reader
Go
22
star
18

pgxutil

Go
20
star
19

pgx-top-to-bottom

HTML
18
star
20

pgxjob

pgxjob provides a job queue implementation using PostgreSQL.
Go
16
star
21

pg-custom-aggregate-grt

PostgreSQL custom aggregate greatest running total implemented in PL/pgSQL and C
PLpgSQL
16
star
22

react2fs

Run command in reaction to file system events
Go
15
star
23

chunkreader

Go
14
star
24

overload

HTTP load tester
Go
14
star
25

pgxrecord

pgxrecord is a tiny framework for CRUD operations and data mapping.
Go
14
star
26

pgx-zerolog

Go
13
star
27

pgio

Package pgio is a low-level toolkit building messages in the PostgreSQL wire protocol.
Go
12
star
28

command_model

CommandModel - when update_attributes isn't enough.
Ruby
12
star
29

booklog

Go
10
star
30

pgtocsv

pgtocsv executes a query on a PostgreSQL database and outputs the results in CSV.
Go
10
star
31

pgx-shopspring-decimal

Go
9
star
32

writable-cte-examples

Examples of Writable Common Table Expressions in PostgreSQL
Ruby
9
star
33

pgxdata

Go
9
star
34

pgx-zap

Go
9
star
35

numfmt

Number formatting in Go
Go
9
star
36

pgservicefile

pgservicefile is a parser PostgreSQL for service files (e.g. .pg_service.conf)
Go
8
star
37

pgsql

Go
8
star
38

pgx-gofrs-uuid

Go
8
star
39

go_map_vs_switch

Benchmark for Go map of functions vs. switch
Go
7
star
40

pg-extid

Go
7
star
41

go-extid

Go
7
star
42

pgundolog

pgundolog is a system for rolling back changes to a PostgreSQL database without using transactions.
PLpgSQL
7
star
43

hannibal

Experimental PostgreSQL web application server
Go
5
star
44

cavein

TCP tunnel that designed for testing applications with random connection losses
Go
5
star
45

pgxrepl

Replication client library for PostgreSQL in Go using the pgx driver
Go
5
star
46

quo_vadis

Really simple and fast HTTP Router
Go
5
star
47

text_tunnel

Use your local text editor to edit files on remote servers.
Ruby
5
star
48

pgpassfile

Go
4
star
49

csvtopg

csvtopg copies a CSV to a PostgreSQL database.
Go
4
star
50

chicagolang-feb-2015

Slides for Building Command Line Applications in Go
Go
4
star
51

go_router_tutorial

Tutorial to build a simple HTTP router in Go
Go
4
star
52

doublecheck

Doublecheck your database before it is too late
Go
4
star
53

why-pgx

Slides for lightning talk on pgx
4
star
54

gel

Go Compiled Templates
Go
3
star
55

ego

Experimental shorthand for Go error handling.
Go
3
star
56

pgx_notify_lost_connection

Test for PGX WaitForNotification when connection is lost
Go
3
star
57

pigeon-exp-xmlpp

Experimenting with pigeon PEG generator for Go
Go
3
star
58

doublecheck_view

Ruby gem for integrating doublecheck view pattern with database integration tests
Ruby
3
star
59

envconf

Envconf is a simple, zero dependency library for managing configuration from the environment.
Go
3
star
60

cachet

The cache for all your Ts
Go
2
star
61

go-hello

Go program to practice packaging
Go
2
star
62

pgxsql

Go
2
star
63

flex

Go
2
star
64

cgol-rust

Quick, experimental port of Go cgol to Rust
Rust
2
star
65

assert_db_rejects

Test database level constraints with ActiveRecord
Ruby
2
star
66

dailyprogrammer

Go
2
star
67

imperator

Imperator is an imperative normalization and validation library for Go.
Go
2
star
68

pg95-whats-new

What's new in PostgreSQL 9.5
PLpgSQL
2
star
69

go-intro

Quick introduction to Go -- sample project and speaker notes
Go
2
star
70

pgxbench

PLSQL
2
star
71

react2fs-deb

react2fs Debian package
Go
2
star
72

sadpath

sadpath provides a simple way to centralize error handling and reduce boilerplate.
Go
2
star
73

ppg

ppg runs a SQL file multiple times in parallel
Go
2
star
74

box

Go
2
star
75

tern-deb

Build scripts for debian package for tern
Go
2
star
76

sqlfmt-deb

sqlfmt Debian package
Go
2
star
77

ctxio

Go
2
star
78

jchat

Go
2
star
79

exp-go-repl

Experimenting with yacc
Go
2
star
80

webby-template-minimal-website

Minimal possible website template for Webby
2
star
81

go-server-closed-tcp-conn-os-inconsistencies

Example of differing server closed TCP connections on Linux and Windows
2
star
82

form

HTTP forms for Go
Go
2
star
83

tpr-deb

The Pithy Reader Debian Package
Go
2
star
84

mp

mp (map parser) provides a parser that parses maps into types defined at runtime.
Go
2
star
85

pgx_issues

Test and example cases for pgx issues
Go
1
star
86

context-rows-cancel

Test of Go database/sql context cancelation
Go
1
star
87

pgx845

This is a test application for https://github.com/jackc/pgx/issues/845.
Go
1
star
88

markovbot

Go
1
star
89

reggie

Regular expression builder and tester for Ruby
Ruby
1
star
90

snake_case

Go
1
star
91

cbc-sinatra-crash

Test app demonstrating a crash
Ruby
1
star
92

hackers-delight

Hacker's Delight Exercises and Experiments
Go
1
star
93

pg_pl_bench

Go
1
star
94

booklogh

Experimental port of Booklog to Hannibal
PLpgSQL
1
star
95

alt_record

An alternative implementation of the active record pattern for Ruby
Ruby
1
star
96

structify

Go
1
star
97

testdb

Test database manager
Go
1
star
98

form_model

Ruby
1
star
99

homebrew-formulas

Jack Christensen's Formulas
Ruby
1
star
100

go_database_sql_retry_bug

Test application to determine if database/sql auto-retry logic is safe
Go
1
star