• Stars
    star
    8,422
  • Rank 4,112 (Top 0.09 %)
  • Language
    Go
  • License
    MIT License
  • Created about 11 years ago
  • Updated 6 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

PostgreSQL driver and toolkit for Go

Go Reference Build Status

pgx - PostgreSQL Driver and Toolkit

pgx is a pure Go driver and toolkit for PostgreSQL.

The pgx driver is a low-level, high performance interface that exposes PostgreSQL-specific features such as LISTEN / NOTIFY and COPY. It also includes an adapter for the standard database/sql interface.

The toolkit component is a related set of packages that implement PostgreSQL functionality such as parsing the wire protocol and type mapping between PostgreSQL and Go. These underlying packages can be used to implement alternative drivers, proxies, load balancers, logical replication clients, etc.

Example Usage

package main

import (
	"context"
	"fmt"
	"os"

	"github.com/jackc/pgx/v5"
)

func main() {
	// urlExample := "postgres://username:password@localhost:5432/database_name"
	conn, err := pgx.Connect(context.Background(), os.Getenv("DATABASE_URL"))
	if err != nil {
		fmt.Fprintf(os.Stderr, "Unable to connect to database: %v\n", err)
		os.Exit(1)
	}
	defer conn.Close(context.Background())

	var name string
	var weight int64
	err = conn.QueryRow(context.Background(), "select name, weight from widgets where id=$1", 42).Scan(&name, &weight)
	if err != nil {
		fmt.Fprintf(os.Stderr, "QueryRow failed: %v\n", err)
		os.Exit(1)
	}

	fmt.Println(name, weight)
}

See the getting started guide for more information.

Features

  • Support for approximately 70 different PostgreSQL types
  • Automatic statement preparation and caching
  • Batch queries
  • Single-round trip query mode
  • Full TLS connection control
  • Binary format support for custom types (allows for much quicker encoding/decoding)
  • COPY protocol support for faster bulk data loads
  • Tracing and logging support
  • Connection pool with after-connect hook for arbitrary connection setup
  • LISTEN / NOTIFY
  • Conversion of PostgreSQL arrays to Go slice mappings for integers, floats, and strings
  • hstore support
  • json and jsonb support
  • Maps inet and cidr PostgreSQL types to netip.Addr and netip.Prefix
  • Large object support
  • NULL mapping to pointer to pointer
  • Supports database/sql.Scanner and database/sql/driver.Valuer interfaces for custom types
  • Notice response handling
  • Simulated nested transactions with savepoints

Choosing Between the pgx and database/sql Interfaces

The pgx interface is faster. Many PostgreSQL specific features such as LISTEN / NOTIFY and COPY are not available through the database/sql interface.

The pgx interface is recommended when:

  1. The application only targets PostgreSQL.
  2. No other libraries that require database/sql are in use.

It is also possible to use the database/sql interface and convert a connection to the lower-level pgx interface as needed.

Testing

See CONTRIBUTING.md for setup instructions.

Architecture

See the presentation at Golang Estonia, PGX Top to Bottom for a description of pgx architecture.

Supported Go and PostgreSQL Versions

pgx supports the same versions of Go and PostgreSQL that are supported by their respective teams. For Go that is the two most recent major releases and for PostgreSQL the major releases in the last 5 years. This means pgx supports Go 1.20 and higher and PostgreSQL 12 and higher. pgx also is tested against the latest version of CockroachDB.

Version Policy

pgx follows semantic versioning for the documented public API on stable releases. v5 is the latest stable major version.

PGX Family Libraries

pglogrepl provides functionality to act as a client for PostgreSQL logical replication.

pgmock offers the ability to create a server that mocks the PostgreSQL wire protocol. This is used internally to test pgx by purposely inducing unusual errors. pgproto3 and pgmock together provide most of the foundational tooling required to implement a PostgreSQL proxy or MitM (such as for a custom connection pooler).

tern is a stand-alone SQL migration system.

pgerrcode contains constants for the PostgreSQL error codes.

Adapters for 3rd Party Types

Adapters for 3rd Party Tracers

Adapters for 3rd Party Loggers

These adapters can be used with the tracelog package.

3rd Party Libraries with PGX Support

pgxmock is a mock library implementing pgx interfaces. pgxmock has one and only purpose - to simulate pgx behavior in tests, without needing a real database connection.

Library for scanning data from a database into Go structs and more.

A carefully designed SQL client for making using SQL easier, more productive, and less error-prone on Golang.

Adds GSSAPI / Kerberos authentication support.

Explicit data mapping and scanning library for Go structs and slices.

Type safe and flexible package for scanning database data into Go types. Supports, structs, maps, slices and custom mapping functions.

Code first migration library for native pgx (no database/sql abstraction).

More Repositories

1

tern

The SQL Fan's Migrator
Go
656
star
2

tod

Time of day and shift types for Ruby
Ruby
415
star
3

surus

PostgreSQL extensions for ActiveRecord
Ruby
395
star
4

sqlfmt

SQL Formatter
Yacc
335
star
5

pgtype

Go
292
star
6

pglogrepl

PostgreSQL logical replication library for Go.
Go
270
star
7

puddle

Generic resource pool for Go
Go
225
star
8

pgconn

Go
166
star
9

pgproto3

Go
148
star
10

pgerrcode

Package pgerrcode contains constants for PostgreSQL error codes.
Go
128
star
11

pgmock

Go
111
star
12

edge

Edge provides graph functionality to ActiveRecord.
Ruby
89
star
13

mat-view-strat-pg

Materialized View Strategies Using PostgreSQL
PLpgSQL
59
star
14

go_db_bench

Benchmarks for database/drivers from Go
Go
52
star
15

json_api_bench

Benchmark of Rails and PostgreSQL JSON generation techniques
Ruby
32
star
16

tpr

The Pithy Reader - a fast, simple, and lightweight feed aggregator and reader
Go
22
star
17

pgxlisten

pgxlisten provides higher level PostgreSQL LISTEN / NOTIFY tooling built on pgx.
Go
18
star
18

pg-custom-aggregate-grt

PostgreSQL custom aggregate greatest running total implemented in PL/pgSQL and C
PLpgSQL
17
star
19

pgxutil

Go
16
star
20

react2fs

Run command in reaction to file system events
Go
15
star
21

chunkreader

Go
14
star
22

overload

HTTP load tester
Go
14
star
23

pgxrecord

pgxrecord is a tiny framework for CRUD operations and data mapping.
Go
14
star
24

pgxjob

pgxjob provides a job queue implementation using PostgreSQL.
Go
13
star
25

pgx-top-to-bottom

HTML
12
star
26

pgio

Package pgio is a low-level toolkit building messages in the PostgreSQL wire protocol.
Go
12
star
27

command_model

CommandModel - when update_attributes isn't enough.
Ruby
12
star
28

pgx-zerolog

Go
10
star
29

writable-cte-examples

Examples of Writable Common Table Expressions in PostgreSQL
Ruby
9
star
30

pgxdata

Go
9
star
31

pgtocsv

pgtocsv executes a query on a PostgreSQL database and outputs the results in CSV.
Go
9
star
32

numfmt

Number formatting in Go
Go
9
star
33

pgservicefile

pgservicefile is a parser PostgreSQL for service files (e.g. .pg_service.conf)
Go
8
star
34

pgsql

Go
8
star
35

go_map_vs_switch

Benchmark for Go map of functions vs. switch
Go
7
star
36

pgx-shopspring-decimal

Go
7
star
37

pg-extid

Go
7
star
38

go-extid

Go
7
star
39

pgundolog

pgundolog is a system for rolling back changes to a PostgreSQL database without using transactions.
PLpgSQL
7
star
40

booklog

Go
6
star
41

pgx-zap

Go
6
star
42

pgx-gofrs-uuid

Go
6
star
43

hannibal

Experimental PostgreSQL web application server
Go
5
star
44

cavein

TCP tunnel that designed for testing applications with random connection losses
Go
5
star
45

quo_vadis

Really simple and fast HTTP Router
Go
5
star
46

pgxrepl

Replication client library for PostgreSQL in Go using the pgx driver
Go
5
star
47

text_tunnel

Use your local text editor to edit files on remote servers.
Ruby
5
star
48

pgpassfile

Go
4
star
49

doublecheck

Doublecheck your database before it is too late
Go
4
star
50

csvtopg

csvtopg copies a CSV to a PostgreSQL database.
Go
4
star
51

chicagolang-feb-2015

Slides for Building Command Line Applications in Go
Go
4
star
52

go_router_tutorial

Tutorial to build a simple HTTP router in Go
Go
4
star
53

why-pgx

Slides for lightning talk on pgx
4
star
54

gel

Go Compiled Templates
Go
3
star
55

ego

Experimental shorthand for Go error handling.
Go
3
star
56

pgx_notify_lost_connection

Test for PGX WaitForNotification when connection is lost
Go
3
star
57

pigeon-exp-xmlpp

Experimenting with pigeon PEG generator for Go
Go
3
star
58

doublecheck_view

Ruby gem for integrating doublecheck view pattern with database integration tests
Ruby
3
star
59

cachet

The cache for all your Ts
Go
2
star
60

pgxsql

Go
2
star
61

flex

Go
2
star
62

cgol-rust

Quick, experimental port of Go cgol to Rust
Rust
2
star
63

dailyprogrammer

Go
2
star
64

sadpath

sadpath provides a simple way to centralize error handling and reduce boilerplate.
Go
2
star
65

imperator

Imperator is an imperative normalization and validation library for Go.
Go
2
star
66

pg95-whats-new

What's new in PostgreSQL 9.5
PLpgSQL
2
star
67

go-intro

Quick introduction to Go -- sample project and speaker notes
Go
2
star
68

pgxbench

PLSQL
2
star
69

react2fs-deb

react2fs Debian package
Go
2
star
70

ppg

ppg runs a SQL file multiple times in parallel
Go
2
star
71

box

Go
2
star
72

tern-deb

Build scripts for debian package for tern
Go
2
star
73

sqlfmt-deb

sqlfmt Debian package
Go
2
star
74

ctxio

Go
2
star
75

jchat

Go
2
star
76

exp-go-repl

Experimenting with yacc
Go
2
star
77

webby-template-minimal-website

Minimal possible website template for Webby
2
star
78

mp

mp (map parser) provides a parser that parses maps into types defined at runtime.
Go
2
star
79

go-hello

Go program to practice packaging
Go
2
star
80

form

HTTP forms for Go
Go
2
star
81

tpr-deb

The Pithy Reader Debian Package
Go
2
star
82

go-server-closed-tcp-conn-os-inconsistencies

Example of differing server closed TCP connections on Linux and Windows
2
star
83

assert_db_rejects

Test database level constraints with ActiveRecord
Ruby
2
star
84

pgx_issues

Test and example cases for pgx issues
Go
1
star
85

context-rows-cancel

Test of Go database/sql context cancelation
Go
1
star
86

pgx845

This is a test application for https://github.com/jackc/pgx/issues/845.
Go
1
star
87

homebrew-formulas

Jack Christensen's Formulas
Ruby
1
star
88

markovbot

Go
1
star
89

reggie

Regular expression builder and tester for Ruby
Ruby
1
star
90

snake_case

Go
1
star
91

cbc-sinatra-crash

Test app demonstrating a crash
Ruby
1
star
92

hackers-delight

Hacker's Delight Exercises and Experiments
Go
1
star
93

pg_pl_bench

Go
1
star
94

booklogh

Experimental port of Booklog to Hannibal
PLpgSQL
1
star
95

alt_record

An alternative implementation of the active record pattern for Ruby
Ruby
1
star
96

structify

Go
1
star
97

form_model

Ruby
1
star
98

testdb

Test database manager
Go
1
star
99

go_database_sql_retry_bug

Test application to determine if database/sql auto-retry logic is safe
Go
1
star
100

go-tls-deadline-temporary-error

Go
1
star