• Stars
    star
    623
  • Rank 72,088 (Top 2 %)
  • Language
    Python
  • License
    PostgreSQL License
  • Created about 8 years ago
  • Updated 4 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Simple tool to evolve PostgreSQL schema easily.

PyPI version Build Status

PGmigrate

PostgreSQL migrations made easy

Overview

PGmigrate is a database migration tool developed by Yandex.

PGmigrate has the following key-features:

  • Transactional and nontransactional migrations: you can enjoy whole power of PostgreSQL DDL
  • Callbacks: you can run some DDL on specific steps of migration process (e.g. drop some code before executing migrations, and create it back after migrations were applied)
  • Online migrations: you can execute series of transactional migrations and callbacks in a single transaction (so, if something goes wrong simple ROLLBACK will bring you in consistent state)

Install

pip install yandex-pgmigrate

Running tests

Tests require running PostgreSQL instance with superuser (to create/drop dbs). You could setup this yourself and use tox to start tests:

tox

Second option is to use docker and make:

make test

How to use

Complete manual is here.

Release history

  • 1.0.7 (2022-02-02)
    • Skip unnecessary schema creation on init
    • Add file path to statement apply error log
    • Add version gaps check
  • 1.0.6 (2020-10-29)
    • Make dsn manipulations more robust
    • Fix empty values-related bugs in config and args parsing
  • 1.0.5 (2020-02-29)
    • Use application_name instead of backend pid for conflict termination
  • 1.0.4 (2019-04-14)
    • Allow using subdirs in migrations folder
  • 1.0.3 (2017-12-28)
    • Fix migration error with comment at the end of file
    • Add blocking pids termination
    • Some minor fixes and improvements
  • 1.0.2 (2017-04-05)
    • Speed up get_info function a bit
    • Fix callbacks in transactional/nontransactional migrations mix on db init
  • 1.0.1 (2017-04-01)
    • Fix bug with python format patterns in migration text
    • Sort info command output by version
    • Support 'latest' target version
    • Add option to override user in migration meta
    • Fix info command fail without target on initialized database
    • Add session setup option
  • 1.0.0 (2016-10-03)
    • First opensource version

License

Distributed under the PostgreSQL license. See LICENSE for more information.

More Repositories

1

gixy

Nginx configuration static analyzer
Python
8,242
star
2

YaLM-100B

Pretrained language model with 100B parameters
Python
3,732
star
3

odyssey

Scalable PostgreSQL connection pooler
C
3,190
star
4

yandex-tank

Load and performance benchmark tool
Python
2,439
star
5

YaFSDP

YaFSDP: Yet another Fully Sharded Data Parallel
Python
821
star
6

rep

Machine Learning toolbox for Humans
Jupyter Notebook
687
star
7

faster-rnnlm

Faster Recurrent Neural Network Language Modeling Toolkit with Noise Contrastive Estimation and Hierarchical Softmax
C++
562
star
8

tomita-parser

C
495
star
9

pandora

A load generator in Go language
Go
401
star
10

porto

Yet another Linux container management system
C++
397
star
11

reshadow

Markup and styles that feel right
JavaScript
363
star
12

django_replicated

Django DB router for stateful master-slave replication
Python
351
star
13

pire

Perl Incompatible Regular Expressions library
C++
330
star
14

metrica-tag

The client library of the web analytics tool. It is in the top 5 by popularity worldwide.
TypeScript
257
star
15

yatagan

Dependency Injection framework based on Google's Dagger2 API, optimized for fast builds and for managing large graphs with optional dependencies
Kotlin
231
star
16

ozo

OZO is a C++17 Boost.Asio based header-only library for asyncronous communication with PostgreSQL DBMS.
C++
226
star
17

mapsapi-codestyle

JavaScript and TypeScript Style Guide
JavaScript
213
star
18

zero-downtime-migrations

Apply Django migrations on PostgreSql without long locks on tables
Python
188
star
19

audio-js

Библиотека аудио-плеера для браузера
JavaScript
186
star
20

alice-skills

Примеры кода навыков для голосового помощника, придуманного в Яндексе
Python
179
star
21

burp-molly-scanner

Turn your Burp suite into headless active web application vulnerability scanner
Java
154
star
22

yandex-taxi-testsuite

testsuite: microservices testing framework
Python
144
star
23

burp-molly-pack

Security checks pack for Burp Suite
Java
137
star
24

yatool

Yatool is a cross-platform distribution, building, testing, and debugging toolkit focused on monorepositories
C++
136
star
25

go-hasql

Go library for accessing multi-host SQL database installations
Go
133
star
26

mapsapi-modules

Async modular system
JavaScript
132
star
27

mapkit-android-demo

MapKit Android demo
Kotlin
121
star
28

yoctodb

A tiny embedded Java-engine for extremely fast partitioned immutable-after-construction databases
Java
106
star
29

scout

A fast and safe manual dependency injector for Kotlin and Android.
Kotlin
104
star
30

handystats

C++ library for collecting user-defined in-process runtime statistics with low overhead
C++
97
star
31

speechkitcloud

Speechkit Cloud examples and SDK
JavaScript
89
star
32

fastops

This small library enables acceleration of bulk calls of certain math functions on AVX and AVX2 hardware. Currently supported operations are exp, log, sigmoid and tanh. The library is designed with extensibility in mind.
C++
88
star
33

mapkit-ios-demo

MapKit iOS demo
Swift
82
star
34

argon2

Implementation of argon2 (i, d, id) algorithms with CPU dispatching
C++
80
star
35

mapsapi-heatmap

Heatmap: Yandex.Maps API plugin for data visualization
JavaScript
77
star
36

mms

Memory-mapped storage library
C++
76
star
37

geo-reviews-dataset-2023

76
star
38

tcplanz

TCPDump latency analyzer
Python
74
star
39

balancer

http balancer
C
72
star
40

securitygym

Python
72
star
41

NwSMTP

Asynchronous SMTP proxy server
Shell
72
star
42

smart

SMT-aware Real-time scheduler for Linux
C
67
star
43

mysync

MySync is mysql high-availability and cluster configuration tool.
Go
64
star
44

YandexDriver

YandexDriver is a WebDriver implementation
63
star
45

rtv

Remote TV control for developers
JavaScript
62
star
46

tex-renderer

Микросервис для рендеринга tex-формул в изображения
JavaScript
61
star
47

yandex_tracker_client

Python client for working with Yandex.Tracker Api
Python
55
star
48

csp-tester

This extension helps web masters to test web application behaviour with Content Security Policy (CSP) ver. 1.0 implemented.
JavaScript
55
star
49

mapsapi-examples

Примеры использования API Яндекс.Карт
JavaScript
52
star
50

ofd

Реализация протокола взаимодействия ККТ-ОФД
Python
49
star
51

csp-reporter

Content Security Policy logs parser
Python
44
star
52

reselector

Use React Components in css selectors
JavaScript
44
star
53

CMICOT

Efficient feature selection method based on Conditional Mutual Information.
C++
42
star
54

dpt

BEM-based prototyping framework for large projects
JavaScript
41
star
55

pgcheck

Tool for monitoring backend databases from PL/Proxy hosts and changing plproxy.get_cluster_partitions() output
Go
37
star
56

root-2015-tasks

Yandex.Root 2015 contest data
Python
34
star
57

deaf

Android App for Deaf
Java
33
star
58

datasync-js

DataSync API allows for structured data storage and synchronization in Web services and mobile applications.
JavaScript
33
star
59

inet64_tcp

Magic thing to make old Erlang stuff work in IPv6-only networks
Erlang
32
star
60

browser-extensions

JavaScript
32
star
61

mongoz

An alternative implementation of MongoDB sharding server aimed at high availability
C++
32
star
62

mapsapi-pie-chart-clusterer

Yandex Maps Plugin: Pie Chart Clusterer
JavaScript
31
star
63

mlcup

Official baseline solutions to Yandex Cup ML challenge
Jupyter Notebook
30
star
64

webmaster.api

28
star
65

mapsapi-polylabeler

Plugin to setting labels inside polygons
JavaScript
25
star
66

ch-backup

Backup tool for ClickHouse DBMS
Python
25
star
67

mapsapi-round-controls

Plugin for Yandex.Maps JS API: rounded map controls theme
JavaScript
24
star
68

ch-tools

ClickHouse administration and diagnostics tools
Python
23
star
69

pgconsul

PgConsul is a tool for maintaining High-Availability Postgresql cluster configurations. It is responsible for cluster recovery in case of emergencies.
Python
22
star
70

rdsync

Go
22
star
71

dep_tregex

Stanford Tregex-inspired language for rule-based dependency tree manipulation.
Python
21
star
72

tartifacts

📦 Create artifacts for your assemblies
JavaScript
20
star
73

mastermind

Smart control for a big storage
Python
19
star
74

cggen

Tool for generating Core Graphics code from vector image files
Swift
19
star
75

sdch_module

C++
18
star
76

YNDX000SB_kernel

Yandex.Phone kernel sources
C
18
star
77

openvpn-python-plugin

Runs python3 interpreter inside OpenVPN process in a persistent manner to answer it's plug-in calls.
C
18
star
78

yandex-ecom-search

Бета-Версия документации для разработчиков по работе с товарным фидом Яндекс Поиска
18
star
79

temporal-over-ydb

Go
17
star
80

evgen

Code generation for event logging
TypeScript
16
star
81

vgsl

Very Good Swift Library
Swift
15
star
82

miniapp-example

Example application for brand new platform of MiniApps inside the Yandex App
TypeScript
15
star
83

cluster_metrics

C++
13
star
84

yamail

YMail General Purpose Library
C++
13
star
85

agglomerative_clustering

C++
13
star
86

minishard

Lightweight sharding for distributed erlang applications
Erlang
12
star
87

jsx-directives

Директивы для JSX
TypeScript
12
star
88

mapsapi-ios

Allows to easily add Yandex.Maps to your existing iOS project using Yandex.Maps JavaScript API
Objective-C
11
star
89

miniapp-example-backend

Backend for Miniapp Example App for brand new platform of MiniApps inside the Yandex App
TypeScript
10
star
90

erater

Generic embedded distributed request rate limiting service for erlang applications
Erlang
10
star
91

storytests-cli

Framework agnostic CLI Utility to generate test files from Storybook
TypeScript
10
star
92

mapsapi-area

util.calculateArea: plugin for calculating geodesic features area.
JavaScript
10
star
93

zest

Библиотека для взаимодействия с бэкендом
TypeScript
9
star
94

opentsdb-flume

Module for flume, allows to write incoming events directly to OpenTSDB.
Java
9
star
95

protoc-gen-crd

Protobuf plugin for generating k8s CRD
Go
8
star
96

mediastorage-proxy

Mediastorage-proxy is a HTTP proxy for mediastorage based on elliptics
C++
8
star
97

toolchain-registry

Toolchain Registry is a central registry for maintaining and versioning toolchains used in Yandex.
Python
8
star
98

erateserver

Distributed rate limiting service with HTTP interface
Erlang
7
star
99

domestic-roots-patch

A patch that adds support for the Russian domesic root certificate to the Chromium browser.
7
star
100

libmastermind

Client library for mastermind
C++
6
star