Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/eulerto/pgquarrel

pgquarrel compares PostgreSQL database schemas (DDL)
https://github.com/eulerto/pgquarrel

database ddl diff postgresql postgresql-client schema

Last synced: 2 days ago
JSON representation

pgquarrel compares PostgreSQL database schemas (DDL)

Host: GitHub
URL: https://github.com/eulerto/pgquarrel
Owner: eulerto
License: bsd-3-clause
Created: 2015-08-25T14:21:33.000Z (about 9 years ago)
Default Branch: master
Last Pushed: 2023-03-27T14:18:46.000Z (over 1 year ago)
Last Synced: 2024-08-01T05:04:37.091Z (3 months ago)
Topics: database, ddl, diff, postgresql, postgresql-client, schema
Language: C
Homepage:
Size: 2.89 MB
Stars: 388
Watchers: 30
Forks: 42
Open Issues: 26
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

awesome-urweb - pgquarrel - Compares PostgreSQL database schemas (DDL). Useful for migrations. (Database Tools)
jimsghstars - eulerto/pgquarrel - pgquarrel compares PostgreSQL database schemas (DDL) (C)
starred-awesome - pgquarrel - pgquarrel compares PostgreSQL database schemas (DDL) (PLpgSQL)

README

[![Build Status](https://travis-ci.org/eulerto/pgquarrel.svg?branch=master)](https://travis-ci.org/eulerto/pgquarrel)
[![Coverity Status](https://scan.coverity.com/projects/8369/badge.svg)](https://scan.coverity.com/projects/pgquarrel)

Introduction
============

**pgquarrel** is a program that compares [PostgreSQL](http://www.postgresql.org/) database schemas (DDL).

Given two database connections, it output a file that represent the difference between schemas. It means that if you run the output file into the *target* database, it'll have the same schema as the *source* database. The main use case is to deploy database changes into testing, staging or production environment.

**pgquarrel** does not rely on another tool (such as **pg\_dump**) instead it connects directly to PostgreSQL server, obtain meta data from catalog, compare objects and output the commands necessary to turn *target* database into *source* database. It also has filter options; that means, you can compare part of your objects.

It could work with different PostgreSQL versions. The generated file could not work as expected if the *source* PostgreSQL version is greater than *target* PostgreSQL version. That's because the tool could generate commands that does not exist in a prior PostgreSQL version.

**pgquarrel** does not manipulate data (i.e. INSERT, UPDATE, DELETE, COPY, etc).

It works with different operating systems. It was tested on Linux, FreeBSD, and Windows.

Installation
============

**pgquarrel** is distributed as a source package and can be downloaded at [GitHub](http://github.com/eulerto/pgquarrel). The installation steps depend on your operating system.

You can also keep up with the latest fixes and features cloning the Git repository.

```
$ git clone https://github.com/eulerto/pgquarrel.git
```

UNIX based Operating Systems
----------------------------

Before installing **pgquarrel**, you should have PostgreSQL 9.0+ installed (including the header files). If PostgreSQL is not in your search path add -DCMAKE_PREFIX_PATH=/path/to/pgsql to cmake command. If you are using [PostgreSQL yum repository](https://yum.postgresql.org), install `postgresql13-devel` and add `-DCMAKE_PREFIX_PATH=/usr/pgsql-13` to cmake command. If you are using [PostgreSQL apt repository](https://wiki.postgresql.org/wiki/Apt), install `postgresql-server-dev-13` and add `-DCMAKE_PREFIX_PATH=/usr/lib/postgresql/13` to cmake command.

If you compile PostgreSQL by yourself and install it in `/home/euler/pg13`:

```
$ tar -zxf pgquarrel-0.7.0.tgz
$ cd pgquarrel-0.7.0
$ cmake -DCMAKE_INSTALL_PREFIX=$HOME/pgquarrel -DCMAKE_PREFIX_PATH=/home/euler/pg13 .
$ make
$ make install
```

If you are using [PostgreSQL yum repository](https://yum.postgresql.org):

```
$ sudo yum install postgresql13-devel
$ tar -zxf pgquarrel-0.7.0.tgz
$ cd pgquarrel-0.7.0
$ cmake -DCMAKE_INSTALL_PREFIX=$HOME/pgquarrel -DCMAKE_PREFIX_PATH=/usr/pgsql-13 .
$ make
$ make install
```

If you are using [PostgreSQL apt repository](https://wiki.postgresql.org/wiki/Apt):

```
$ sudo apt-get install postgresql-server-dev-13
$ tar -zxf pgquarrel-0.7.0.tgz
$ cd pgquarrel-0.7.0
$ cmake -DCMAKE_INSTALL_PREFIX=$HOME/pgquarrel -DCMAKE_PREFIX_PATH=/usr/lib/postgresql/13 .
$ make
$ make install
```

Windows
-------

You should have CMake 2.8.11+ installed and MS Visual Studio (tested with 2017). Open CMake Gui. If PostgreSQL is not in your path add an entry CMAKE_PREFIX_PATH (e.g. C:/Program Files/PostgreSQL/10). Change CMAKE_INSTALL_PREFIX if you want to install in another directory. Click on 'Configure' and then 'Generate'. Open MS Visual Studio project (path is specified in CMake Gui), right-click on ALL_BUILD and 'Compile'. After that right-click on INSTALL and 'Deploy'.

Features
========

**pgquarrel** does not support all of the PostgreSQL objects.

Object
Support
Comments

ACCESS METHOD
complete

AGGREGATE
partial

CAST
complete

COLLATION
partial

COMMENT
partial

CONVERSION
partial

DOMAIN
partial

EVENT TRIGGER
complete

EXTENSION
partial

FUNCTION
partial

INDEX
partial

LANGUAGE
partial

MATERIALIZED VIEW
partial

RULE
complete

SCHEMA
partial

SEQUENCE
partial

TABLE
partial

TRIGGER
complete

TYPE
partial

VIEW
partial

GRANT
complete

REVOKE
complete

SECURITY LABEL
partial

FOREIGN DATA WRAPPER
complete

FOREIGN TABLE
partial

SERVER
complete

USER MAPPING
complete

TEXT SEARCH CONFIGURATION
partial

TEXT SEARCH DICTIONARY
partial

TEXT SEARCH PARSER
partial

TEXT SEARCH TEMPLATE
partial

OPERATOR
partial

OPERATOR CLASS
partial

OPERATOR FAMILY
partial

PUBLICATION
partial

SUBSCRIPTION
partial

POLICY
partial

TRANSFORM
complete

PROCEDURE
partial

ALTER DEFAULT PRIVILEGES
uncertain

ALTER LARGE OBJECT
uncertain

STATISTICS
complete

Although **pgquarrel** does not support all PostgreSQL objects, it covers many of the use cases. In future releases, we expect to implement the TODO items to cover more cases. The main absences are:

* inheritance;
* roles.

Usage
=====

```
$ pgquarrel [OPTION]...
```

By default, the changes will be output to stdout and only some kind of objects will be compared (those whose default is true).

The following command-line options are provided (all are optional):

* `config (-c)`: configuration file that contains source and target connection information and kind of objects that will be compared.
* `file (-f)`: send output to file, - for stdout (default: stdout).
* `ignore-version`: ignore version check. pgquarrel uses the reserved keywords provided by the postgres version that it was compiled in. Server version greater than the compiled one could not properly quote some keywords used as identifiers.
* `summary (-s)`: print a summary of changes.
* `single-transaction (-t)`: output changes as a single transaction.
* `temp-directory`: use this directory as a temporary area ( default: /tmp).
* `verbose (-v)`: verbose mode.
* `source-dbname`: source database name or connection string ( `keyword = value` strings or URIs).
* `source-host`: source host name.
* `source-port`: source port.
* `source-username`: source user name.
* `source-no-password`: never prompt for password.
* `target-dbname`: target database name or connection string ( `keyword = value` strings or URIs).
* `target-host`: target host name.
* `target-port`: target port.
* `target-username`: target user name.
* `target-no-password`: never prompt for password.
* `help`: print help.
* `version`: print version.
* `access-method`: access method comparison (default: false).
* `aggregate`: aggregate comparison (default: false).
* `cast`: cast comparison (default: false).
* `collation`: collation comparison (default: false).
* `comment`: comment comparison (default: false).
* `conversion`: conversion comparison (default: false).
* `domain`: domain comparison (default: true).
* `event-trigger`: event trigger comparison (default: false).
* `extension`: extension comparison (default: false).
* `fdw`: foreign data wrapper comparison (default: false).
* `foreign-table`: foreign table comparison (default: false).
* `function`: function comparison (default: true).
* `index`: index comparison (default: true).
* `language`: language comparison (default: false).
* `materialized-view`: materialized view comparison (default: true).
* `operator`: operator comparison (default: false).
* `policy`: policy comparison (default: false).
* `procedure`: procedure comparison (default: true).
* `publication`: publication comparison (default: false).
* `owner`: owner comparison (default: false).
* `privileges`: privileges comparison (default: false).
* `rule`: rule comparison (default: false).
* `schema`: schema comparison (default: true).
* `security-labels`: security labels comparison (default: false).
* `sequence`: sequence comparison (default: true).
* `statistics`: statistics comparison (default: false).
* `subscription`: subscription comparison (default: false).
* `table`: table comparison (default: true).
* `text-search`: text search comparison (default: false).
* `transform`: transform comparison (default: false).
* `trigger`: trigger comparison (default: true).
* `type`: type comparison (default: true).
* `view`: view comparison (default: true).
* `include-schema`: include schemas that match pattern (default: all schemas).
* `exclude-schema`: exclude schemas that match pattern (default: none).

You can use a configuration file to store the desired options. The _general_ section specifies which kind of objects will be output. The _target_ and _source_ section options specifies connection options to both servers. Have in mind that any command-line option can override the configuration file option. The configuration file contains the following structure:

```
[general]
output = /tmp/diff.sql
temp-directory = /tmp
verbose = false
summary = false
comment = false
security-labels = false
owner = false
privileges = false
ignore-version = false
single-transaction = false

access-method = false
aggregate = false
cast = false
collation = false
conversion = false
domain = true
event-trigger = false
extension = false
fdw = false
foreign-table = false
function = true
index = true
language = false
materialized-view = true
operator = false
policy = false
procedure = true
publication = false
rule = false
schema = true
sequence = true
statistics = false
subscription = false
table = true
text-search = false
transform = false
trigger = true
type = true
view = true

include-schema = ^(hr|finance|account|crm|sales)$
exclude-schema = ^public$

[target]
host = 10.27.0.8
port = 5432
dbname = quarrel1
user = bob
no-password = false

[source]
host = 10.8.0.10
port = 5432
dbname = quarrel2
user = alice
no-password = false
```

Regression Tests
================

```
$ # adjust test/run-test.sh
$ cd pgquarrel-0.7.0/test
$ # test using 11 on both clusters
$ ./run-test.sh 11 11 init
```

License
=======

> Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

> Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer;
> Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution;
> Neither the name of the Euler Taveira de Oliveira nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission.

> THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.