Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/denismilovanov/PostgresqlDeployerGUI
GUI simplifies deployment of PostgreSQL schema (seeds, functions, types, sequences, triggers, tables partially) from your git repository
https://github.com/denismilovanov/PostgresqlDeployerGUI
Last synced: 15 days ago
JSON representation
GUI simplifies deployment of PostgreSQL schema (seeds, functions, types, sequences, triggers, tables partially) from your git repository
- Host: GitHub
- URL: https://github.com/denismilovanov/PostgresqlDeployerGUI
- Owner: denismilovanov
- License: mit
- Created: 2014-10-05T17:21:07.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2016-06-10T18:52:08.000Z (over 8 years ago)
- Last Synced: 2024-07-03T06:33:48.827Z (4 months ago)
- Language: PHP
- Homepage:
- Size: 126 KB
- Stars: 19
- Watchers: 6
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
PostgresqlDeployerGUI
=====================
### Demo
[http://pg.denismilovanov.net](http://pg.denismilovanov.net)
E-mail `guest`, password `guest`.
### Intro
PostgresqlDeployerGUI provides you web interface that simplifies deployment of PostgreSQL schema.
Single database only, you can not deploy schema on two or more databases with sync commit.
Generally speaking there are several approaches to schema deployment.
Popular approach is to use migrations. You take your favorite migration tool built in your framework,
write 'up' code, write 'down' code, and you are done.
Advantages are obvious: one after you can deploy schema changes on any machine (local, staging, production) very easily.
But I see 2 problems here:
1) migrations like `ALTER TABLE ADD COLUMN NOT NULL DEFAULT` on huge tables have to be performed manually in any case
(fast `ALTER TABLE ADD COLUMN NULL` first, then `ALTER TABLE ALTER COLUMN SET DEFAULT`, then batch updates of null values),
2) stored functions and types up and down migrations lead to great code overhead (to add one line in function you have to double
its source code, to change function signature - to drop its previous version, to change type signature - to redeploy its depending functions).
That is why I don't believe in completely automatic migrations. They are suiteable only for small projects.
Git (where I offer to store schema) is already migration-fashioned system. You may say `git checkout ` and
get schema state at any time in the past to rollback if it is needed, or say `git pull` and see the difference between states
(if you organize database objects storage).
PostgreSQLDeployerGUI works with 8 database objects types:
* tables,
* seeds (data of system dictionaries, mappings, settings, etc),
* types (PostgreSQL user types),
* functions (PostgreSQL stored procedures),
* sequencies,
* triggers,
* views (limited support, actually you may only download definitions),
* arbitrary queries.
Tables DDL's (`CREATE TABLE`, `CREATE INDEX`, `ALTER TABLE`) are committed into git and can be
deployed automatically if 2 conditions are satisfied:
* there is no significant `deletions` lines in commit,
* there are no cyclic table references in `additions` lines among commits.
If commit includes `deletions` it means that you have to apply corresponding changes by hands: system is not smart enough
to produce 'revert' statements (`ALTER TABLE RENAME COLUMN`, `ALTER TABLE DROP COLUMN`, `DROP INDEX`, etc).
If commits include cyclic references system also requires you to do manual deployment even if statements can be ordered the way avoiding cycles.
Other cases are marked as 'Can be forwarded #N', it means that statements can be deployed in automatic mode.
Seeds are deployed automatically via `DELETE - INSERT`.
Types are deployed automatically by dropping old version of type with all dependent functions.
Interface will show you dependencies, they will be included into deployment list.
Functions are deployed automatically by dropping old version if signature or return type were changed.
Then `CREATE OR REPLACE FUNCTION` is called.
All changes are deployed in single transaction. You may exclude any object from list.
### Installation
Clone repository:
git clone https://github.com/denismilovanov/PostgresqlDeployerGUI.git
Setup dependencies via composer:
cd lib && composer update
Setup your web server:
http://silex.sensiolabs.org/doc/web_servers.html
Route all queries to `htdocs/index.php`.
Or use built-in php server:
php -S 0.0.0.0:8000 -t htdocs/
Perform on your database(s) (psql):
\i db.schema/create_schema.sql
Add new user (psql will show how).
Create databases config file:
nano lib/config/databases.json
Example:
{
"databases": {
"db1": {
"name": "DB 1",
"credentials": {
"host": "localhost",
"port": "5432",
"user_name": "user1",
"user_password": "pass1",
"db_name": "db1"
},
"git_root": "/home/user/work/project/db1_git_root/"
,"schemas_path": "dir1/dir2/schemas/" #optinal, 'schemas/' by default
,"settings": {
#optional settings overloading global
#see settings.json
}
},
"db2": {
"name": "DB 2",
"credentials": {
"host": "localhost",
"port": "5432",
"user_name": "user2",
"user_password": "pass2",
"db_name": "db2"
},
"git_root": "/home/user/work/project/db2_git_root/"
}
}
}
All `git-root's` directories should be opened for write to user your server (FPM-workers for example) is running at, 'cause interface will
perform write-commands such as `git checkout`.
Create settings file:
nano lib/config/settings.json
Example:
{
"settings": {
"not_in_git": {
"active": true,
"exclude_regexp": "(public\\.not_under_git_table)|(main\\.table_number_\\d+)"
},
"reload_and_apply": {
"active": true,
"ignore_manual": false
},
"plpgsql_check": {
"active": false,
"exclude_regexp": "tricky_functions_schema\\.tricky_",
"targets": "all"
},
"paths": {
"pg_bin": "/usr/lib/postgresql/%v/bin/"
},
"commits_list": {
"limit": 10
},
"interface": {
"sticky_control_buttons": false
}
}
}
Available settings:
- not_in_git - this option tells if non-git database objects are shown (they will be marked as `NOT IN GIT`),
- reload_and_apply - show 'Reload and apply' button (makes sense for development purposes only, not in production),
- plpgsql_check - this option runs checking of all stored functions after deployment but before final commit (checking is performed by [plpgsql_check extension](https://github.com/okbob/plpgsql_check.git)
- active - use plpgsql_check or not. boolean, default false
- exclude_regexp - functions, that match this regexp, will be not checked
- targets - specify check functions: "all" for check all existing functions (default) or "only_selected" for check only functions for deploy
- paths
- pg_bin - path to psql and pg_dump executables (%v will be replaced to MAJOR.MINOR version of current database you work at),
- commits_list
- limit - max amount of commits to show,
- interface - some interface features.
You may omit any of these options.
### Repository
Your schema repository should have structure like this:
repository_root/
schemas/
schema1/
functions/
function_name1.sql
function_name2.sql
...
seeds/
seed_table_name1.sql
seed_table_name2.sql
...
tables/
table_name1.sql
table_name2.sql
...
types/
type_name1.sql
type_name2.sql
...
sequences/
sequence_name1.sql
sequence_name2.sql
...
triggers/
this_schema_table_name1.trigger_name1.sql
this_schema_table_name2.trigger_name2.sql
...
queries_before/
01_query.sql
02_query.sql
...
queries_after/
01_query.sql
02_query.sql
...
schema2/
functions/
seeds/
tables/
types/
sequences/
triggers/
queries_before/
queries_after/
...
other_directories/
...
### Seeds
Expected structure of seed file `seed_table_name.sql`:
BEGIN;
DELETE FROM seed_table_name;
INSERT INTO seed_table_name (...)
VALUES (...);
COMMIT;
Please, do not use `TRUNCATE`, it is not MVCC safe.
If you use foreign key referenced to seed table you should make it `DERERRABLE INITIALLY DEFERRED`, in other case `DELETE FROM` will throw an error.
This structure allows you to deploy seed in manual mode with single transaction via simple copying the code.
### Stored functions (procedures)
Expected structure of function file `function_name.sql` (usual pg `CREATE OR REPLACE FUNCTION`):
CREATE OR REPLACE FUNCTION function_name(
)
RETURNS ret_value_type AS
$BODY$
DECLARE
BEGIN
END
$BODY$
LANGUAGE plpgsql;
These cases related to functions currently are not supported:
1. Functions for functional indexes and handling triggers events are forbidden to be dropped automatically.
2. Functions overloading. It is not allowed to have more than one functions with the same or different names in one file.
When you use custom type name you should also provide schema name (even if schema is in `search_path`):
DECLARE
i_count integer;
r_element queues.t_queue_element;
### Types
Expected structure of type file `type_name.sql` (usual pg `CREATE TYPE`):
CREATE TYPE type_name AS (
);
### Sequences
Expected structure of sequence file `sequnces_name.sql`:
CREATE SEQUENCE sequence_name [];
### Triggers
Trigger file name should consist of table name and trigger_name (`table_name.trigger_name.sql`) and contain something like this:
CREATE TRIGGER trigger_name
AFTER INSERT ON current_schema_name.table_name
FOR EACH ROW
EXECUTE PROCEDURE arbitrary_schema.trigger_procedure();
Trigger will be dropped and deployed again as soon as file content is changed (exactly like `seed` objects).
### Notes
1. Do not forget that `CREATE / DROP INDEX CONCURRENTLY` cannot be performed within a transaction block.