Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/graze/morphism
Tool for parsing, extracting, and diffing mysqldump files
https://github.com/graze/morphism
database mysql mysqldump php
Last synced: about 10 hours ago
JSON representation
Tool for parsing, extracting, and diffing mysqldump files
- Host: GitHub
- URL: https://github.com/graze/morphism
- Owner: graze
- License: mit
- Created: 2014-09-08T10:45:19.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2024-05-01T12:38:29.000Z (7 months ago)
- Last Synced: 2024-05-02T04:41:24.991Z (7 months ago)
- Topics: database, mysql, mysqldump, php
- Language: PHP
- Homepage:
- Size: 357 KB
- Stars: 6
- Watchers: 17
- Forks: 0
- Open Issues: 7
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- Contributing: CONTRIBUTING.md
- License: LICENSE.md
Awesome Lists containing this project
README
# morphism
[](https://packagist.org/packages/graze/morphism)
[](LICENSE.md)
[](https://travis-ci.org/graze/morphism)
[](https://scrutinizer-ci.com/g/graze/morphism/code-structure)
[](https://scrutinizer-ci.com/g/graze/morphism)
[](https://packagist.org/packages/graze/morphism)
[](https://php.net)
[](https://microbadger.com/images/graze/morphism)
This package provides a set of tools for parsing, extracting, and diffing mysqldump
files.
A typical application of this is for managing schema changes during application
development (keeping schemas in sync with code when switching branches), and during
deployment (migrating the schema to match the deployed code).
Using this tool allows you to store the complete database schema in the repository.
When a branch
requires a schema update to work properly, you should edit your checkout's schema
and run the new tool to figure out the necessary `ALTER` / `CREATE` / `DROP` statements
to run, and apply them. Similarly, when switching branches you can simply run the
tool and it will apply the necessary changes automatically.
This has the additional benefit that the complete history of the schema is stored
under version control, instead of a series of incremental change scripts. If more
than one party changes the same table, git will merge the changes automatically,
or generate a conflict for manual merging where it cannot. All the usual git tools
become useful - e.g. a simple `git annotate schema/catalog/product.sql` can tell
you who added a redundant index on `pr_name`.
## Install
Via Composer
``` bash
$ composer require graze/morphism
```
## Running With Docker
```bash
$ docker run --rm graze/morphism
```
### Examples:
```bash
$ docker run --rm -v $PWD/config:/app/config -v $PWD/schema:/app/schema:cached graze/morphism diff config/morphism.yml
$ docker run --rm -v $PWD/config:/app/config -v $PWD/schema:/app/schema:delegated graze/morphism dump config/morphism.yml
```
### Attaching to an existing network when developing
You can add morphism to your `docker-compose` file and can talk to your databases locally.
Or if you have an existing docker network you can do:
```bash
$ docker run --rm -v $PWD/config:/app/config -v $PWD/schema:/app/schema:cached --network app_default graze/morphsim diff config/morphism.yml
```
## Tools
All commands support the `--help` parameter which give more information on usage.
* **morphism extract**: Extract schema definitions from a mysqldump file.
* **morphism dump**: Dump database schema for a named database connection.
* **morphism lint**: Check database schema files for correctness.
* **morphism diff**: Show necessary DDL statements to make a given database match the schema files. Optionally apply the changes too.
## Config File
The config file used by some of morphism's tools uses yaml format, as follows:
```
# All connection definitions appear under the 'databases' key
databases:
# name of connection
catalog:
# Connection details - this is just an example, you may want to specify
# different properties, e.g. if connecting to a remote server. You are
# advised to refer to the 'pdo' documentation for further details.
user: 'my-user'
password: 'my-password'
host: 'localhost'
driver: 'pdo_mysql'
unix_socket: '/var/lib/mysql/catalog.sock'
# morphism specific options
morphism:
# morphism diff only operates on connections with 'enable: true'
enable: true
# Path where schema files live.
# Defaults to "schema/"
schemaDefinitionPath:
- schema/catalog
# you may optionally specify one or more regexes matching tables
# to exclude (any changes, creation or deletion of matching tables
# will be ignored). The regex must match the entire table name, i.e.
# it is implicitly anchored with ^...$
exclude:
- temp_.*
- page_load_\d{4}-\d{2}-\d{2}
# similarly, you may optionally specify tables for explicit inclusion.
include:
...
# you may specify more connections
...
# other top level keys are ignored
...
```
## Example Usage
This example uses `morphism dump` to generate schema files from a database, `morphism lint` for checking the files and `morphism diff` to apply changes both interactively and automatically.
```
(master) $ # create a baseline for the schema
(master) $ mkdir schema
(master) $ bin/morphism dump --write config.yml catalog
(master) $ git add schema/catalog
(master) $ git commit -m "initial checkin of catalog schema"
(master) $
(master) $ # start work on changes to the catalog...
(master) $ git checkout -b catalog-fixes
(catalog-fixes) $ vi schema/catalog/product.sql # edit table definition
(catalog-fixes) $ vi schema/catalog/product_dimensions.sql # add new table
(catalog-fixes) $ bin/morphism lint schema/catalog # check syntax
ERROR schema/catalog/product_dimensions.sql, line 2: unknown datatype 'intt'
1: CREATE TABLE product_dimensions (
2: `pd_id` intt<>(10) unsigned NOT NULL AUTO_INCREMENT,
(catalog-fixes) $ vi schema/catalog/product_dimensions.sql # fix table definition
(catalog-fixes) $ bin/morphism lint schema/catalog # check syntax
(catalog-fixes) $ git add schema/catalog
(catalog-fixes) $ git rm schema/catalog/discontinued.sql # delete a table
(catalog-fixes) $ git commit -m "various changes to catalog schema"
(catalog-fixes) $ # alter the database to match the schema files
(catalog-fixes) $ bin/morphism diff --apply-changes=confirm config.yml catalog
-- --------------------------------
-- Connection: catalog
-- --------------------------------
DROP TABLE IF EXISTS `discontinued`;
ALTER TABLE `product`
MODIFY COLUMN `pr_name` varchar(255) NOT NULL,
MODIFY COLUMN `pr_description` text NOT NULL,
ADD COLUMN `pr_modified` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP AFTER `pr_description`;
CREATE TABLE `product_dimensions` (
`pd_id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`pd_width` decimal(10,2) NOT NULL,
`pd_height` decimal(10,2) NOT NULL,
`pd_depth` decimal(10,2) NOT NULL,
PRIMARY KEY (`pd_id`)
) ENGINE=InnoDB;
-- Confirm changes to catalog:
DROP TABLE IF EXISTS `discontinued`;
-- Apply this change? [y]es [n]o [a]ll [q]uit: y
ALTER TABLE `product`
MODIFY COLUMN `pr_name` varchar(255) NOT NULL,
MODIFY COLUMN `pr_description` text NOT NULL,
ADD COLUMN `pr_modified` timestamp NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP AFTER `pr_description`;
-- Apply this change? [y]es [n]o [a]ll [q]uit: y
CREATE TABLE `product_dimensions` (
`pd_id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`pd_width` decimal(10,2) NOT NULL,
`pd_height` decimal(10,2) NOT NULL,
`pd_depth` decimal(10,2) NOT NULL,
PRIMARY KEY (`pd_id`)
) ENGINE=InnoDB;
-- Apply this change? [y]es [n]o [a]ll [q]uit: y
(catalog-fixes) $ # hack hack hack
(catalog-fixes) $ ...
(catalog-fixes) $ # do some work back on master...
(catalog-fixes) $ git checkout master
(master) $ # restore schema to previous state
(master) $ bin/morphism diff --apply-changes=yes config.yml catalog
```
## Testing
``` bash
$ make test
```
## Security
If you discover any security related issues, please email [email protected] instead of using the issue tracker.
## Credits
- [All Contributors](../../contributors)
## License
The MIT License (MIT). Please see [License File](LICENSE.md) for more information.