Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/Tinram/Database-Filler
MySQL/MariaDB: populate database tables and test schema design by parsing the SQL schema file.
https://github.com/Tinram/Database-Filler
database-schema database-testing mariadb mysql mysql-schema mysql-test schema schemas
Last synced: 7 days ago
JSON representation
MySQL/MariaDB: populate database tables and test schema design by parsing the SQL schema file.
- Host: GitHub
- URL: https://github.com/Tinram/Database-Filler
- Owner: Tinram
- License: gpl-3.0
- Archived: true
- Created: 2014-12-14T18:17:49.000Z (almost 10 years ago)
- Default Branch: master
- Last Pushed: 2022-01-21T21:08:35.000Z (almost 3 years ago)
- Last Synced: 2024-08-01T22:04:56.323Z (4 months ago)
- Topics: database-schema, database-testing, mariadb, mysql, mysql-schema, mysql-test, schema, schemas
- Language: PHP
- Homepage:
- Size: 66.4 KB
- Stars: 9
- Watchers: 1
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
##### This repo is shoved into retirement. The schema file parsing and single-threaded nature of PHP, along with high memory usage makes this package obsolete.
##### More efficient alternatives are [MySQL-Filler](https://github.com/Tinram/MySQL-Filler) and [mysql_random_data_load](https://github.com/Percona-Lab/mysql_random_data_load).
# Database Filler
#### Populate MySQL database tables with test data by parsing the SQL schema file.
## Purpose
+ Database table population without using any real or sensitive data:
+ Schema design and development:
+ Check table field population with specified datatypes, potential data truncation etc.
+ Test connection encoding and character encoding, and data insertion speeds.
[1]: https://tinram.github.io/images/databasefiller-data.png
![Database-Filler database][1]
## Background
Originally, I needed to populate a database containing 14 complex tables. Tools such as Spawner are ideal for populating small tables, but in this case, specifying the datatypes for 300+ fields to initiate Spawner would have been insanity.
Instead, why not parse the SQL schema?
[2]: https://tinram.github.io/images/databasefiller-execute.png
![Database-Filler execute][2]
## Database Requirements
1. The script expects the database schema to already exist in MySQL (`mysql -u root -p < test.sql`).
2. **All table names** and **column names** in the MySQL schema **require back-ticks**.
3. **Unique keys must be removed** from tables when the configuration array option *random_data* is set to false.
## Other
+ The majority of MySQL datatypes are supported.
+ Any foreign keys are disabled on data population.
+ Random character generation is slow in PHP, and such slowness further depends on field length, number of fields, and the number of rows being generated.
+ Multiple INSERTs are added in a single query, which is quite fast. The number of INSERTs per second will depend on MySQL configuration settings (the defaults are not optimised), datatype / length inserted, system load, operating system, hardware etc.
## Further Options
Configuration boolean toggles (`false` by default):
+ *incremental_ints*
+ make added integers incremental, enabling simplistic integer foreign keys.
+ *populate_primary_key*
+ populate a primary key field, e.g. a UUID used as a primary key (experimental, supports only some definitions).
## Set-up
Ensure the database already exists in MySQL
e.g. for the test schema:
```bash
mysql -u root -p < test.sql
```
Adjust the array connection details and parameters in the file *databasefiller_example.php*
Then execute this file with PHP on the command-line:
```bash
php databasefiller_example.php
```
*or* run the file through a web server e.g.
http://localhost/Database-Filler/databasefiller_example.php
## Other Projects
+ [SQLParser](https://github.com/iamcal/SQLParser)
+ [schema-parser-mysql](https://github.com/ekhaled/schema-parser-mysql/)
+ [MySQL_Filler](https://github.com/Tinram/MySQL_Filler)
*SQLParser* would have been used in this project had it been available in 2014.
## License
Database Filler is released under the [GPL v.3](https://www.gnu.org/licenses/gpl-3.0.html).