Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/w3tecch/typeorm-seeding
🌱 A delightful way to seed test data into your database.
https://github.com/w3tecch/typeorm-seeding
cli data-seeding database seed seeding typeorm typeorm-extension typescript
Last synced: about 2 months ago
JSON representation
🌱 A delightful way to seed test data into your database.
- Host: GitHub
- URL: https://github.com/w3tecch/typeorm-seeding
- Owner: w3tecch
- License: mit
- Created: 2018-09-25T13:30:22.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2023-12-29T20:27:33.000Z (9 months ago)
- Last Synced: 2024-04-04T08:02:42.178Z (6 months ago)
- Topics: cli, data-seeding, database, seed, seeding, typeorm, typeorm-extension, typescript
- Language: TypeScript
- Homepage: https://www.npmjs.com/package/typeorm-seeding
- Size: 1.19 MB
- Stars: 867
- Watchers: 17
- Forks: 129
- Open Issues: 38
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
TypeORM Seeding
A delightful way to seed test data into your database.
Inspired by the awesome framework laravel in PHP and of the repositories from pleerock
Made with ❤️ by Gery Hirschfeld and contributors
## ❯ Table of contents
- [Introduction](#-introduction)
- [Installation](#-installation)
- [Basic Seeder](#-basic-seeder)
- [Using Entity Factory](#-using-entity-factory)
- [Seeding Data in Testing](#-seeding-data-in-testing)
- [Changelog](#-changelog)
- [License](#-license)
## ❯ Introduction
Isn't it exhausting to create some sample data for your database, well this time is over!
How does it work? Just create a entity factory for your entities (models) and a seed script.
### Entity
First create your TypeORM entities.
```typescript
// user.entity.ts
@Entity()
export class User {
@PrimaryGeneratedColumn('uuid') id: string
@Column({ nullable: true }) name: string
@Column({ type: 'varchar', length: 100, nullable: false }) password: string
@OneToMany((type) => Pet, (pet) => pet.user) pets: Pet[]
@BeforeInsert()
async setPassword(password: string) {
const salt = await bcrypt.genSalt()
this.password = await bcrypt.hash(password || this.password, salt)
}
}
// pet.entity.ts
@Entity()
export class Pet {
@PrimaryGeneratedColumn('uuid') id: string
@Column() name: string
@Column() age: number
@ManyToOne((type) => User, (user) => user.pets)
@JoinColumn({ name: 'user_id' })
user: User
}
```
### Factory
Then for each entity define a factory. The purpose of a factory is to create new entites with generate data.
> Note: Factories can also be used to generate data for testing.
```typescript
// user.factory.ts
define(User, (faker: typeof Faker) => {
const gender = faker.datatype.number(1)
const firstName = faker.name.firstName(gender)
const lastName = faker.name.lastName(gender)
const user = new User()
user.name = `${firstName} ${lastName}`
user.password = faker.random.word()
return user
})
// pet.factory.ts
define(Pet, (faker: typeof Faker) => {
const gender = faker.datatype.number(1)
const name = faker.name.firstName(gender)
const pet = new Pet()
pet.name = name
pet.age = faker.datatype.number()
pet.user = factory(User)() as any
return pet
})
```
### Seeder
And last but not least, create a seeder. The seeder can be called by the configured cli command `seed:run`. In this case it generates 10 pets with a owner (User).
> Note: `seed:run` must be configured first. Go to [CLI Configuration](#cli-configuration).
```typescript
// create-pets.seed.ts
export default class CreatePets implements Seeder {
public async run(factory: Factory, connection: Connection): Promise {
await factory(Pet)().createMany(10)
}
}
```
Until [this issue](https://github.com/w3tecch/typeorm-seeding/issues/119) is closed, seeder files must not contain any other export statement besides the one that exports the seeder class.
## ❯ Installation
Before using this TypeORM extension please read the [TypeORM Getting Started](https://typeorm.io/#/) documentation. This explains how to setup a TypeORM project.
After that install the extension with `npm` or `yarn`.
```bash
npm i typeorm-seeding
# or
yarn add typeorm-seeding
```
Optional, install the type definitions of the `Faker` library.
```bash
npm install -D @types/faker
```
### Configuration
To configure the path to your seeds and factories change the TypeORM config file (ormconfig.js or ormconfig.json).
> The default paths are `src/database/{seeds,factories}/**/*{.ts,.js}`
**ormconfig.js**
```JavaScript
module.exports = {
...
seeds: ['src/seeds/**/*{.ts,.js}'],
factories: ['src/factories/**/*{.ts,.js}'],
}
```
**.env**
```
TYPEORM_SEEDING_FACTORIES=src/factories/**/*{.ts,.js}
TYPEORM_SEEDING_SEEDS=src/seeds/**/*{.ts,.js}
```
### CLI Configuration
Add the following scripts to your `package.json` file to configure the seed cli commands.
```
"scripts": {
"seed:config": "ts-node ./node_modules/typeorm-seeding/dist/cli.js config",
"seed:run": "ts-node ./node_modules/typeorm-seeding/dist/cli.js seed",
...
}
```
To execute the seed run `npm run seed:run` in the terminal.
> Note: More CLI options are [here](#cli-options)
Add the following TypeORM cli commands to the package.json to drop and sync the database.
```
"scripts": {
...
"schema:drop": "ts-node ./node_modules/typeorm/cli.js schema:drop",
"schema:sync": "ts-node ./node_modules/typeorm/cli.js schema:sync",
...
}
```
#### CLI Options
| Option | Default | Description |
| ---------------------- | --------------- | --------------------------------------------------------------------------- |
| `--seed` or `-s` | null | Option to specify a seeder class to run individually. |
| `--connection` or `-c` | null | Name of the typeorm connection. Required if there are multiple connections. |
| `--configName` or `-n` | `ormconfig.js` | Name to the typeorm config file. |
| `--root` or `-r` | `process.cwd()` | Path to the typeorm config file. |
## ❯ Basic Seeder
A seeder class only contains one method by default `run`. Within this method, you may insert data into your database. For manually insertion use the [Query Builder](https://typeorm.io/#/select-query-builder) or use the [Entity Factory](#-using-entity-factory)
> Note. The seeder files will be executed alphabetically.
```typescript
import { Factory, Seeder } from 'typeorm-seeding'
import { Connection } from 'typeorm'
import { User } from '../entities'
export default class CreateUsers implements Seeder {
public async run(factory: Factory, connection: Connection): Promise {
await connection
.createQueryBuilder()
.insert()
.into(User)
.values([
{ firstName: 'Timber', lastName: 'Saw' },
{ firstName: 'Phantom', lastName: 'Lancer' },
])
.execute()
}
}
```
## ❯ Using Entity Factory
Of course, manually specifying the attributes for each entity seed is cumbersome. Instead, you can use entity factories to conveniently generate large amounts of database records.
For all entities we want to create, we need to define a factory. To do so we give you the awesome [faker](https://github.com/marak/Faker.js/) library as a parameter into your factory. Then create your "fake" entity and return it. Those factory files should be in the `src/database/factories` folder and suffixed with `.factory` like `src/database/factories/user.factory.ts`.
| Types | Description |
| --------------- | ------------------------------------------------------------------------------- |
| `Entity` | TypeORM Entity like the user or the pet in the samples. |
| `Context` | Argument to pass some static data into the factory function. |
| `EntityFactory` | This object is used to make new filled entities or create it into the database. |
### `define`
The define function creates a new entity factory.
```typescript
define: (entity: Entity, factoryFn: FactoryFunction) => void;
```
```typescript
import Faker from 'faker'
import { define } from 'typeorm-seeding'
import { User } from '../entities'
define(User, (faker: typeof Faker, context: { roles: string[] }) => { ... })
```
### `factory`
Factory retrieves the defined factory function and returns the EntityFactory to start creating new enities.
```typescript
factory: (entity: Entity) => (context?: Context) => EntityFactory
```
```typescript
factory(Pet)()
factory(Pet)({ name: 'Balou' })
```
### EntityFactory
#### `map`
Use the `.map()` function to alter the generated value before they get persisted.
```typescript
map(mapFunction: (entity: Entity) => Promise): EntityFactory
```
```typescript
await factory(User)()
.map(async (user: User) => {
const pets: Pet[] = await factory(Pet)().createMany(2)
const petIds = pets.map((pet: Pet) => pet.Id)
await user.pets().attach(petIds)
})
.createMany(5)
```
#### `make` & `makeMany`
Make and makeMany executes the factory functions and return a new instance of the given entity. The instance is filled with the generated values from the factory function, but not saved in the database.
**overrideParams** - Override some of the attributes of the entity.
```typescript
make(overrideParams: EntityProperty = {}): Promise
```
```typescript
await factory(User)().make()
await factory(User)().makeMany(10)
// override the email
await factory(User)().make({ email: '[email protected]' })
await factory(User)().makeMany(10, { email: '[email protected]' })
```
#### `create` & `createMany`
the create and createMany method is similar to the make and makeMany method, but at the end the created entity instance gets persisted in the database.
**overrideParams** - Override some of the attributes of the entity.
**saveOptions** - [Save options](https://github.com/typeorm/typeorm/blob/master/src/repository/SaveOptions.ts) from typeorm
```typescript
create(overrideParams: EntityProperty = {}, saveOptions?: SaveOptions): Promise
createMany(amount: number, overrideParams: EntityProperty = {}, saveOptions?: SaveOptions): Promise
```
```typescript
await factory(User)().create()
await factory(User)().createMany(10)
// override the email
await factory(User)().create({ email: '[email protected]' })
await factory(User)().createMany(10, { email: '[email protected]' })
// using save options
await factory(User)().create({ email: '[email protected]' }, { listeners: false })
await factory(User)().createMany(10, { email: '[email protected]' }, { listeners: false })
```
## ❯ Seeding Data in Testing
The entity factories can also be used in testing. To do so call the `useSeeding` function, which loads all the defined entity factories.
Choose your test database wisley. We suggest to run your test in a sqlite in memory database.
```json
{
"type": "sqlite",
"name": "memory",
"database": ":memory:"
}
```
However, if the test database is not in memory, than use the `--runInBand` flag to disable parallelizes runs.
```typescript
describe("UserService", () => {
let connection: Connection
beforeAll(async (done) => {
connection = await useRefreshDatabase({ connection: 'memory' })
await useSeeding()
const user = await factory(User)().make()
const createdUser = await factory(User)().create()
await runSeeder(CreateUserSeed)
done()
})
afterAll(async (done) => {
await tearDownDatabase()
done()
})
test('Should ...', () => { ... })
})
```
### `useSeeding`
Loads the defined entity factories.
```typescript
useSeeding(options: ConfigureOption = {}): Promise
```
### `runSeeder`
Runs the given seeder class.
```typescript
runSeeder(seed: SeederConstructor): Promise
```
### `useRefreshDatabase`
Connects to the database, drops it and recreates the schema.
```typescript
useRefreshDatabase(options: ConfigureOption = {}): Promise
```
### `tearDownDatabase`
Closes the open database connection.
```typescript
tearDownDatabase(): Promise
```
### `ConfigureOption`
```typescript
interface ConfigureOption {
root?: string // path to the orm config file. Default = process.cwd()
configName?: string // name of the config file. eg. ormconfig.js
connection?: string // name of the database connection.
}
```
## ❯ Example Projects
> Please fill free to add your open-source project here. This helps others to better understand the seeding technology.
| Project | Description |
| ---------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
| [copa-ch/copa-backend](https://github.com/copa-ch/copa-backend/tree/master/src/database) | 🚀 Nest application written in TypeScript for the COPA project. This app manages your tournaments and generates the schedules. |
## ❯ Changelog
[Changelog](https://github.com/w3tecch/typeorm-seeding/releases)
## ❯ License
[MIT](LICENSE)